2024-06-06T08:18:16.511 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-06T08:18:16.511 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsx}} --archive /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250 --verbose --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250/orig.config.yaml 2024-06-06T08:18:16.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-06T08:18:16.658 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsx}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7743250' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 3d746ca5346f34eef7e826a1eb71e59e02b682ae owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5050 sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba sleep_before_teardown: 0 subset: 416/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 3d746ca5346f34eef7e826a1eb71e59e02b682ae syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDw8T9kKqIzg4S/7/oigKdSuJCmV3tcBn0yJt+iUxT3O4NWUciS/9O0cZ3NhXBinRXdZRz3/Lai2gkWksuo80to= smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLwE7xGnQdAL0YhB0iBjxVQKj2TfYjpDjdiee6HDEhXy97iZ8fJR8wyOd/RTI6Hwe5mmJfUhfh7cBIOG0zMvOcc= smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGjrA/JIjKjQDco3so2XkqEp2eeSpIZrcXmjTVHHWYRT0ftqGmGMcU8/fqsYih0ABQ8Mcaj2LC3mnm3KjG76ee8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-05_21:24:16 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-06T08:18:16.658 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa; will attempt to use it 2024-06-06T08:18:16.659 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks 2024-06-06T08:18:16.659 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-06T08:18:16.661 INFO:teuthology.task.internal:Checking packages... 2024-06-06T08:18:16.681 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d89accfe3201286f000e065a1faea2a88c7a6ba' 2024-06-06T08:18:16.681 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-06T08:18:16.681 INFO:teuthology.packaging:ref: None 2024-06-06T08:18:16.681 INFO:teuthology.packaging:tag: None 2024-06-06T08:18:16.681 INFO:teuthology.packaging:branch: squid 2024-06-06T08:18:16.681 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:18:16.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-06T08:18:16.985 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2960.g3d746ca5 2024-06-06T08:18:16.986 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-06T08:18:16.992 INFO:teuthology.task.internal:no buildpackages task found 2024-06-06T08:18:16.993 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-06T08:18:17.012 INFO:teuthology.task.internal:Saving configuration 2024-06-06T08:18:17.030 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-06T08:18:17.037 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-06T08:18:17.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-06 08:13:34.145577', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDw8T9kKqIzg4S/7/oigKdSuJCmV3tcBn0yJt+iUxT3O4NWUciS/9O0cZ3NhXBinRXdZRz3/Lai2gkWksuo80to='} 2024-06-06T08:18:17.084 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-06 08:13:34.142767', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLwE7xGnQdAL0YhB0iBjxVQKj2TfYjpDjdiee6HDEhXy97iZ8fJR8wyOd/RTI6Hwe5mmJfUhfh7cBIOG0zMvOcc='} 2024-06-06T08:18:17.105 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-06 08:13:34.144446', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGjrA/JIjKjQDco3so2XkqEp2eeSpIZrcXmjTVHHWYRT0ftqGmGMcU8/fqsYih0ABQ8Mcaj2LC3mnm3KjG76ee8='} 2024-06-06T08:18:17.106 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-06T08:18:17.113 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-06-06T08:18:17.114 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-06-06T08:18:17.114 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-06-06T08:18:17.114 INFO:teuthology.run_tasks:Running task console_log... 2024-06-06T08:18:17.197 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6f280f7be0>, signals=[15]) 2024-06-06T08:18:17.197 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-06T08:18:17.203 INFO:teuthology.task.internal:Opening connections... 2024-06-06T08:18:17.203 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi028.front.sepia.ceph.com 2024-06-06T08:18:17.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T08:18:17.282 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-06-06T08:18:17.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T08:18:17.356 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-06-06T08:18:17.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T08:18:17.429 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-06T08:18:17.436 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2024-06-06T08:18:17.454 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2024-06-06T08:18:17.455 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-06-06T08:18:17.512 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-06T08:18:17.513 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-06T08:18:17.514 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-06-06T08:18:17.533 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-06-06T08:18:17.552 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-06-06T08:18:17.552 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-06-06T08:18:17.610 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-06-06T08:18:17.610 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-06-06T08:18:17.610 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-06-06T08:18:17.610 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-06-06T08:18:17.610 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-06-06T08:18:17.610 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-06-06T08:18:17.610 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-06T08:18:17.610 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-06-06T08:18:17.611 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-06-06T08:18:17.611 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-06T08:18:17.611 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-06-06T08:18:17.611 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-06T08:18:17.611 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-06T08:18:17.611 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-06T08:18:17.611 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-06-06T08:18:17.633 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-06-06T08:18:17.651 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-06-06T08:18:17.652 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-06-06T08:18:17.710 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-06-06T08:18:17.710 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-06-06T08:18:17.710 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-06-06T08:18:17.710 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-06-06T08:18:17.710 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-06-06T08:18:17.710 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-06-06T08:18:17.710 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-06T08:18:17.711 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-06-06T08:18:17.711 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-06-06T08:18:17.711 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-06T08:18:17.711 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-06-06T08:18:17.711 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-06T08:18:17.711 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-06T08:18:17.711 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-06T08:18:17.711 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-06-06T08:18:17.734 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-06T08:18:17.745 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-06T08:18:17.751 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-06T08:18:17.751 DEBUG:teuthology.orchestra.run.smithi028:> test '!' -e /home/ubuntu/cephtest 2024-06-06T08:18:17.753 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-06-06T08:18:17.756 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-06-06T08:18:17.772 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-06T08:18:17.778 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-06T08:18:17.779 DEBUG:teuthology.orchestra.run.smithi028:> test -z $(ls -A /var/lib/ceph) 2024-06-06T08:18:17.811 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-06-06T08:18:17.813 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-06-06T08:18:17.841 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-06T08:18:17.921 INFO:teuthology.run_tasks:Running task kernel... 2024-06-06T08:18:17.937 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-06-06T08:18:17.937 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-06-06T08:18:17.937 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-06-06T08:18:17.938 DEBUG:teuthology.orchestra.run.smithi028:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-06T08:18:17.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:18:17.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-06-06T08:18:18.186 DEBUG:teuthology.task.kernel:sha1 for client.0 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-06T08:18:18.187 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-06-06T08:18:18.187 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-06-06T08:18:18.205 INFO:teuthology.orchestra.run.smithi028.stdout:5.14.0-437.el9.x86_64 2024-06-06T08:18:18.205 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-06T08:18:18.205 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-06-06T08:18:18.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum upgrade -y linux-firmware 2024-06-06T08:18:20.540 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.1 MB 00:00 2024-06-06T08:18:22.333 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - AppStream 30 MB/s | 19 MB 00:00 2024-06-06T08:18:26.508 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-06-06T08:18:27.992 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 17 kB 00:00 2024-06-06T08:18:29.329 INFO:teuthology.orchestra.run.smithi028.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-06-06T08:18:34.693 INFO:teuthology.orchestra.run.smithi028.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-06-06T08:18:36.922 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-06-06T08:18:36.923 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-06-06T08:18:36.923 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-06-06T08:18:37.035 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-06-06T08:18:37.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-06T08:18:37.176 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-06-06T08:18:37.176 DEBUG:teuthology.orchestra.run.smithi028:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-06-06T08:18:37.179 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi028.front.sepia.ceph.com to complete... 2024-06-06T08:18:49.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06 08:18:49 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-06-06T08:18:49.353 INFO:teuthology.orchestra.run.smithi028.stderr:FINISHED --2024-06-06 08:18:49-- 2024-06-06T08:18:49.353 INFO:teuthology.orchestra.run.smithi028.stderr:Total wall clock time: 12s 2024-06-06T08:18:49.353 INFO:teuthology.orchestra.run.smithi028.stderr:Downloaded: 1 files, 340M in 12s (28.7 MB/s) 2024-06-06T08:18:49.357 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-06-06T08:18:49.357 DEBUG:teuthology.orchestra.run.smithi028:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-06-06T08:18:51.536 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying... ######################################## 2024-06-06T08:18:51.678 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing... ######################################## 2024-06-06T08:18:51.804 INFO:teuthology.orchestra.run.smithi028.stdout:Updating / installing... 2024-06-06T08:19:00.125 INFO:teuthology.orchestra.run.smithi028.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-06-06T08:19:39.691 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi028.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-06-06T08:19:39.692 DEBUG:teuthology.orchestra.run.smithi028:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-06-06T08:19:39.779 INFO:teuthology.orchestra.run.smithi028.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/boot/config-6.9.0-gb9459a26b088 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-06-06T08:19:39.780 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-06-06T08:19:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-06-06T08:19:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-06-06T08:19:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-06-06T08:19:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-06-06T08:19:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-06-06T08:19:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-06-06T08:19:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-06-06T08:19:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-06-06T08:19:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-06-06T08:19:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-06-06T08:19:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-06-06T08:19:39.782 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-06-06T08:19:39.782 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-06-06T08:19:39.782 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-06-06T08:19:39.782 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-06-06T08:19:39.782 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-06-06T08:19:39.782 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-06-06T08:19:39.782 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-06-06T08:19:39.782 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-06-06T08:19:39.782 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-06-06T08:19:39.782 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-06-06T08:19:39.782 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-06-06T08:19:39.783 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-06-06T08:19:39.784 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-06-06T08:19:39.784 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-06-06T08:19:39.784 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-06-06T08:19:39.784 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-06-06T08:19:39.784 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-06-06T08:19:39.784 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-06-06T08:19:39.784 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-06-06T08:19:39.784 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-06-06T08:19:39.784 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-06-06T08:19:39.784 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-06-06T08:19:39.785 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-06-06T08:19:39.786 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-06-06T08:19:39.786 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-06-06T08:19:39.786 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-06-06T08:19:39.786 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-06-06T08:19:39.786 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-06-06T08:19:39.786 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-06-06T08:19:39.786 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-06-06T08:19:39.786 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-06-06T08:19:39.786 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-06-06T08:19:39.787 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-06-06T08:19:39.787 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-06-06T08:19:39.787 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-06-06T08:19:39.787 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-06-06T08:19:39.787 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-06-06T08:19:39.787 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-06-06T08:19:39.787 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-06-06T08:19:39.787 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-06-06T08:19:39.787 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-06-06T08:19:39.787 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-06-06T08:19:39.787 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-06-06T08:19:39.788 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-06-06T08:19:39.788 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-06-06T08:19:39.788 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-06-06T08:19:39.788 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-06-06T08:19:39.788 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-06-06T08:19:39.788 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-06-06T08:19:39.788 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-06-06T08:19:39.788 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-06-06T08:19:39.788 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-06-06T08:19:39.788 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-06-06T08:19:39.789 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-06-06T08:19:39.789 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-06-06T08:19:39.789 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-06-06T08:19:39.789 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-06-06T08:19:39.789 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-06-06T08:19:39.789 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-06-06T08:19:39.789 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-06-06T08:19:39.789 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-06-06T08:19:39.789 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-06-06T08:19:39.789 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-06-06T08:19:39.790 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-06-06T08:19:39.790 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-06-06T08:19:39.790 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-06-06T08:19:39.790 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-06-06T08:19:39.790 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-06-06T08:19:39.790 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-06-06T08:19:39.790 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-06-06T08:19:39.790 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-06-06T08:19:39.791 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-06-06T08:19:39.791 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-06-06T08:19:39.791 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-06-06T08:19:39.791 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-06-06T08:19:39.791 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-06-06T08:19:39.791 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-06-06T08:19:39.791 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-06-06T08:19:39.791 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-06-06T08:19:39.792 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-06-06T08:19:39.792 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-06-06T08:19:39.792 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-06-06T08:19:39.792 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-06-06T08:19:39.792 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-06-06T08:19:39.792 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-06-06T08:19:39.792 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-06-06T08:19:39.792 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-06-06T08:19:39.792 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-06-06T08:19:39.792 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-06-06T08:19:39.792 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-06-06T08:19:39.793 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-06-06T08:19:39.794 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-06-06T08:19:39.795 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-06-06T08:19:39.796 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-06-06T08:19:39.797 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-06-06T08:19:39.798 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-06-06T08:19:39.799 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-06-06T08:19:39.800 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-06-06T08:19:39.801 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-06-06T08:19:39.802 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-06-06T08:19:39.803 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-06-06T08:19:39.804 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-06-06T08:19:39.805 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-06-06T08:19:39.806 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-06-06T08:19:39.807 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-06-06T08:19:39.808 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-06-06T08:19:39.809 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-06-06T08:19:39.810 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-06-06T08:19:39.811 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-06-06T08:19:39.812 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-06-06T08:19:39.813 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-06-06T08:19:39.813 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-06-06T08:19:39.813 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-06-06T08:19:39.813 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-06-06T08:19:39.813 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-06-06T08:19:39.813 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-06-06T08:19:39.813 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-06-06T08:19:39.813 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-06-06T08:19:39.813 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-06-06T08:19:39.814 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-06-06T08:19:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-06-06T08:19:39.816 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-06-06T08:19:39.817 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-06-06T08:19:39.818 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-06-06T08:19:39.818 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-06-06T08:19:39.818 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-06-06T08:19:39.818 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-06-06T08:19:39.818 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-06-06T08:19:39.818 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-06-06T08:19:39.818 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-06-06T08:19:39.818 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-06-06T08:19:39.818 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-06-06T08:19:39.818 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-06-06T08:19:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-06-06T08:19:39.820 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-06-06T08:19:39.820 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-06-06T08:19:39.820 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-06-06T08:19:39.820 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-06-06T08:19:39.820 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-06-06T08:19:39.820 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-06-06T08:19:39.820 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-06-06T08:19:39.820 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-06-06T08:19:39.820 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-06-06T08:19:39.821 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-06-06T08:19:39.821 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-06-06T08:19:39.821 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-06-06T08:19:39.821 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-06-06T08:19:39.821 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-06-06T08:19:39.821 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-06-06T08:19:39.821 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-06-06T08:19:39.821 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-06-06T08:19:39.821 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-06-06T08:19:39.821 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-06-06T08:19:39.821 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-06-06T08:19:39.822 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-06-06T08:19:39.822 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-06-06T08:19:39.822 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-06-06T08:19:39.822 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-06-06T08:19:39.822 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-06-06T08:19:39.822 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-06-06T08:19:39.822 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-06-06T08:19:39.822 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-06-06T08:19:39.823 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-06-06T08:19:39.823 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-06-06T08:19:39.823 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-06-06T08:19:39.823 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-06-06T08:19:39.823 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-06-06T08:19:39.823 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-06-06T08:19:39.823 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-06-06T08:19:39.823 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-06-06T08:19:39.824 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-06-06T08:19:39.824 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-06-06T08:19:39.824 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-06-06T08:19:39.824 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-06-06T08:19:39.824 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-06-06T08:19:39.824 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-06-06T08:19:39.824 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-06-06T08:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-06-06T08:19:39.826 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-06-06T08:19:39.827 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-06-06T08:19:39.827 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-06-06T08:19:39.827 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-06-06T08:19:39.827 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-06-06T08:19:39.827 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-06-06T08:19:39.827 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-06-06T08:19:39.827 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-06-06T08:19:39.827 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-06-06T08:19:39.827 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-06-06T08:19:39.827 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-06-06T08:19:39.827 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-06-06T08:19:39.828 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-06-06T08:19:39.828 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-06-06T08:19:39.828 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-06-06T08:19:39.828 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-06-06T08:19:39.828 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-06-06T08:19:39.828 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-06-06T08:19:39.828 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-06-06T08:19:39.829 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-06-06T08:19:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-06-06T08:19:39.831 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-06-06T08:19:39.832 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-06-06T08:19:39.833 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-06-06T08:19:39.834 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-06-06T08:19:39.835 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-06-06T08:19:39.836 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-06-06T08:19:39.837 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-06-06T08:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-06-06T08:19:39.839 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-06-06T08:19:39.840 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-06-06T08:19:39.841 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-06-06T08:19:39.841 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-06-06T08:19:39.841 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-06-06T08:19:39.841 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-06-06T08:19:39.841 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-06-06T08:19:39.841 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-06-06T08:19:39.841 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-06-06T08:19:39.841 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-06-06T08:19:39.841 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-06-06T08:19:39.841 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-06-06T08:19:39.841 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-06-06T08:19:39.842 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-06-06T08:19:39.843 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-06-06T08:19:39.844 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-06-06T08:19:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-06-06T08:19:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-06-06T08:19:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-06-06T08:19:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-06-06T08:19:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-06-06T08:19:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-06-06T08:19:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-06-06T08:19:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-06-06T08:19:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-06-06T08:19:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-06-06T08:19:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-06-06T08:19:39.846 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-06-06T08:19:39.847 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-06-06T08:19:39.848 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-06-06T08:19:39.849 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-06-06T08:19:39.850 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-06-06T08:19:39.850 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-06-06T08:19:39.850 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-06-06T08:19:39.850 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-06-06T08:19:39.850 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-06-06T08:19:39.850 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-06-06T08:19:39.850 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-06-06T08:19:39.850 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-06-06T08:19:39.851 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-06-06T08:19:39.852 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-06-06T08:19:39.852 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-06-06T08:19:39.852 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-06-06T08:19:39.852 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-06-06T08:19:39.852 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-06-06T08:19:39.852 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-06-06T08:19:39.852 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-06-06T08:19:39.852 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-06-06T08:19:39.852 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-06-06T08:19:39.852 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-06-06T08:19:39.853 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-06-06T08:19:39.853 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-06-06T08:19:39.853 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-06-06T08:19:39.853 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-06-06T08:19:39.853 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-06-06T08:19:39.853 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-06-06T08:19:39.853 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-06-06T08:19:39.853 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-06-06T08:19:39.853 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-06-06T08:19:39.853 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-06-06T08:19:39.854 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-06-06T08:19:39.855 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-06-06T08:19:39.855 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-06-06T08:19:39.855 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-06-06T08:19:39.855 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-06-06T08:19:39.855 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-06-06T08:19:39.855 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-06-06T08:19:39.855 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-06-06T08:19:39.855 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-06-06T08:19:39.856 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-06-06T08:19:39.856 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-06-06T08:19:39.856 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-06-06T08:19:39.856 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-06-06T08:19:39.856 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-06-06T08:19:39.856 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-06-06T08:19:39.856 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-06-06T08:19:39.856 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-06-06T08:19:39.856 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-06-06T08:19:39.856 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-06-06T08:19:39.856 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-06-06T08:19:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-06-06T08:19:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-06-06T08:19:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-06-06T08:19:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-06-06T08:19:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-06-06T08:19:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-06-06T08:19:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-06-06T08:19:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-06-06T08:19:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-06-06T08:19:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-06-06T08:19:39.858 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-06-06T08:19:39.858 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-06-06T08:19:39.858 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-06-06T08:19:39.858 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-06-06T08:19:39.858 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-06-06T08:19:39.858 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-06-06T08:19:39.858 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-06-06T08:19:39.858 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-06-06T08:19:39.858 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-06-06T08:19:39.858 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-06-06T08:19:39.859 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-06-06T08:19:39.859 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-06-06T08:19:39.859 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-06-06T08:19:39.859 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-06-06T08:19:39.859 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-06-06T08:19:39.859 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-06-06T08:19:39.859 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-06-06T08:19:39.859 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-06-06T08:19:39.859 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-06-06T08:19:39.859 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-06-06T08:19:39.860 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-06-06T08:19:39.860 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-06-06T08:19:39.860 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-06-06T08:19:39.860 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-06-06T08:19:39.860 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-06-06T08:19:39.860 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-06-06T08:19:39.860 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-06-06T08:19:39.860 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-06-06T08:19:39.860 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-06-06T08:19:39.861 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-06-06T08:19:39.861 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-06-06T08:19:39.861 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-06-06T08:19:39.861 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-06-06T08:19:39.861 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-06-06T08:19:39.861 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-06-06T08:19:39.861 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-06-06T08:19:39.861 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-06-06T08:19:39.862 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-06-06T08:19:39.862 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-06-06T08:19:39.862 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-06-06T08:19:39.862 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-06-06T08:19:39.862 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-06-06T08:19:39.862 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-06-06T08:19:39.862 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-06-06T08:19:39.862 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-06-06T08:19:39.862 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-06-06T08:19:39.862 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-06-06T08:19:39.863 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-06-06T08:19:39.863 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-06-06T08:19:39.863 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-06-06T08:19:39.863 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-06-06T08:19:39.863 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-06-06T08:19:39.863 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-06-06T08:19:39.863 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-06-06T08:19:39.863 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-06-06T08:19:39.864 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-06-06T08:19:39.865 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-06-06T08:19:39.866 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-06-06T08:19:39.867 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-06-06T08:19:39.868 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-06-06T08:19:39.869 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-06-06T08:19:39.870 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-06-06T08:19:39.871 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-06-06T08:19:39.872 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-06-06T08:19:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-06-06T08:19:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-06-06T08:19:39.875 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-06-06T08:19:39.876 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-06-06T08:19:39.877 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-06-06T08:19:39.878 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-06-06T08:19:39.879 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-06-06T08:19:39.880 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-06-06T08:19:39.881 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-06-06T08:19:39.882 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-06-06T08:19:39.883 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-06-06T08:19:39.883 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-06-06T08:19:39.883 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-06-06T08:19:39.883 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-06-06T08:19:39.883 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-06-06T08:19:39.883 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-06-06T08:19:39.883 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-06-06T08:19:39.883 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-06-06T08:19:39.883 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-06-06T08:19:39.883 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-06-06T08:19:39.884 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-06-06T08:19:39.884 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-06-06T08:19:39.884 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-06-06T08:19:39.884 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-06-06T08:19:39.884 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-06-06T08:19:39.884 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-06-06T08:19:39.884 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-06-06T08:19:39.884 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-06-06T08:19:39.884 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-06-06T08:19:39.884 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-06-06T08:19:39.884 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-06-06T08:19:39.885 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-06-06T08:19:39.885 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-06-06T08:19:39.885 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-06-06T08:19:39.885 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-06-06T08:19:39.885 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-06-06T08:19:39.885 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-06-06T08:19:39.885 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-06-06T08:19:39.885 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-06-06T08:19:39.885 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-06-06T08:19:39.886 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-06-06T08:19:39.886 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-06-06T08:19:39.886 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-06-06T08:19:39.886 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-06-06T08:19:39.886 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-06-06T08:19:39.886 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-06-06T08:19:39.886 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-06-06T08:19:39.886 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-06-06T08:19:39.886 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-06-06T08:19:39.886 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-06-06T08:19:39.886 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-06-06T08:19:39.887 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-06-06T08:19:39.887 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-06-06T08:19:39.887 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-06-06T08:19:39.887 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-06-06T08:19:39.887 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-06-06T08:19:39.887 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-06-06T08:19:39.887 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-06-06T08:19:39.887 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-06-06T08:19:39.887 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-06-06T08:19:39.887 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-06-06T08:19:39.888 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-06-06T08:19:39.889 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-06-06T08:19:39.889 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-06-06T08:19:39.889 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-06-06T08:19:39.889 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-06-06T08:19:39.889 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-06-06T08:19:39.889 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-06-06T08:19:39.889 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-06-06T08:19:39.889 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-06-06T08:19:39.890 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-06-06T08:19:39.891 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-06-06T08:19:39.891 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-06-06T08:19:39.891 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-06-06T08:19:39.891 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-06-06T08:19:39.891 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-06-06T08:19:39.891 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-06-06T08:19:39.891 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-06-06T08:19:39.891 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-06-06T08:19:39.892 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-06-06T08:19:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-06-06T08:19:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-06-06T08:19:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-06-06T08:19:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-06-06T08:19:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-06-06T08:19:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-06-06T08:19:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-06-06T08:19:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-06-06T08:19:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-06-06T08:19:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-06-06T08:19:39.893 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-06-06T08:19:39.894 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-06-06T08:19:39.894 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-06-06T08:19:39.894 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-06-06T08:19:39.894 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-06-06T08:19:39.894 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-06-06T08:19:39.894 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-06-06T08:19:39.894 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-06-06T08:19:39.894 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-06-06T08:19:39.894 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-06-06T08:19:39.894 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-06-06T08:19:39.895 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-06-06T08:19:39.895 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-06-06T08:19:39.895 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-06-06T08:19:39.895 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-06-06T08:19:39.895 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-06-06T08:19:39.895 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-06-06T08:19:39.895 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-06-06T08:19:39.895 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-06-06T08:19:39.896 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-06-06T08:19:39.896 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-06-06T08:19:39.896 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-06-06T08:19:39.896 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-06-06T08:19:39.896 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-06-06T08:19:39.896 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-06-06T08:19:39.896 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-06-06T08:19:39.896 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-06-06T08:19:39.896 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-06-06T08:19:39.897 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-06-06T08:19:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-06-06T08:19:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-06-06T08:19:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-06-06T08:19:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-06-06T08:19:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-06-06T08:19:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-06-06T08:19:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-06-06T08:19:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-06-06T08:19:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-06-06T08:19:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-06-06T08:19:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-06-06T08:19:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-06-06T08:19:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-06-06T08:19:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-06-06T08:19:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-06-06T08:19:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-06-06T08:19:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-06-06T08:19:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-06-06T08:19:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-06-06T08:19:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-06-06T08:19:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-06-06T08:19:39.899 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-06-06T08:19:39.900 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-06-06T08:19:39.901 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-06-06T08:19:39.901 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-06-06T08:19:39.901 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-06-06T08:19:39.901 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-06-06T08:19:39.901 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-06-06T08:19:39.901 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-06-06T08:19:39.902 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-06-06T08:19:39.903 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-06-06T08:19:39.903 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-06-06T08:19:39.903 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-06-06T08:19:39.903 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-06-06T08:19:39.903 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-06-06T08:19:39.903 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-06-06T08:19:39.903 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-06-06T08:19:39.903 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-06-06T08:19:39.903 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-06-06T08:19:39.903 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-06-06T08:19:39.904 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-06-06T08:19:39.905 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-06-06T08:19:39.906 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-06-06T08:19:39.907 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-06-06T08:19:39.908 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-06-06T08:19:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-06-06T08:19:39.910 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-06-06T08:19:39.911 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-06-06T08:19:39.912 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-06-06T08:19:39.913 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-06-06T08:19:39.914 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-06-06T08:19:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-06-06T08:19:39.916 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-06-06T08:19:39.917 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-06-06T08:19:39.918 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-06-06T08:19:39.919 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-06-06T08:19:39.920 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-06-06T08:19:39.920 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-06-06T08:19:39.920 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-06-06T08:19:39.920 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-06-06T08:19:39.920 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-06-06T08:19:39.920 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-06-06T08:19:39.920 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-06-06T08:19:39.920 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-06-06T08:19:39.920 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-06-06T08:19:39.920 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-06-06T08:19:39.920 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-06-06T08:19:39.921 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-06-06T08:19:39.922 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-06-06T08:19:39.923 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-06-06T08:19:39.923 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-06-06T08:19:39.923 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-06-06T08:19:39.923 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-06-06T08:19:39.923 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-06-06T08:19:39.923 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-06-06T08:19:39.923 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-06-06T08:19:39.923 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-06-06T08:19:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-06-06T08:19:39.925 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-06-06T08:19:39.925 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-06-06T08:19:39.925 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-06-06T08:19:39.925 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-06-06T08:19:39.925 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-06-06T08:19:39.925 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-06-06T08:19:39.925 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-06-06T08:19:39.925 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-06-06T08:19:39.925 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-06-06T08:19:39.925 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-06-06T08:19:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-06-06T08:19:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-06-06T08:19:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-06-06T08:19:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-06-06T08:19:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-06-06T08:19:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-06-06T08:19:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-06-06T08:19:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-06-06T08:19:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-06-06T08:19:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-06-06T08:19:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-06-06T08:19:39.927 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-06-06T08:19:39.928 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-06-06T08:19:39.929 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-06-06T08:19:39.929 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-06-06T08:19:39.929 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-06-06T08:19:39.929 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-06-06T08:19:39.929 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-06-06T08:19:39.929 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-06-06T08:19:39.929 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-06-06T08:19:39.929 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-06-06T08:19:39.929 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-06-06T08:19:39.930 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-06-06T08:19:39.931 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-06-06T08:19:39.931 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-06-06T08:19:39.931 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-06-06T08:19:39.931 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-06-06T08:19:39.931 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-06-06T08:19:39.931 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-06-06T08:19:39.931 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-06-06T08:19:39.931 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-06-06T08:19:39.931 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-06-06T08:19:39.931 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-06-06T08:19:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-06-06T08:19:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-06-06T08:19:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-06-06T08:19:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-06-06T08:19:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-06-06T08:19:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-06-06T08:19:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-06-06T08:19:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-06-06T08:19:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-06-06T08:19:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-06-06T08:19:39.933 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-06-06T08:19:39.933 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-06-06T08:19:39.933 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-06-06T08:19:39.933 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-06-06T08:19:39.933 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-06-06T08:19:39.933 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-06-06T08:19:39.933 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-06-06T08:19:39.933 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-06-06T08:19:39.933 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-06-06T08:19:39.933 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-06-06T08:19:39.934 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-06-06T08:19:39.934 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-06-06T08:19:39.934 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-06-06T08:19:39.934 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-06-06T08:19:39.934 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-06-06T08:19:39.934 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-06-06T08:19:39.934 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-06-06T08:19:39.934 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-06-06T08:19:39.934 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-06-06T08:19:39.934 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-06-06T08:19:39.935 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-06-06T08:19:39.935 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-06-06T08:19:39.935 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-06-06T08:19:39.935 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-06-06T08:19:39.935 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-06-06T08:19:39.935 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-06-06T08:19:39.935 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-06-06T08:19:39.935 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-06-06T08:19:39.935 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-06-06T08:19:39.936 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-06-06T08:19:39.937 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-06-06T08:19:39.938 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-06-06T08:19:39.939 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-06-06T08:19:39.939 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-06-06T08:19:39.939 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-06-06T08:19:39.939 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-06-06T08:19:39.939 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-06-06T08:19:39.939 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-06-06T08:19:39.939 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-06-06T08:19:39.939 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-06-06T08:19:39.939 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-06-06T08:19:39.940 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-06-06T08:19:39.941 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-06-06T08:19:39.941 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-06-06T08:19:39.941 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-06-06T08:19:39.941 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-06-06T08:19:39.941 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-06-06T08:19:39.941 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-06-06T08:19:39.941 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-06-06T08:19:39.941 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-06-06T08:19:39.941 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-06-06T08:19:39.941 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-06-06T08:19:39.941 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-06-06T08:19:39.942 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-06-06T08:19:39.943 INFO:teuthology.orchestra.run.smithi028.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-06-06T08:19:39.948 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-06-06T08:19:39.948 DEBUG:teuthology.orchestra.run.smithi028:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-06-06T08:19:39.974 INFO:teuthology.orchestra.run.smithi028.stdout:postinstall scriptlet (using /bin/sh): 2024-06-06T08:19:39.974 INFO:teuthology.orchestra.run.smithi028.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-06T08:19:39.974 INFO:teuthology.orchestra.run.smithi028.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-06-06T08:19:39.974 INFO:teuthology.orchestra.run.smithi028.stdout:fi 2024-06-06T08:19:39.974 INFO:teuthology.orchestra.run.smithi028.stdout:for file in vmlinuz System.map config; do 2024-06-06T08:19:39.974 INFO:teuthology.orchestra.run.smithi028.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-06-06T08:19:39.974 INFO:teuthology.orchestra.run.smithi028.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout: fi 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout:done 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout:fi 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout:fi 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout:preuninstall scriptlet (using /bin/sh): 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-06T08:19:39.975 INFO:teuthology.orchestra.run.smithi028.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-06-06T08:19:39.976 INFO:teuthology.orchestra.run.smithi028.stdout:fi 2024-06-06T08:19:39.976 DEBUG:teuthology.orchestra.run.smithi028:> sudo rpm -qi grub2-tools 2024-06-06T08:19:40.053 INFO:teuthology.orchestra.run.smithi028.stdout:Name : grub2-tools 2024-06-06T08:19:40.053 INFO:teuthology.orchestra.run.smithi028.stdout:Epoch : 1 2024-06-06T08:19:40.053 INFO:teuthology.orchestra.run.smithi028.stdout:Version : 2.06 2024-06-06T08:19:40.053 INFO:teuthology.orchestra.run.smithi028.stdout:Release : 68.el9 2024-06-06T08:19:40.053 INFO:teuthology.orchestra.run.smithi028.stdout:Architecture: x86_64 2024-06-06T08:19:40.053 INFO:teuthology.orchestra.run.smithi028.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:Group : Unspecified 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:Size : 8264254 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:License : GPLv3+ 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:Packager : builder@centos.org 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:Vendor : CentOS 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:Summary : Support tools for GRUB. 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout:Description : 2024-06-06T08:19:40.054 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:19:40.055 INFO:teuthology.orchestra.run.smithi028.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-06T08:19:40.055 INFO:teuthology.orchestra.run.smithi028.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-06T08:19:40.055 INFO:teuthology.orchestra.run.smithi028.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-06T08:19:40.055 INFO:teuthology.orchestra.run.smithi028.stdout:hardware devices. 2024-06-06T08:19:40.055 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:19:40.055 INFO:teuthology.orchestra.run.smithi028.stdout:This subpackage provides tools for support of all platforms. 2024-06-06T08:19:40.056 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-06T08:19:40.056 INFO:teuthology.task.kernel:Updating grub on smithi028 to boot 6.9.0-gb9459a26b088 2024-06-06T08:19:40.056 DEBUG:teuthology.orchestra.run.smithi028:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-06T08:19:40.638 INFO:teuthology.orchestra.run.smithi028.stderr:Generating grub configuration file ... 2024-06-06T08:19:42.152 INFO:teuthology.orchestra.run.smithi028.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-06T08:19:42.183 INFO:teuthology.orchestra.run.smithi028.stderr:done 2024-06-06T08:19:42.185 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-06-06T08:19:42.243 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.IZbYfpfafd 2024-06-06T08:19:42.243 DEBUG:teuthology.orchestra.run.smithi028:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IZbYfpfafd 2024-06-06T08:19:42.313 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.IZbYfpfafd 2024-06-06T08:19:42.458 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.IZbYfpfafd is 6KB 2024-06-06T08:19:42.481 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.IZbYfpfafd 2024-06-06T08:19:42.497 DEBUG:teuthology.orchestra.run.smithi028:> sudo /bin/ls /boot/loader/entries || true 2024-06-06T08:19:42.565 INFO:teuthology.orchestra.run.smithi028.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-06T08:19:42.565 INFO:teuthology.orchestra.run.smithi028.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-06T08:19:42.565 INFO:teuthology.orchestra.run.smithi028.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-06T08:19:42.566 INFO:teuthology.orchestra.run.smithi028.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-06-06T08:19:42.567 DEBUG:teuthology.orchestra.run.smithi028:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-06-06T08:19:42.733 DEBUG:teuthology.orchestra.run.smithi028:> sudo shutdown -r now 2024-06-06T08:20:12.736 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-06-06T08:20:12.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-06-06T08:20:12.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T08:20:31.134 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-06-06T08:20:40.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-06-06T08:20:40.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T08:20:58.530 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-06-06T08:21:10.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-06-06T08:21:10.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T08:21:10.989 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-06-06T08:21:11.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-06-06T08:21:11.631 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-gb9459a26b088"... 2024-06-06T08:21:11.631 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-06-06T08:21:11.690 INFO:teuthology.orchestra.run.smithi028.stdout:6.9.0-gb9459a26b088 2024-06-06T08:21:11.691 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-06-06T08:21:11.691 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-06T08:21:11.691 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-06T08:21:12.692 DEBUG:teuthology.parallel:result is None 2024-06-06T08:21:12.692 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-06T08:21:12.702 INFO:teuthology.task.internal:Creating test directory... 2024-06-06T08:21:12.703 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-06T08:21:12.708 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-06T08:21:12.714 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-06T08:21:12.752 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-06T08:21:12.759 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-06T08:21:12.766 INFO:teuthology.task.internal:Creating archive directory... 2024-06-06T08:21:12.766 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-06T08:21:12.770 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-06T08:21:12.773 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-06T08:21:12.817 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-06T08:21:12.825 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-06T08:21:12.825 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-06T08:21:12.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:21:12.859 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-06T08:21:12.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:21:12.877 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-06T08:21:12.881 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-06T08:21:12.902 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-06T08:21:12.933 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T08:21:12.950 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T08:21:12.972 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T08:21:12.989 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T08:21:13.065 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T08:21:13.114 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T08:21:13.118 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-06T08:21:13.125 INFO:teuthology.task.internal:Configuring sudo... 2024-06-06T08:21:13.125 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-06T08:21:13.130 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-06T08:21:13.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-06T08:21:13.194 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-06T08:21:13.203 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-06T08:21:13.203 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-06T08:21:13.208 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-06T08:21:13.210 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-06T08:21:13.245 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T08:21:13.359 DEBUG:teuthology.orchestra.run.smithi028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T08:21:13.440 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T08:21:13.517 DEBUG:teuthology.orchestra.run.smithi028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T08:21:13.586 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:21:13.586 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-06T08:21:13.688 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T08:21:13.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T08:21:13.784 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T08:21:13.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T08:21:13.913 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-06-06T08:21:13.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-06T08:21:13.980 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T08:21:14.025 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T08:21:14.075 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T08:21:14.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T08:21:14.203 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-06-06T08:21:14.203 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-06T08:21:14.270 DEBUG:teuthology.orchestra.run.smithi028:> sudo service rsyslog restart 2024-06-06T08:21:14.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-06-06T08:21:14.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-06-06T08:21:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T08:21:14.352 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T08:21:14.368 INFO:teuthology.orchestra.run.smithi028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T08:21:14.767 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-06T08:21:14.774 INFO:teuthology.task.internal:Starting timer... 2024-06-06T08:21:14.775 INFO:teuthology.run_tasks:Running task pcp... 2024-06-06T08:21:14.786 INFO:teuthology.run_tasks:Running task selinux... 2024-06-06T08:21:14.800 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-06-06T08:21:14.801 DEBUG:teuthology.orchestra.run.smithi028:> sudo service auditd rotate 2024-06-06T08:21:14.926 INFO:teuthology.orchestra.run.smithi028.stdout:Rotating logs: 2024-06-06T08:21:14.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-06-06T08:21:14.996 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-06-06T08:21:14.998 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2024-06-06T08:21:15.068 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2024-06-06T08:21:15.070 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-06T08:21:15.071 DEBUG:teuthology.orchestra.run.smithi028:> /usr/sbin/getenforce 2024-06-06T08:21:15.139 INFO:teuthology.orchestra.run.smithi028.stdout:Permissive 2024-06-06T08:21:15.139 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-06-06T08:21:15.167 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-06-06T08:21:15.167 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2024-06-06T08:21:15.187 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2024-06-06T08:21:15.187 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi028.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi059.front.sepia.ceph.com': 'permissive'} 2024-06-06T08:21:15.187 DEBUG:teuthology.orchestra.run.smithi028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T08:21:15.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:21:15.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T08:21:15.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:21:15.294 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T08:21:15.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:21:15.322 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-06T08:21:15.322 DEBUG:teuthology.orchestra.run.smithi028:> sudo /usr/sbin/setenforce permissive 2024-06-06T08:21:15.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-06-06T08:21:15.461 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2024-06-06T08:21:15.487 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-06T08:21:15.501 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-06T08:21:15.515 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-06T08:21:15.516 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi028.front.sepia.ceph.com,smithi037.front.sepia.ceph.com,smithi059.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-06T08:27:24.876 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi028.front.sepia.ceph.com'), Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi059.front.sepia.ceph.com')] 2024-06-06T08:27:24.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-06-06T08:27:24.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T08:27:24.992 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-06-06T08:27:25.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-06-06T08:27:25.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-06-06T08:27:25.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T08:27:25.232 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-06-06T08:27:25.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-06-06T08:27:25.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-06-06T08:27:25.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T08:27:25.400 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-06-06T08:27:25.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-06-06T08:27:25.497 INFO:teuthology.run_tasks:Running task clock... 2024-06-06T08:27:25.508 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-06T08:27:25.509 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-06T08:27:25.510 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T08:27:25.518 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-06T08:27:25.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T08:27:25.520 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-06T08:27:25.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T08:27:25.552 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-06T08:27:25.567 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-06T08:27:25.569 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-06T08:27:25.584 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-06T08:27:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-06-06T08:27:25.604 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-06-06T08:27:25.610 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2024-06-06T08:27:25.613 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-06T08:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-06T08:27:25.621 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2024-06-06T08:27:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-06T08:27:25.635 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-06T08:27:25.649 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-06T08:27:25.657 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-06T08:27:25.688 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-06-06T08:27:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T08:27:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-06-06T08:27:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:25.692 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:25.693 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:25.710 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-06-06T08:27:25.713 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T08:27:25.713 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-06-06T08:27:25.713 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:25.713 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:25.713 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:25.713 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:25.731 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: ntpd: command not found 2024-06-06T08:27:25.766 INFO:teuthology.orchestra.run.smithi028.stdout:506 Cannot talk to daemon 2024-06-06T08:27:25.809 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-06T08:27:25.849 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-06T08:27:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: ntpq: command not found 2024-06-06T08:27:26.000 INFO:teuthology.orchestra.run.smithi028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T08:27:26.000 INFO:teuthology.orchestra.run.smithi028.stdout:=============================================================================== 2024-06-06T08:27:26.000 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:26.000 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:26.000 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:26.000 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:27:26.001 INFO:teuthology.run_tasks:Running task install... 2024-06-06T08:27:26.010 DEBUG:teuthology.task.install:project ceph 2024-06-06T08:27:26.010 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}} 2024-06-06T08:27:26.010 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-06T08:27:26.010 INFO:teuthology.task.install:Using flavor: default 2024-06-06T08:27:26.016 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-06T08:27:26.016 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-06T08:27:26.016 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-06T08:27:26.017 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:27:26.019 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-06T08:27:26.019 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:27:26.020 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-06T08:27:26.020 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:27:26.240 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-06T08:27:26.240 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-06T08:27:26.247 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-06T08:27:26.247 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-06T08:27:26.250 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-06T08:27:26.250 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-06T08:27:26.536 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-06T08:27:26.536 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-06-06T08:27:26.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-06T08:27:26.563 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-06T08:27:26.564 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-06-06T08:27:26.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-06T08:27:26.567 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-06T08:27:26.567 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-06T08:27:26.593 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-06T08:27:26.593 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-06T08:27:26.601 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-06T08:27:26.601 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:27:26.601 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-06T08:27:26.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-06T08:27:26.662 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-06T08:27:26.695 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-06T08:27:26.695 DEBUG:teuthology.orchestra.run.smithi028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-06T08:27:26.714 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-06T08:27:26.740 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-06T08:27:26.781 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2024-06-06T08:27:26.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2024-06-06T08:27:26.806 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-06-06T08:27:26.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-06-06T08:27:26.829 DEBUG:teuthology.orchestra.run.smithi028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-06T08:27:26.948 DEBUG:teuthology.orchestra.run.smithi028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-06T08:27:27.021 INFO:teuthology.orchestra.run.smithi059.stdout:45 files removed 2024-06-06T08:27:27.037 INFO:teuthology.orchestra.run.smithi028.stdout:check_obsoletes = 1 2024-06-06T08:27:27.041 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum clean all 2024-06-06T08:27:27.045 INFO:teuthology.orchestra.run.smithi037.stdout:45 files removed 2024-06-06T08:27:27.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-06T08:27:27.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-06T08:27:27.364 INFO:teuthology.orchestra.run.smithi028.stdout:45 files removed 2024-06-06T08:27:27.404 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-06T08:27:28.107 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 106 kB/s | 83 kB 00:00 2024-06-06T08:27:28.129 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 106 kB/s | 83 kB 00:00 2024-06-06T08:27:28.717 INFO:teuthology.orchestra.run.smithi028.stdout:ceph packages for x86_64 96 kB/s | 83 kB 00:00 2024-06-06T08:27:28.849 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 16 kB/s | 11 kB 00:00 2024-06-06T08:27:28.947 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 15 kB/s | 11 kB 00:00 2024-06-06T08:27:29.441 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2024-06-06T08:27:29.483 INFO:teuthology.orchestra.run.smithi028.stdout:ceph noarch packages 17 kB/s | 11 kB 00:00 2024-06-06T08:27:29.489 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2024-06-06T08:27:30.076 INFO:teuthology.orchestra.run.smithi028.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2024-06-06T08:27:30.118 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.1 MB 00:00 2024-06-06T08:27:30.325 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.1 MB 00:00 2024-06-06T08:27:31.236 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.1 MB 00:01 2024-06-06T08:27:32.186 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-06-06T08:27:32.201 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-06-06T08:27:33.454 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-06-06T08:27:36.587 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 6.2 MB 00:00 2024-06-06T08:27:36.593 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.2 MB 00:00 2024-06-06T08:27:38.072 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-06-06T08:27:38.137 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 17 kB 00:00 2024-06-06T08:27:38.368 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 17 kB 00:00 2024-06-06T08:27:39.390 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-06-06T08:27:39.704 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-06-06T08:27:39.963 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 17 kB 00:00 2024-06-06T08:27:41.174 INFO:teuthology.orchestra.run.smithi028.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-06-06T08:27:44.779 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-06-06T08:27:45.044 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-06-06T08:27:47.173 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T08:27:47.173 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T08:27:47.184 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-06T08:27:47.185 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-06T08:27:47.186 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-06T08:27:47.187 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-06T08:27:47.188 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-06T08:27:47.191 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-06T08:27:47.192 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-06T08:27:47.259 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-06-06T08:27:47.275 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-06-06T08:27:47.275 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-06-06T08:27:47.275 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-06-06T08:27:47.275 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-06-06T08:27:47.275 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-06T08:27:47.276 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-06T08:27:47.276 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-06T08:27:47.276 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-06T08:27:47.276 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-06T08:27:47.276 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-06T08:27:47.276 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-06T08:27:47.276 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-06T08:27:47.276 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-06T08:27:47.276 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-06T08:27:47.276 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-06T08:27:47.277 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-06T08:27:47.278 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-06T08:27:47.279 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-06T08:27:47.280 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-06T08:27:47.281 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-06T08:27:47.281 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-06T08:27:47.281 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-06T08:27:47.281 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-06T08:27:47.281 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-06T08:27:47.281 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-06T08:27:47.281 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-06T08:27:47.281 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-06T08:27:47.281 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-06T08:27:47.281 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-06T08:27:47.282 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-06T08:27:47.283 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-06T08:27:47.283 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-06T08:27:47.283 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-06T08:27:47.283 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-06T08:27:47.283 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-06T08:27:47.283 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-06T08:27:47.283 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-06T08:27:47.283 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-06T08:27:47.283 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-06T08:27:47.283 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-06T08:27:47.284 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-06T08:27:47.284 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-06T08:27:47.284 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-06T08:27:47.284 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-06T08:27:47.284 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-06T08:27:47.284 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-06T08:27:47.284 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-06T08:27:47.284 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-06T08:27:47.284 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-06T08:27:47.284 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-06T08:27:47.285 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-06T08:27:47.286 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-06T08:27:47.287 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-06T08:27:47.288 INFO:teuthology.orchestra.run.smithi059.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-06T08:27:47.289 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-06T08:27:47.289 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-06T08:27:47.289 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2024-06-06T08:27:47.289 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-06T08:27:47.289 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:27:47.289 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-06-06T08:27:47.289 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-06-06T08:27:47.289 INFO:teuthology.orchestra.run.smithi059.stdout:Install 148 Packages 2024-06-06T08:27:47.289 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 11 Packages 2024-06-06T08:27:47.289 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:27:47.290 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 225 M 2024-06-06T08:27:47.290 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-06-06T08:27:47.438 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T08:27:47.439 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T08:27:47.445 INFO:teuthology.orchestra.run.smithi028.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-06-06T08:27:47.451 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-06T08:27:47.452 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-06T08:27:47.453 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-06T08:27:47.453 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-06T08:27:47.455 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-06T08:27:47.458 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-06T08:27:47.458 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-06T08:27:47.526 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-06-06T08:27:47.543 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-06T08:27:47.544 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-06T08:27:47.545 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T08:27:47.546 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-06T08:27:47.547 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-06T08:27:47.548 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-06T08:27:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-06T08:27:47.550 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-06T08:27:47.551 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-06T08:27:47.553 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-06T08:27:47.553 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-06T08:27:47.553 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-06T08:27:47.553 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-06T08:27:47.553 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-06T08:27:47.553 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-06T08:27:47.553 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-06T08:27:47.553 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-06T08:27:47.553 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-06T08:27:47.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-06T08:27:47.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-06T08:27:47.556 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout:Install 148 Packages 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 11 Packages 2024-06-06T08:27:47.557 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:27:47.558 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 225 M 2024-06-06T08:27:47.558 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-06-06T08:27:48.364 INFO:teuthology.orchestra.run.smithi059.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-06-06T08:27:48.504 INFO:teuthology.orchestra.run.smithi037.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-06-06T08:27:48.687 INFO:teuthology.orchestra.run.smithi037.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 4.8 MB/s | 890 kB 00:00 2024-06-06T08:27:48.738 INFO:teuthology.orchestra.run.smithi037.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 2.8 MB/s | 145 kB 00:00 2024-06-06T08:27:48.905 INFO:teuthology.orchestra.run.smithi037.stdout:(4/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 14 MB/s | 2.4 MB 00:00 2024-06-06T08:27:49.013 INFO:teuthology.orchestra.run.smithi037.stdout:(5/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 14 MB/s | 1.5 MB 00:00 2024-06-06T08:27:49.389 INFO:teuthology.orchestra.run.smithi037.stdout:(6/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 13 MB/s | 4.7 MB 00:00 2024-06-06T08:27:49.448 INFO:teuthology.orchestra.run.smithi059.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 821 kB/s | 890 kB 00:01 2024-06-06T08:27:49.572 INFO:teuthology.orchestra.run.smithi037.stdout:(7/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 4.3 MB/s | 5.4 MB 00:01 2024-06-06T08:27:49.756 INFO:teuthology.orchestra.run.smithi059.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 470 kB/s | 145 kB 00:00 2024-06-06T08:27:50.130 INFO:teuthology.orchestra.run.smithi028.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T08:27:50.131 INFO:teuthology.orchestra.run.smithi028.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T08:27:50.151 INFO:teuthology.orchestra.run.smithi028.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-06T08:27:50.152 INFO:teuthology.orchestra.run.smithi028.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-06T08:27:50.154 INFO:teuthology.orchestra.run.smithi028.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-06T08:27:50.155 INFO:teuthology.orchestra.run.smithi028.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-06T08:27:50.157 INFO:teuthology.orchestra.run.smithi028.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-06T08:27:50.161 INFO:teuthology.orchestra.run.smithi028.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-06T08:27:50.162 INFO:teuthology.orchestra.run.smithi028.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-06T08:27:50.240 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-06-06T08:27:50.262 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================= 2024-06-06T08:27:50.262 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-06-06T08:27:50.262 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================= 2024-06-06T08:27:50.262 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-06-06T08:27:50.262 INFO:teuthology.orchestra.run.smithi028.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-06T08:27:50.262 INFO:teuthology.orchestra.run.smithi028.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-06T08:27:50.262 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-06T08:27:50.262 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-06T08:27:50.262 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-06T08:27:50.262 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-06T08:27:50.263 INFO:teuthology.orchestra.run.smithi028.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-06T08:27:50.264 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout:Upgrading: 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-06T08:27:50.265 INFO:teuthology.orchestra.run.smithi028.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-06T08:27:50.266 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-06T08:27:50.267 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-06T08:27:50.268 INFO:teuthology.orchestra.run.smithi028.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-06T08:27:50.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-06T08:27:50.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-06T08:27:50.271 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-06T08:27:50.272 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-06T08:27:50.273 INFO:teuthology.orchestra.run.smithi028.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-06T08:27:50.273 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-06T08:27:50.273 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-06T08:27:50.273 INFO:teuthology.orchestra.run.smithi028.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-06T08:27:50.273 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-06T08:27:50.273 INFO:teuthology.orchestra.run.smithi028.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-06T08:27:50.273 INFO:teuthology.orchestra.run.smithi028.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-06T08:27:50.273 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-06T08:27:50.273 INFO:teuthology.orchestra.run.smithi028.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-06T08:27:50.273 INFO:teuthology.orchestra.run.smithi028.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-06T08:27:50.274 INFO:teuthology.orchestra.run.smithi028.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-06T08:27:50.274 INFO:teuthology.orchestra.run.smithi028.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-06T08:27:50.274 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-06T08:27:50.274 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-06T08:27:50.274 INFO:teuthology.orchestra.run.smithi028.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-06T08:27:50.274 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-06T08:27:50.274 INFO:teuthology.orchestra.run.smithi028.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-06T08:27:50.274 INFO:teuthology.orchestra.run.smithi028.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-06T08:27:50.274 INFO:teuthology.orchestra.run.smithi028.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-06T08:27:50.275 INFO:teuthology.orchestra.run.smithi028.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-06T08:27:50.275 INFO:teuthology.orchestra.run.smithi028.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-06T08:27:50.275 INFO:teuthology.orchestra.run.smithi028.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-06T08:27:50.275 INFO:teuthology.orchestra.run.smithi028.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-06T08:27:50.275 INFO:teuthology.orchestra.run.smithi028.stdout:Installing weak dependencies: 2024-06-06T08:27:50.275 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-06T08:27:50.275 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:27:50.275 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-06-06T08:27:50.276 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================= 2024-06-06T08:27:50.276 INFO:teuthology.orchestra.run.smithi028.stdout:Install 148 Packages 2024-06-06T08:27:50.276 INFO:teuthology.orchestra.run.smithi028.stdout:Upgrade 11 Packages 2024-06-06T08:27:50.276 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:27:50.277 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 225 M 2024-06-06T08:27:50.277 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-06-06T08:27:50.714 INFO:teuthology.orchestra.run.smithi037.stdout:(8/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x86 13 MB/s | 17 MB 00:01 2024-06-06T08:27:50.764 INFO:teuthology.orchestra.run.smithi037.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 508 kB/s | 25 kB 00:00 2024-06-06T08:27:50.839 INFO:teuthology.orchestra.run.smithi059.stdout:(4/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 1.9 MB/s | 5.4 MB 00:02 2024-06-06T08:27:50.940 INFO:teuthology.orchestra.run.smithi037.stdout:(10/159): ceph-radosgw-19.0.0-2946.g3d89accf.el 7.5 MB/s | 10 MB 00:01 2024-06-06T08:27:51.031 INFO:teuthology.orchestra.run.smithi037.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.4 MB/s | 221 kB 00:00 2024-06-06T08:27:51.140 INFO:teuthology.orchestra.run.smithi037.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 250 kB/s | 27 kB 00:00 2024-06-06T08:27:51.156 INFO:teuthology.orchestra.run.smithi059.stdout:(5/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 4.7 MB/s | 1.5 MB 00:00 2024-06-06T08:27:51.215 INFO:teuthology.orchestra.run.smithi037.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 423 kB/s | 32 kB 00:00 2024-06-06T08:27:51.389 INFO:teuthology.orchestra.run.smithi028.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-06-06T08:27:51.416 INFO:teuthology.orchestra.run.smithi037.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 3.6 MB/s | 747 kB 00:00 2024-06-06T08:27:51.508 INFO:teuthology.orchestra.run.smithi037.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 1.7 MB/s | 163 kB 00:00 2024-06-06T08:27:51.616 INFO:teuthology.orchestra.run.smithi037.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.1 MB/s | 127 kB 00:00 2024-06-06T08:27:52.223 INFO:teuthology.orchestra.run.smithi059.stdout:(6/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 981 kB/s | 2.4 MB 00:02 2024-06-06T08:27:52.473 INFO:teuthology.orchestra.run.smithi059.stdout:(7/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 3.6 MB/s | 4.7 MB 00:01 2024-06-06T08:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 562 kB/s | 501 kB 00:00 2024-06-06T08:27:52.564 INFO:teuthology.orchestra.run.smithi028.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 758 kB/s | 890 kB 00:01 2024-06-06T08:27:52.947 INFO:teuthology.orchestra.run.smithi028.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 379 kB/s | 145 kB 00:00 2024-06-06T08:27:52.965 INFO:teuthology.orchestra.run.smithi059.stdout:(8/159): ceph-common-19.0.0-2946.g3d89accf.el9. 4.3 MB/s | 21 MB 00:04 2024-06-06T08:27:53.040 INFO:teuthology.orchestra.run.smithi059.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 337 kB/s | 25 kB 00:00 2024-06-06T08:27:53.048 INFO:teuthology.orchestra.run.smithi028.stdout:(4/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 2.6 MB/s | 5.4 MB 00:02 2024-06-06T08:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout:(18/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 5.5 MB/s | 5.3 MB 00:00 2024-06-06T08:27:53.506 INFO:teuthology.orchestra.run.smithi028.stdout:(5/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 3.3 MB/s | 1.5 MB 00:00 2024-06-06T08:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 542 kB/s | 45 kB 00:00 2024-06-06T08:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 1.3 MB/s | 135 kB 00:00 2024-06-06T08:27:53.759 INFO:teuthology.orchestra.run.smithi037.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 1.6 MB/s | 162 kB 00:00 2024-06-06T08:27:53.868 INFO:teuthology.orchestra.run.smithi037.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 2.9 MB/s | 321 kB 00:00 2024-06-06T08:27:53.977 INFO:teuthology.orchestra.run.smithi037.stdout:(23/159): python3-rbd-19.0.0-2946.g3d89accf.el9 2.7 MB/s | 300 kB 00:00 2024-06-06T08:27:54.077 INFO:teuthology.orchestra.run.smithi037.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 991 kB/s | 99 kB 00:00 2024-06-06T08:27:54.194 INFO:teuthology.orchestra.run.smithi037.stdout:(25/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 730 kB/s | 85 kB 00:00 2024-06-06T08:27:54.781 INFO:teuthology.orchestra.run.smithi028.stdout:(6/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 3.7 MB/s | 4.7 MB 00:01 2024-06-06T08:27:54.853 INFO:teuthology.orchestra.run.smithi037.stdout:(26/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 4.7 MB/s | 3.1 MB 00:00 2024-06-06T08:27:54.970 INFO:teuthology.orchestra.run.smithi037.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.4 MB/s | 171 kB 00:00 2024-06-06T08:27:55.070 INFO:teuthology.orchestra.run.smithi037.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 317 kB/s | 32 kB 00:00 2024-06-06T08:27:55.179 INFO:teuthology.orchestra.run.smithi037.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.3 MB/s | 142 kB 00:00 2024-06-06T08:27:55.946 INFO:teuthology.orchestra.run.smithi037.stdout:(30/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 4.6 MB/s | 3.5 MB 00:00 2024-06-06T08:27:55.982 INFO:teuthology.orchestra.run.smithi028.stdout:(7/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 798 kB/s | 2.4 MB 00:03 2024-06-06T08:27:56.857 INFO:teuthology.orchestra.run.smithi059.stdout:(10/159): ceph-radosgw-19.0.0-2946.g3d89accf.el 2.3 MB/s | 10 MB 00:04 2024-06-06T08:27:57.049 INFO:teuthology.orchestra.run.smithi059.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 1.1 MB/s | 221 kB 00:00 2024-06-06T08:27:57.166 INFO:teuthology.orchestra.run.smithi059.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 232 kB/s | 27 kB 00:00 2024-06-06T08:27:57.266 INFO:teuthology.orchestra.run.smithi059.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 318 kB/s | 32 kB 00:00 2024-06-06T08:27:57.312 INFO:teuthology.orchestra.run.smithi037.stdout:(31/159): ceph-mgr-diskprediction-local-19.0.0- 5.4 MB/s | 7.4 MB 00:01 2024-06-06T08:27:57.413 INFO:teuthology.orchestra.run.smithi037.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.4 MB/s | 249 kB 00:00 2024-06-06T08:27:57.513 INFO:teuthology.orchestra.run.smithi037.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 493 kB/s | 49 kB 00:00 2024-06-06T08:27:57.605 INFO:teuthology.orchestra.run.smithi037.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 180 kB/s | 16 kB 00:00 2024-06-06T08:27:57.666 INFO:teuthology.orchestra.run.smithi059.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 1.9 MB/s | 747 kB 00:00 2024-06-06T08:27:57.705 INFO:teuthology.orchestra.run.smithi037.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 2.6 MB/s | 264 kB 00:00 2024-06-06T08:27:57.767 INFO:teuthology.orchestra.run.smithi059.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 1.5 MB/s | 163 kB 00:00 2024-06-06T08:27:57.875 INFO:teuthology.orchestra.run.smithi059.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.1 MB/s | 127 kB 00:00 2024-06-06T08:27:57.889 INFO:teuthology.orchestra.run.smithi037.stdout:(36/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 4.1 MB/s | 763 kB 00:00 2024-06-06T08:27:57.989 INFO:teuthology.orchestra.run.smithi037.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 182 kB/s | 18 kB 00:00 2024-06-06T08:27:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:27:58.109 INFO:teuthology.orchestra.run.smithi059.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 2.1 MB/s | 501 kB 00:00 2024-06-06T08:27:58.123 INFO:teuthology.orchestra.run.smithi037.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 603 kB/s | 80 kB 00:00 2024-06-06T08:27:58.124 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout:(39/159): libgfortran-11.4.1-3.el9.x86_64.rpm 8.6 MB/s | 803 kB 00:00 2024-06-06T08:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:27:58.257 INFO:teuthology.orchestra.run.smithi037.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-06-06T08:27:58.298 INFO:teuthology.orchestra.run.smithi037.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-06-06T08:27:58.366 INFO:teuthology.orchestra.run.smithi037.stdout:(42/159): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-06-06T08:27:58.398 INFO:teuthology.orchestra.run.smithi028.stdout:(8/159): ceph-common-19.0.0-2946.g3d89accf.el9. 2.8 MB/s | 21 MB 00:07 2024-06-06T08:27:58.407 INFO:teuthology.orchestra.run.smithi037.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-06-06T08:27:58.450 INFO:teuthology.orchestra.run.smithi037.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-06-06T08:27:58.474 INFO:teuthology.orchestra.run.smithi028.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 341 kB/s | 25 kB 00:00 2024-06-06T08:27:58.491 INFO:teuthology.orchestra.run.smithi037.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-06-06T08:27:58.533 INFO:teuthology.orchestra.run.smithi037.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 5.1 MB/s | 215 kB 00:00 2024-06-06T08:27:58.535 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-06T08:27:58.584 INFO:teuthology.orchestra.run.smithi037.stdout:(47/159): automake-1.16.2-8.el9.noarch.rpm 13 MB/s | 689 kB 00:00 2024-06-06T08:27:58.585 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:27:58.642 INFO:teuthology.orchestra.run.smithi037.stdout:(48/159): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-06-06T08:27:58.644 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:27:58.676 INFO:teuthology.orchestra.run.smithi037.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 107 kB 00:00 2024-06-06T08:27:58.710 INFO:teuthology.orchestra.run.smithi037.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 653 kB/s | 22 kB 00:00 2024-06-06T08:27:58.760 INFO:teuthology.orchestra.run.smithi037.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-06-06T08:27:58.794 INFO:teuthology.orchestra.run.smithi037.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 984 kB/s | 33 kB 00:00 2024-06-06T08:27:58.911 INFO:teuthology.orchestra.run.smithi037.stdout:(53/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-06-06T08:27:58.944 INFO:teuthology.orchestra.run.smithi037.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 551 kB/s | 18 kB 00:00 2024-06-06T08:27:58.970 INFO:teuthology.orchestra.run.smithi037.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 445 kB/s | 11 kB 00:00 2024-06-06T08:27:59.012 INFO:teuthology.orchestra.run.smithi037.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-06-06T08:27:59.045 INFO:teuthology.orchestra.run.smithi037.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-06-06T08:27:59.087 INFO:teuthology.orchestra.run.smithi037.stdout:(58/159): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 662 kB 00:00 2024-06-06T08:27:59.129 INFO:teuthology.orchestra.run.smithi037.stdout:(59/159): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 582 kB 00:00 2024-06-06T08:27:59.166 INFO:teuthology.orchestra.run.smithi028.stdout:(10/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 3.8 MB/s | 17 MB 00:04 2024-06-06T08:27:59.241 INFO:teuthology.orchestra.run.smithi028.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.9 MB/s | 221 kB 00:00 2024-06-06T08:27:59.251 INFO:teuthology.orchestra.run.smithi059.stdout:(18/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 7.8 MB/s | 48 MB 00:06 2024-06-06T08:27:59.291 INFO:teuthology.orchestra.run.smithi028.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 553 kB/s | 27 kB 00:00 2024-06-06T08:27:59.318 INFO:teuthology.orchestra.run.smithi059.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 680 kB/s | 45 kB 00:00 2024-06-06T08:27:59.350 INFO:teuthology.orchestra.run.smithi028.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 554 kB/s | 32 kB 00:00 2024-06-06T08:27:59.368 INFO:teuthology.orchestra.run.smithi059.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 2.6 MB/s | 135 kB 00:00 2024-06-06T08:27:59.435 INFO:teuthology.orchestra.run.smithi059.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 2.4 MB/s | 162 kB 00:00 2024-06-06T08:27:59.517 INFO:teuthology.orchestra.run.smithi028.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 4.4 MB/s | 747 kB 00:00 2024-06-06T08:27:59.518 INFO:teuthology.orchestra.run.smithi059.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 3.8 MB/s | 321 kB 00:00 2024-06-06T08:27:59.572 INFO:teuthology.orchestra.run.smithi037.stdout:(60/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 5.5 MB/s | 48 MB 00:08 2024-06-06T08:27:59.575 INFO:teuthology.orchestra.run.smithi028.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 2.8 MB/s | 163 kB 00:00 2024-06-06T08:27:59.597 INFO:teuthology.orchestra.run.smithi037.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 54 kB/s | 25 kB 00:00 2024-06-06T08:27:59.611 INFO:teuthology.orchestra.run.smithi059.stdout:(23/159): python3-rbd-19.0.0-2946.g3d89accf.el9 3.2 MB/s | 300 kB 00:00 2024-06-06T08:27:59.634 INFO:teuthology.orchestra.run.smithi028.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 2.2 MB/s | 127 kB 00:00 2024-06-06T08:27:59.638 INFO:teuthology.orchestra.run.smithi037.stdout:(62/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-06-06T08:27:59.664 INFO:teuthology.orchestra.run.smithi037.stdout:(63/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 517 kB/s | 47 kB 00:00 2024-06-06T08:27:59.678 INFO:teuthology.orchestra.run.smithi059.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.5 MB/s | 99 kB 00:00 2024-06-06T08:27:59.697 INFO:teuthology.orchestra.run.smithi037.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-06-06T08:27:59.723 INFO:teuthology.orchestra.run.smithi037.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 600 kB/s | 35 kB 00:00 2024-06-06T08:27:59.734 INFO:teuthology.orchestra.run.smithi028.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 4.9 MB/s | 501 kB 00:00 2024-06-06T08:27:59.745 INFO:teuthology.orchestra.run.smithi059.stdout:(25/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.3 MB/s | 85 kB 00:00 2024-06-06T08:27:59.873 INFO:teuthology.orchestra.run.smithi037.stdout:(66/159): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-06-06T08:27:59.912 INFO:teuthology.orchestra.run.smithi059.stdout:(26/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 3.0 MB/s | 5.3 MB 00:01 2024-06-06T08:27:59.948 INFO:teuthology.orchestra.run.smithi037.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-06-06T08:27:59.991 INFO:teuthology.orchestra.run.smithi037.stdout:(68/159): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-06-06T08:27:59.995 INFO:teuthology.orchestra.run.smithi059.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 2.0 MB/s | 171 kB 00:00 2024-06-06T08:28:00.024 INFO:teuthology.orchestra.run.smithi037.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-06-06T08:28:00.049 INFO:teuthology.orchestra.run.smithi037.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-06-06T08:28:00.079 INFO:teuthology.orchestra.run.smithi059.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 381 kB/s | 32 kB 00:00 2024-06-06T08:28:00.108 INFO:teuthology.orchestra.run.smithi037.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-06-06T08:28:00.163 INFO:teuthology.orchestra.run.smithi059.stdout:(29/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 7.4 MB/s | 3.1 MB 00:00 2024-06-06T08:28:00.184 INFO:teuthology.orchestra.run.smithi037.stdout:(72/159): postgresql-server-13.14-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-06-06T08:28:00.188 INFO:teuthology.orchestra.run.smithi059.stdout:(30/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.3 MB/s | 142 kB 00:00 2024-06-06T08:28:00.201 INFO:teuthology.orchestra.run.smithi037.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 953 kB/s | 87 kB 00:00 2024-06-06T08:28:00.242 INFO:teuthology.orchestra.run.smithi037.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-06-06T08:28:00.284 INFO:teuthology.orchestra.run.smithi037.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 5.7 MB/s | 244 kB 00:00 2024-06-06T08:28:00.351 INFO:teuthology.orchestra.run.smithi037.stdout:(76/159): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-06-06T08:28:00.393 INFO:teuthology.orchestra.run.smithi037.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-06-06T08:28:00.419 INFO:teuthology.orchestra.run.smithi037.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 381 kB/s | 26 kB 00:00 2024-06-06T08:28:00.444 INFO:teuthology.orchestra.run.smithi037.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 379 kB/s | 19 kB 00:00 2024-06-06T08:28:00.469 INFO:teuthology.orchestra.run.smithi037.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-06-06T08:28:00.494 INFO:teuthology.orchestra.run.smithi037.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-06-06T08:28:00.537 INFO:teuthology.orchestra.run.smithi037.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-06-06T08:28:00.605 INFO:teuthology.orchestra.run.smithi059.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 8.0 MB/s | 3.5 MB 00:00 2024-06-06T08:28:00.622 INFO:teuthology.orchestra.run.smithi037.stdout:(83/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-06-06T08:28:00.645 INFO:teuthology.orchestra.run.smithi037.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-06-06T08:28:00.670 INFO:teuthology.orchestra.run.smithi037.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-06-06T08:28:00.687 INFO:teuthology.orchestra.run.smithi037.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-06-06T08:28:00.688 INFO:teuthology.orchestra.run.smithi059.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.9 MB/s | 249 kB 00:00 2024-06-06T08:28:00.713 INFO:teuthology.orchestra.run.smithi037.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-06-06T08:28:00.726 INFO:teuthology.orchestra.run.smithi028.stdout:(18/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 5.4 MB/s | 5.3 MB 00:00 2024-06-06T08:28:00.738 INFO:teuthology.orchestra.run.smithi037.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-06T08:28:00.739 INFO:teuthology.orchestra.run.smithi059.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 985 kB/s | 49 kB 00:00 2024-06-06T08:28:00.785 INFO:teuthology.orchestra.run.smithi028.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 790 kB/s | 45 kB 00:00 2024-06-06T08:28:00.816 INFO:teuthology.orchestra.run.smithi059.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 213 kB/s | 16 kB 00:00 2024-06-06T08:28:00.889 INFO:teuthology.orchestra.run.smithi059.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 3.5 MB/s | 264 kB 00:00 2024-06-06T08:28:00.930 INFO:teuthology.orchestra.run.smithi037.stdout:(89/159): ceph-common-19.0.0-2946.g3d89accf.el9 1.7 MB/s | 21 MB 00:12 2024-06-06T08:28:00.947 INFO:teuthology.orchestra.run.smithi037.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 244 kB/s | 51 kB 00:00 2024-06-06T08:28:00.968 INFO:teuthology.orchestra.run.smithi028.stdout:(20/159): ceph-radosgw-19.0.0-2946.g3d89accf.el 2.1 MB/s | 10 MB 00:04 2024-06-06T08:28:00.972 INFO:teuthology.orchestra.run.smithi037.stdout:(91/159): python3-pyasn1-modules-0.4.8-6.el9.no 1.1 MB/s | 279 kB 00:00 2024-06-06T08:28:01.002 INFO:teuthology.orchestra.run.smithi028.stdout:(21/159): python3-ceph-common-19.0.0-2946.g3d89 625 kB/s | 135 kB 00:00 2024-06-06T08:28:01.006 INFO:teuthology.orchestra.run.smithi037.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-06-06T08:28:01.006 INFO:teuthology.orchestra.run.smithi059.stdout:(36/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 6.4 MB/s | 763 kB 00:00 2024-06-06T08:28:01.023 INFO:teuthology.orchestra.run.smithi037.stdout:(93/159): python3-requests-oauthlib-1.3.0-12.el 582 kB/s | 54 kB 00:00 2024-06-06T08:28:01.040 INFO:teuthology.orchestra.run.smithi037.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-06-06T08:28:01.052 INFO:teuthology.orchestra.run.smithi028.stdout:(22/159): python3-cephfs-19.0.0-2946.g3d89accf. 1.9 MB/s | 162 kB 00:00 2024-06-06T08:28:01.073 INFO:teuthology.orchestra.run.smithi059.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 274 kB/s | 18 kB 00:00 2024-06-06T08:28:01.074 INFO:teuthology.orchestra.run.smithi037.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-06-06T08:28:01.099 INFO:teuthology.orchestra.run.smithi037.stdout:(96/159): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-06-06T08:28:01.111 INFO:teuthology.orchestra.run.smithi028.stdout:(23/159): python3-rados-19.0.0-2946.g3d89accf.e 2.9 MB/s | 321 kB 00:00 2024-06-06T08:28:01.114 INFO:teuthology.orchestra.run.smithi059.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:01.124 INFO:teuthology.orchestra.run.smithi037.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-06-06T08:28:01.149 INFO:teuthology.orchestra.run.smithi037.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-06-06T08:28:01.170 INFO:teuthology.orchestra.run.smithi028.stdout:(24/159): python3-rbd-19.0.0-2946.g3d89accf.el9 2.5 MB/s | 300 kB 00:00 2024-06-06T08:28:01.174 INFO:teuthology.orchestra.run.smithi037.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-06-06T08:28:01.200 INFO:teuthology.orchestra.run.smithi037.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-06-06T08:28:01.203 INFO:teuthology.orchestra.run.smithi028.stdout:(25/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.1 MB/s | 99 kB 00:00 2024-06-06T08:28:01.224 INFO:teuthology.orchestra.run.smithi059.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 535 kB/s | 80 kB 00:00 2024-06-06T08:28:01.225 INFO:teuthology.orchestra.run.smithi037.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-06-06T08:28:01.227 INFO:teuthology.orchestra.run.smithi059.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:01.228 INFO:teuthology.orchestra.run.smithi028.stdout:(26/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.4 MB/s | 85 kB 00:00 2024-06-06T08:28:01.251 INFO:teuthology.orchestra.run.smithi037.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-06-06T08:28:01.251 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:01.253 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:01.307 INFO:teuthology.orchestra.run.smithi059.stdout:(39/159): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 803 kB 00:00 2024-06-06T08:28:01.309 INFO:teuthology.orchestra.run.smithi059.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:01.329 INFO:teuthology.orchestra.run.smithi028.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.7 MB/s | 171 kB 00:00 2024-06-06T08:28:01.334 INFO:teuthology.orchestra.run.smithi037.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-06-06T08:28:01.349 INFO:teuthology.orchestra.run.smithi059.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-06-06T08:28:01.391 INFO:teuthology.orchestra.run.smithi059.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-06-06T08:28:01.396 INFO:teuthology.orchestra.run.smithi028.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 482 kB/s | 32 kB 00:00 2024-06-06T08:28:01.454 INFO:teuthology.orchestra.run.smithi028.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 2.4 MB/s | 142 kB 00:00 2024-06-06T08:28:01.458 INFO:teuthology.orchestra.run.smithi059.stdout:(42/159): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-06-06T08:28:01.500 INFO:teuthology.orchestra.run.smithi059.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-06-06T08:28:01.501 INFO:teuthology.orchestra.run.smithi037.stdout:(104/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-06-06T08:28:01.542 INFO:teuthology.orchestra.run.smithi059.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-06-06T08:28:01.559 INFO:teuthology.orchestra.run.smithi037.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 2.4 MB/s | 548 kB 00:00 2024-06-06T08:28:01.584 INFO:teuthology.orchestra.run.smithi059.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-06-06T08:28:01.585 INFO:teuthology.orchestra.run.smithi037.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 873 kB/s | 19 kB 00:00 2024-06-06T08:28:01.619 INFO:teuthology.orchestra.run.smithi037.stdout:(107/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-06-06T08:28:01.626 INFO:teuthology.orchestra.run.smithi059.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 5.1 MB/s | 215 kB 00:00 2024-06-06T08:28:01.628 INFO:teuthology.orchestra.run.smithi059.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-06T08:28:01.663 INFO:teuthology.orchestra.run.smithi028.stdout:(30/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 6.7 MB/s | 3.1 MB 00:00 2024-06-06T08:28:01.676 INFO:teuthology.orchestra.run.smithi059.stdout:(47/159): automake-1.16.2-8.el9.noarch.rpm 13 MB/s | 689 kB 00:00 2024-06-06T08:28:01.677 INFO:teuthology.orchestra.run.smithi037.stdout:(108/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.7 MB/s | 309 kB 00:00 2024-06-06T08:28:01.711 INFO:teuthology.orchestra.run.smithi037.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-06-06T08:28:01.736 INFO:teuthology.orchestra.run.smithi037.stdout:(110/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-06-06T08:28:01.762 INFO:teuthology.orchestra.run.smithi037.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-06-06T08:28:01.787 INFO:teuthology.orchestra.run.smithi037.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-06-06T08:28:01.829 INFO:teuthology.orchestra.run.smithi037.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-06-06T08:28:01.843 INFO:teuthology.orchestra.run.smithi059.stdout:(48/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 1.7 MB/s | 17 MB 00:09 2024-06-06T08:28:01.844 INFO:teuthology.orchestra.run.smithi059.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:01.845 INFO:teuthology.orchestra.run.smithi059.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:01.854 INFO:teuthology.orchestra.run.smithi037.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-06T08:28:01.879 INFO:teuthology.orchestra.run.smithi037.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-06T08:28:01.905 INFO:teuthology.orchestra.run.smithi037.stdout:(116/159): python3-certifi-2021.10.8-2.el9.noar 600 kB/s | 15 kB 00:00 2024-06-06T08:28:01.930 INFO:teuthology.orchestra.run.smithi037.stdout:(117/159): python3-asyncssh-2.13.2-5.el9.noarch 3.7 MB/s | 548 kB 00:00 2024-06-06T08:28:01.942 INFO:teuthology.orchestra.run.smithi059.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 943 kB 00:00 2024-06-06T08:28:01.955 INFO:teuthology.orchestra.run.smithi037.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-06-06T08:28:01.981 INFO:teuthology.orchestra.run.smithi037.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-06-06T08:28:01.986 INFO:teuthology.orchestra.run.smithi059.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 506 kB/s | 22 kB 00:00 2024-06-06T08:28:02.006 INFO:teuthology.orchestra.run.smithi037.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-06-06T08:28:02.011 INFO:teuthology.orchestra.run.smithi059.stdout:(51/159): boost-program-options-1.75.0-8.el9.x8 640 kB/s | 107 kB 00:00 2024-06-06T08:28:02.036 INFO:teuthology.orchestra.run.smithi059.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-06-06T08:28:02.039 INFO:teuthology.orchestra.run.smithi037.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-06-06T08:28:02.062 INFO:teuthology.orchestra.run.smithi059.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 649 kB/s | 33 kB 00:00 2024-06-06T08:28:02.073 INFO:teuthology.orchestra.run.smithi037.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-06-06T08:28:02.099 INFO:teuthology.orchestra.run.smithi037.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-06-06T08:28:02.103 INFO:teuthology.orchestra.run.smithi059.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 441 kB/s | 18 kB 00:00 2024-06-06T08:28:02.124 INFO:teuthology.orchestra.run.smithi037.stdout:(124/159): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-06-06T08:28:02.149 INFO:teuthology.orchestra.run.smithi037.stdout:(125/159): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-06-06T08:28:02.162 INFO:teuthology.orchestra.run.smithi059.stdout:(55/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-06-06T08:28:02.174 INFO:teuthology.orchestra.run.smithi037.stdout:(126/159): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-06-06T08:28:02.187 INFO:teuthology.orchestra.run.smithi059.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-06-06T08:28:02.199 INFO:teuthology.orchestra.run.smithi037.stdout:(127/159): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-06-06T08:28:02.213 INFO:teuthology.orchestra.run.smithi059.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-06-06T08:28:02.238 INFO:teuthology.orchestra.run.smithi059.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-06-06T08:28:02.263 INFO:teuthology.orchestra.run.smithi028.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 4.4 MB/s | 3.5 MB 00:00 2024-06-06T08:28:02.267 INFO:teuthology.orchestra.run.smithi037.stdout:(128/159): libarrow-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2024-06-06T08:28:02.272 INFO:teuthology.orchestra.run.smithi059.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-06-06T08:28:02.283 INFO:teuthology.orchestra.run.smithi037.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-06-06T08:28:02.326 INFO:teuthology.orchestra.run.smithi037.stdout:(130/159): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-06-06T08:28:02.356 INFO:teuthology.orchestra.run.smithi059.stdout:(60/159): ceph-mgr-diskprediction-local-19.0.0- 3.4 MB/s | 7.4 MB 00:02 2024-06-06T08:28:02.356 INFO:teuthology.orchestra.run.smithi028.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.7 MB/s | 249 kB 00:00 2024-06-06T08:28:02.381 INFO:teuthology.orchestra.run.smithi059.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 234 kB/s | 25 kB 00:00 2024-06-06T08:28:02.411 INFO:teuthology.orchestra.run.smithi037.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 622 kB/s | 79 kB 00:00 2024-06-06T08:28:02.414 INFO:teuthology.orchestra.run.smithi028.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 861 kB/s | 49 kB 00:00 2024-06-06T08:28:02.426 INFO:teuthology.orchestra.run.smithi037.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-06-06T08:28:02.443 INFO:teuthology.orchestra.run.smithi037.stdout:(133/159): python3-portend-3.1.0-2.el9.noarch.r 989 kB/s | 16 kB 00:00 2024-06-06T08:28:02.469 INFO:teuthology.orchestra.run.smithi037.stdout:(134/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-06-06T08:28:02.472 INFO:teuthology.orchestra.run.smithi028.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 286 kB/s | 16 kB 00:00 2024-06-06T08:28:02.481 INFO:teuthology.orchestra.run.smithi059.stdout:(62/159): libtool-2.4.6-45.el9.x86_64.rpm 2.3 MB/s | 582 kB 00:00 2024-06-06T08:28:02.494 INFO:teuthology.orchestra.run.smithi037.stdout:(135/159): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-06-06T08:28:02.506 INFO:teuthology.orchestra.run.smithi059.stdout:(63/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 315 kB/s | 47 kB 00:00 2024-06-06T08:28:02.519 INFO:teuthology.orchestra.run.smithi037.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-06-06T08:28:02.532 INFO:teuthology.orchestra.run.smithi059.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-06-06T08:28:02.545 INFO:teuthology.orchestra.run.smithi037.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-06-06T08:28:02.557 INFO:teuthology.orchestra.run.smithi059.stdout:(65/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-06-06T08:28:02.578 INFO:teuthology.orchestra.run.smithi037.stdout:(138/159): python3-kubernetes-26.1.0-2.el9.noar 2.7 MB/s | 1.0 MB 00:00 2024-06-06T08:28:02.582 INFO:teuthology.orchestra.run.smithi059.stdout:(66/159): openblas-0.3.21-2.el9.x86_64.rpm 467 kB/s | 35 kB 00:00 2024-06-06T08:28:02.598 INFO:teuthology.orchestra.run.smithi028.stdout:(35/159): ceph-mgr-diskprediction-local-19.0.0- 7.9 MB/s | 7.4 MB 00:00 2024-06-06T08:28:02.604 INFO:teuthology.orchestra.run.smithi037.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-06-06T08:28:02.629 INFO:teuthology.orchestra.run.smithi037.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-06-06T08:28:02.632 INFO:teuthology.orchestra.run.smithi028.stdout:(36/159): ceph-volume-19.0.0-2946.g3d89accf.el9 1.6 MB/s | 264 kB 00:00 2024-06-06T08:28:02.654 INFO:teuthology.orchestra.run.smithi037.stdout:(141/159): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-06-06T08:28:02.675 INFO:teuthology.orchestra.run.smithi059.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-06-06T08:28:02.679 INFO:teuthology.orchestra.run.smithi037.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-06-06T08:28:02.682 INFO:teuthology.orchestra.run.smithi028.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 373 kB/s | 18 kB 00:00 2024-06-06T08:28:02.696 INFO:teuthology.orchestra.run.smithi037.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-06-06T08:28:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:(144/159): python3-zc-lockfile-2.0-10.el9.noarc 807 kB/s | 20 kB 00:00 2024-06-06T08:28:02.733 INFO:teuthology.orchestra.run.smithi059.stdout:(68/159): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2024-06-06T08:28:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:(145/159): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-06-06T08:28:02.766 INFO:teuthology.orchestra.run.smithi059.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 9.7 MB/s | 911 kB 00:00 2024-06-06T08:28:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-06T08:28:02.784 INFO:teuthology.orchestra.run.smithi028.stdout:(38/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 4.1 MB/s | 763 kB 00:00 2024-06-06T08:28:02.790 INFO:teuthology.orchestra.run.smithi028.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:02.791 INFO:teuthology.orchestra.run.smithi059.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-06-06T08:28:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:(147/159): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-06-06T08:28:02.834 INFO:teuthology.orchestra.run.smithi059.stdout:(71/159): postgresql-13.14-1.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-06-06T08:28:02.856 INFO:teuthology.orchestra.run.smithi037.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-06-06T08:28:02.857 INFO:teuthology.orchestra.run.smithi028.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:02.877 INFO:teuthology.orchestra.run.smithi059.stdout:(72/159): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-06-06T08:28:02.901 INFO:teuthology.orchestra.run.smithi059.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-06-06T08:28:02.934 INFO:teuthology.orchestra.run.smithi028.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 322 kB/s | 80 kB 00:00 2024-06-06T08:28:02.938 INFO:teuthology.orchestra.run.smithi028.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:02.943 INFO:teuthology.orchestra.run.smithi059.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-06-06T08:28:02.991 INFO:teuthology.orchestra.run.smithi028.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-06-06T08:28:03.015 INFO:teuthology.orchestra.run.smithi037.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-06-06T08:28:03.026 INFO:teuthology.orchestra.run.smithi059.stdout:(75/159): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-06-06T08:28:03.033 INFO:teuthology.orchestra.run.smithi028.stdout:(41/159): libgfortran-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 803 kB 00:00 2024-06-06T08:28:03.052 INFO:teuthology.orchestra.run.smithi059.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-06-06T08:28:03.067 INFO:teuthology.orchestra.run.smithi028.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-06-06T08:28:03.078 INFO:teuthology.orchestra.run.smithi059.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-06-06T08:28:03.090 INFO:teuthology.orchestra.run.smithi037.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-06-06T08:28:03.101 INFO:teuthology.orchestra.run.smithi028.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 3.2 MB/s | 106 kB 00:00 2024-06-06T08:28:03.102 INFO:teuthology.orchestra.run.smithi059.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-06-06T08:28:03.119 INFO:teuthology.orchestra.run.smithi059.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 455 kB/s | 19 kB 00:00 2024-06-06T08:28:03.132 INFO:teuthology.orchestra.run.smithi037.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 1.0 MB/s | 41 kB 00:00 2024-06-06T08:28:03.145 INFO:teuthology.orchestra.run.smithi059.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-06-06T08:28:03.159 INFO:teuthology.orchestra.run.smithi028.stdout:(44/159): python3-cryptography-36.0.1-4.el9.x86 9.9 MB/s | 1.2 MB 00:00 2024-06-06T08:28:03.162 INFO:teuthology.orchestra.run.smithi059.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 827 kB/s | 35 kB 00:00 2024-06-06T08:28:03.174 INFO:teuthology.orchestra.run.smithi037.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 5.8 MB/s | 248 kB 00:00 2024-06-06T08:28:03.185 INFO:teuthology.orchestra.run.smithi028.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-06-06T08:28:03.216 INFO:teuthology.orchestra.run.smithi037.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 886 kB/s | 37 kB 00:00 2024-06-06T08:28:03.237 INFO:teuthology.orchestra.run.smithi059.stdout:(82/159): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-06-06T08:28:03.243 INFO:teuthology.orchestra.run.smithi028.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-06-06T08:28:03.249 INFO:teuthology.orchestra.run.smithi028.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-06T08:28:03.262 INFO:teuthology.orchestra.run.smithi059.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-06-06T08:28:03.277 INFO:teuthology.orchestra.run.smithi028.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-06-06T08:28:03.279 INFO:teuthology.orchestra.run.smithi028.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:03.286 INFO:teuthology.orchestra.run.smithi037.stdout:(154/159): librados2-19.0.0-2946.g3d89accf.el9. 6.6 MB/s | 3.4 MB 00:00 2024-06-06T08:28:03.288 INFO:teuthology.orchestra.run.smithi059.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-06-06T08:28:03.309 INFO:teuthology.orchestra.run.smithi037.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 2.2 MB/s | 207 kB 00:00 2024-06-06T08:28:03.313 INFO:teuthology.orchestra.run.smithi059.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-06-06T08:28:03.338 INFO:teuthology.orchestra.run.smithi059.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-06-06T08:28:03.344 INFO:teuthology.orchestra.run.smithi028.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 6.8 MB/s | 689 kB 00:00 2024-06-06T08:28:03.349 INFO:teuthology.orchestra.run.smithi028.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:03.364 INFO:teuthology.orchestra.run.smithi059.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-06-06T08:28:03.367 INFO:teuthology.orchestra.run.smithi037.stdout:(156/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 5.6 MB/s | 3.1 MB 00:00 2024-06-06T08:28:03.389 INFO:teuthology.orchestra.run.smithi059.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-06T08:28:03.394 INFO:teuthology.orchestra.run.smithi028.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-06-06T08:28:03.409 INFO:teuthology.orchestra.run.smithi037.stdout:(157/159): openssl-3.2.1-1.el9.x86_64.rpm 13 MB/s | 1.3 MB 00:00 2024-06-06T08:28:03.422 INFO:teuthology.orchestra.run.smithi059.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-06-06T08:28:03.436 INFO:teuthology.orchestra.run.smithi028.stdout:(50/159): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-06-06T08:28:03.440 INFO:teuthology.orchestra.run.smithi059.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-06T08:28:03.451 INFO:teuthology.orchestra.run.smithi037.stdout:(158/159): elfutils-libs-0.191-4.el9.x86_64.rpm 1.5 MB/s | 260 kB 00:00 2024-06-06T08:28:03.456 INFO:teuthology.orchestra.run.smithi059.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-06-06T08:28:03.461 INFO:teuthology.orchestra.run.smithi028.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 329 kB/s | 22 kB 00:00 2024-06-06T08:28:03.482 INFO:teuthology.orchestra.run.smithi059.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2024-06-06T08:28:03.495 INFO:teuthology.orchestra.run.smithi028.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-06-06T08:28:03.517 INFO:teuthology.orchestra.run.smithi037.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-06-06T08:28:03.520 INFO:teuthology.orchestra.run.smithi028.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 567 kB/s | 33 kB 00:00 2024-06-06T08:28:03.524 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-06-06T08:28:03.524 INFO:teuthology.orchestra.run.smithi037.stdout:Total 14 MB/s | 225 MB 00:15 2024-06-06T08:28:03.557 INFO:teuthology.orchestra.run.smithi059.stdout:(93/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-06-06T08:28:03.563 INFO:teuthology.orchestra.run.smithi028.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 447 kB/s | 18 kB 00:00 2024-06-06T08:28:03.574 INFO:teuthology.orchestra.run.smithi059.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-06-06T08:28:03.599 INFO:teuthology.orchestra.run.smithi059.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-06-06T08:28:03.604 INFO:teuthology.orchestra.run.smithi028.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 273 kB/s | 11 kB 00:00 2024-06-06T08:28:03.616 INFO:teuthology.orchestra.run.smithi059.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 857 kB/s | 36 kB 00:00 2024-06-06T08:28:03.641 INFO:teuthology.orchestra.run.smithi059.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-06-06T08:28:03.655 INFO:teuthology.orchestra.run.smithi028.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 160 kB 00:00 2024-06-06T08:28:03.667 INFO:teuthology.orchestra.run.smithi059.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-06-06T08:28:03.692 INFO:teuthology.orchestra.run.smithi059.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-06-06T08:28:03.697 INFO:teuthology.orchestra.run.smithi028.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-06-06T08:28:03.717 INFO:teuthology.orchestra.run.smithi059.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-06-06T08:28:03.743 INFO:teuthology.orchestra.run.smithi059.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-06-06T08:28:03.768 INFO:teuthology.orchestra.run.smithi059.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-06-06T08:28:03.768 INFO:teuthology.orchestra.run.smithi059.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:03.770 INFO:teuthology.orchestra.run.smithi059.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:03.789 INFO:teuthology.orchestra.run.smithi028.stdout:(58/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-06-06T08:28:03.801 INFO:teuthology.orchestra.run.smithi059.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-06-06T08:28:03.831 INFO:teuthology.orchestra.run.smithi028.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 4.9 MB/s | 662 kB 00:00 2024-06-06T08:28:03.843 INFO:teuthology.orchestra.run.smithi059.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-06-06T08:28:03.872 INFO:teuthology.orchestra.run.smithi028.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 625 kB/s | 25 kB 00:00 2024-06-06T08:28:03.906 INFO:teuthology.orchestra.run.smithi028.stdout:(61/159): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-06-06T08:28:03.910 INFO:teuthology.orchestra.run.smithi059.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 4.9 MB/s | 548 kB 00:00 2024-06-06T08:28:03.931 INFO:teuthology.orchestra.run.smithi028.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 822 kB/s | 47 kB 00:00 2024-06-06T08:28:03.944 INFO:teuthology.orchestra.run.smithi059.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 632 kB/s | 19 kB 00:00 2024-06-06T08:28:03.965 INFO:teuthology.orchestra.run.smithi028.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-06-06T08:28:03.994 INFO:teuthology.orchestra.run.smithi059.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 2.0 MB/s | 309 kB 00:00 2024-06-06T08:28:03.999 INFO:teuthology.orchestra.run.smithi028.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-06-06T08:28:04.020 INFO:teuthology.orchestra.run.smithi059.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-06-06T08:28:04.024 INFO:teuthology.orchestra.run.smithi028.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 611 kB/s | 35 kB 00:00 2024-06-06T08:28:04.179 INFO:teuthology.orchestra.run.smithi059.stdout:(109/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-06-06T08:28:04.200 INFO:teuthology.orchestra.run.smithi028.stdout:(66/159): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2024-06-06T08:28:04.203 INFO:teuthology.orchestra.run.smithi059.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 264 kB/s | 49 kB 00:00 2024-06-06T08:28:04.270 INFO:teuthology.orchestra.run.smithi059.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 3.9 MB/s | 151 kB 00:00 2024-06-06T08:28:04.296 INFO:teuthology.orchestra.run.smithi059.stdout:(112/159): libunwind-1.6.2-1.el9.x86_64.rpm 576 kB/s | 67 kB 00:00 2024-06-06T08:28:04.300 INFO:teuthology.orchestra.run.smithi028.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-06-06T08:28:04.346 INFO:teuthology.orchestra.run.smithi059.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-06-06T08:28:04.371 INFO:teuthology.orchestra.run.smithi059.stdout:(114/159): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-06-06T08:28:04.397 INFO:teuthology.orchestra.run.smithi059.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-06-06T08:28:04.398 INFO:teuthology.orchestra.run.smithi028.stdout:(68/159): postgresql-contrib-13.14-1.el9.x86_64 9.1 MB/s | 911 kB 00:00 2024-06-06T08:28:04.422 INFO:teuthology.orchestra.run.smithi059.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-06-06T08:28:04.447 INFO:teuthology.orchestra.run.smithi059.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-06-06T08:28:04.450 INFO:teuthology.orchestra.run.smithi028.stdout:(69/159): postgresql-13.14-1.el9.x86_64.rpm 6.4 MB/s | 1.6 MB 00:00 2024-06-06T08:28:04.464 INFO:teuthology.orchestra.run.smithi059.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-06-06T08:28:04.484 INFO:teuthology.orchestra.run.smithi028.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.5 MB/s | 133 kB 00:00 2024-06-06T08:28:04.514 INFO:teuthology.orchestra.run.smithi059.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-06-06T08:28:04.540 INFO:teuthology.orchestra.run.smithi059.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-06-06T08:28:04.568 INFO:teuthology.orchestra.run.smithi028.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-06-06T08:28:04.610 INFO:teuthology.orchestra.run.smithi028.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-06-06T08:28:04.615 INFO:teuthology.orchestra.run.smithi059.stdout:(121/159): libarrow-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-06-06T08:28:04.640 INFO:teuthology.orchestra.run.smithi059.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 1.6 MB/s | 206 kB 00:00 2024-06-06T08:28:04.666 INFO:teuthology.orchestra.run.smithi059.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-06-06T08:28:04.691 INFO:teuthology.orchestra.run.smithi059.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-06-06T08:28:04.718 INFO:teuthology.orchestra.run.smithi059.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-06-06T08:28:04.741 INFO:teuthology.orchestra.run.smithi059.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-06-06T08:28:04.755 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-06-06T08:28:04.760 INFO:teuthology.orchestra.run.smithi028.stdout:(73/159): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-06-06T08:28:04.767 INFO:teuthology.orchestra.run.smithi059.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-06-06T08:28:04.792 INFO:teuthology.orchestra.run.smithi059.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-06-06T08:28:04.817 INFO:teuthology.orchestra.run.smithi059.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-06-06T08:28:04.876 INFO:teuthology.orchestra.run.smithi059.stdout:(130/159): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-06-06T08:28:04.901 INFO:teuthology.orchestra.run.smithi059.stdout:(131/159): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-06-06T08:28:04.932 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-06-06T08:28:04.932 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-06-06T08:28:04.935 INFO:teuthology.orchestra.run.smithi059.stdout:(132/159): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-06-06T08:28:04.960 INFO:teuthology.orchestra.run.smithi059.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-06-06T08:28:04.977 INFO:teuthology.orchestra.run.smithi059.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 392 kB/s | 16 kB 00:00 2024-06-06T08:28:04.994 INFO:teuthology.orchestra.run.smithi059.stdout:(135/159): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-06-06T08:28:05.028 INFO:teuthology.orchestra.run.smithi059.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-06-06T08:28:05.053 INFO:teuthology.orchestra.run.smithi059.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 523 kB/s | 31 kB 00:00 2024-06-06T08:28:05.078 INFO:teuthology.orchestra.run.smithi059.stdout:(138/159): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-06-06T08:28:05.104 INFO:teuthology.orchestra.run.smithi059.stdout:(139/159): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-06-06T08:28:05.129 INFO:teuthology.orchestra.run.smithi059.stdout:(140/159): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-06-06T08:28:05.154 INFO:teuthology.orchestra.run.smithi059.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-06T08:28:05.205 INFO:teuthology.orchestra.run.smithi059.stdout:(142/159): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-06-06T08:28:05.230 INFO:teuthology.orchestra.run.smithi059.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-06-06T08:28:05.235 INFO:teuthology.orchestra.run.smithi028.stdout:(74/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 7.1 MB/s | 48 MB 00:06 2024-06-06T08:28:05.255 INFO:teuthology.orchestra.run.smithi059.stdout:(144/159): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-06-06T08:28:05.260 INFO:teuthology.orchestra.run.smithi028.stdout:(75/159): python3-colorama-0.4.6-3.el9.noarch.r 122 kB/s | 61 kB 00:00 2024-06-06T08:28:05.280 INFO:teuthology.orchestra.run.smithi059.stdout:(145/159): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-06-06T08:28:05.306 INFO:teuthology.orchestra.run.smithi059.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-06T08:28:05.310 INFO:teuthology.orchestra.run.smithi028.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-06-06T08:28:05.339 INFO:teuthology.orchestra.run.smithi059.stdout:(147/159): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-06-06T08:28:05.353 INFO:teuthology.orchestra.run.smithi028.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 620 kB/s | 26 kB 00:00 2024-06-06T08:28:05.386 INFO:teuthology.orchestra.run.smithi028.stdout:(78/159): python3-devel-3.9.18-3.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2024-06-06T08:28:05.390 INFO:teuthology.orchestra.run.smithi059.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-06-06T08:28:05.411 INFO:teuthology.orchestra.run.smithi028.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 332 kB/s | 19 kB 00:00 2024-06-06T08:28:05.445 INFO:teuthology.orchestra.run.smithi028.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-06-06T08:28:05.470 INFO:teuthology.orchestra.run.smithi028.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 602 kB/s | 35 kB 00:00 2024-06-06T08:28:05.523 INFO:teuthology.orchestra.run.smithi059.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 17 MB/s | 2.3 MB 00:00 2024-06-06T08:28:05.582 INFO:teuthology.orchestra.run.smithi059.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 31 MB/s | 1.8 MB 00:00 2024-06-06T08:28:05.587 INFO:teuthology.orchestra.run.smithi028.stdout:(82/159): python3-babel-2.9.1-2.el9.noarch.rpm 6.1 MB/s | 6.0 MB 00:00 2024-06-06T08:28:05.615 INFO:teuthology.orchestra.run.smithi059.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-06-06T08:28:05.621 INFO:teuthology.orchestra.run.smithi028.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-06-06T08:28:05.655 INFO:teuthology.orchestra.run.smithi028.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-06-06T08:28:05.657 INFO:teuthology.orchestra.run.smithi059.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 5.8 MB/s | 248 kB 00:00 2024-06-06T08:28:05.680 INFO:teuthology.orchestra.run.smithi028.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-06-06T08:28:05.691 INFO:teuthology.orchestra.run.smithi059.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 1.1 MB/s | 37 kB 00:00 2024-06-06T08:28:05.705 INFO:teuthology.orchestra.run.smithi028.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 855 kB/s | 42 kB 00:00 2024-06-06T08:28:05.733 INFO:teuthology.orchestra.run.smithi059.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 4.8 MB/s | 207 kB 00:00 2024-06-06T08:28:05.739 INFO:teuthology.orchestra.run.smithi028.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 269 kB 00:00 2024-06-06T08:28:05.775 INFO:teuthology.orchestra.run.smithi059.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 6.1 MB/s | 260 kB 00:00 2024-06-06T08:28:05.834 INFO:teuthology.orchestra.run.smithi059.stdout:(156/159): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-06-06T08:28:05.875 INFO:teuthology.orchestra.run.smithi028.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 944 kB/s | 159 kB 00:00 2024-06-06T08:28:05.901 INFO:teuthology.orchestra.run.smithi059.stdout:(157/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 36 MB/s | 2.4 MB 00:00 2024-06-06T08:28:05.923 INFO:teuthology.orchestra.run.smithi028.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-06-06T08:28:05.948 INFO:teuthology.orchestra.run.smithi028.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 705 kB/s | 51 kB 00:00 2024-06-06T08:28:05.982 INFO:teuthology.orchestra.run.smithi028.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 925 kB/s | 54 kB 00:00 2024-06-06T08:28:06.024 INFO:teuthology.orchestra.run.smithi028.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-06-06T08:28:06.066 INFO:teuthology.orchestra.run.smithi028.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.1 MB/s | 44 kB 00:00 2024-06-06T08:28:06.116 INFO:teuthology.orchestra.run.smithi028.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 4.4 MB/s | 221 kB 00:00 2024-06-06T08:28:06.158 INFO:teuthology.orchestra.run.smithi028.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 879 kB/s | 36 kB 00:00 2024-06-06T08:28:06.267 INFO:teuthology.orchestra.run.smithi028.stdout:(96/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.2 MB/s | 5.1 MB 00:00 2024-06-06T08:28:06.292 INFO:teuthology.orchestra.run.smithi028.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 357 kB/s | 47 kB 00:00 2024-06-06T08:28:06.326 INFO:teuthology.orchestra.run.smithi028.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-06-06T08:28:06.351 INFO:teuthology.orchestra.run.smithi028.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-06-06T08:28:06.376 INFO:teuthology.orchestra.run.smithi028.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.9 MB/s | 94 kB 00:00 2024-06-06T08:28:06.401 INFO:teuthology.orchestra.run.smithi028.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-06-06T08:28:06.427 INFO:teuthology.orchestra.run.smithi028.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-06-06T08:28:06.429 INFO:teuthology.orchestra.run.smithi028.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:06.432 INFO:teuthology.orchestra.run.smithi028.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T08:28:06.477 INFO:teuthology.orchestra.run.smithi028.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-06-06T08:28:06.545 INFO:teuthology.orchestra.run.smithi028.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 7.3 MB/s | 863 kB 00:00 2024-06-06T08:28:06.603 INFO:teuthology.orchestra.run.smithi028.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-06-06T08:28:06.628 INFO:teuthology.orchestra.run.smithi028.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 807 kB/s | 19 kB 00:00 2024-06-06T08:28:06.687 INFO:teuthology.orchestra.run.smithi028.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 2.1 MB/s | 309 kB 00:00 2024-06-06T08:28:06.712 INFO:teuthology.orchestra.run.smithi028.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-06-06T08:28:06.737 INFO:teuthology.orchestra.run.smithi028.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-06-06T08:28:06.771 INFO:teuthology.orchestra.run.smithi028.stdout:(110/159): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-06-06T08:28:06.785 INFO:teuthology.orchestra.run.smithi059.stdout:(158/159): librados2-19.0.0-2946.g3d89accf.el9. 2.3 MB/s | 3.4 MB 00:01 2024-06-06T08:28:06.813 INFO:teuthology.orchestra.run.smithi028.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-06-06T08:28:06.850 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-06-06T08:28:06.851 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-06-06T08:28:06.876 INFO:teuthology.orchestra.run.smithi059.stdout:(159/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 2.0 MB/s | 3.1 MB 00:01 2024-06-06T08:28:06.882 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-06-06T08:28:06.882 INFO:teuthology.orchestra.run.smithi059.stdout:Total 11 MB/s | 225 MB 00:19 2024-06-06T08:28:06.896 INFO:teuthology.orchestra.run.smithi028.stdout:(112/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 839 kB 00:00 2024-06-06T08:28:06.955 INFO:teuthology.orchestra.run.smithi028.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 9.3 MB/s | 548 kB 00:00 2024-06-06T08:28:06.980 INFO:teuthology.orchestra.run.smithi028.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.8 MB/s | 43 kB 00:00 2024-06-06T08:28:07.006 INFO:teuthology.orchestra.run.smithi028.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-06T08:28:07.031 INFO:teuthology.orchestra.run.smithi028.stdout:(116/159): python3-certifi-2021.10.8-2.el9.noar 627 kB/s | 15 kB 00:00 2024-06-06T08:28:07.073 INFO:teuthology.orchestra.run.smithi028.stdout:(117/159): python3-cheroot-8.6.0-4.el9.noarch.r 4.1 MB/s | 172 kB 00:00 2024-06-06T08:28:07.140 INFO:teuthology.orchestra.run.smithi028.stdout:(118/159): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-06-06T08:28:07.193 INFO:teuthology.orchestra.run.smithi028.stdout:(119/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.0 MB/s | 303 kB 00:00 2024-06-06T08:28:07.233 INFO:teuthology.orchestra.run.smithi028.stdout:(120/159): python3-google-auth-2.29.0-1.el9.noa 4.9 MB/s | 206 kB 00:00 2024-06-06T08:28:07.375 INFO:teuthology.orchestra.run.smithi028.stdout:(121/159): libarrow-9.0.0-11.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-06-06T08:28:07.408 INFO:teuthology.orchestra.run.smithi028.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-06-06T08:28:07.433 INFO:teuthology.orchestra.run.smithi028.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 441 kB/s | 11 kB 00:00 2024-06-06T08:28:07.459 INFO:teuthology.orchestra.run.smithi028.stdout:(124/159): python3-jaraco-classes-3.2.1-5.el9.n 733 kB/s | 18 kB 00:00 2024-06-06T08:28:07.484 INFO:teuthology.orchestra.run.smithi028.stdout:(125/159): python3-jaraco-collections-3.0.0-8.e 959 kB/s | 23 kB 00:00 2024-06-06T08:28:07.509 INFO:teuthology.orchestra.run.smithi028.stdout:(126/159): python3-jaraco-functools-3.5.0-2.el9 805 kB/s | 19 kB 00:00 2024-06-06T08:28:07.535 INFO:teuthology.orchestra.run.smithi028.stdout:(127/159): python3-jaraco-text-3.2.0-6.el9.noar 816 kB/s | 20 kB 00:00 2024-06-06T08:28:07.760 INFO:teuthology.orchestra.run.smithi028.stdout:(128/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.0 MB/s | 16 MB 00:01 2024-06-06T08:28:07.994 INFO:teuthology.orchestra.run.smithi028.stdout:(129/159): python3-grpcio-1.46.7-10.el9.x86_64. 2.7 MB/s | 2.0 MB 00:00 2024-06-06T08:28:08.019 INFO:teuthology.orchestra.run.smithi028.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 180 kB/s | 46 kB 00:00 2024-06-06T08:28:08.053 INFO:teuthology.orchestra.run.smithi028.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-06-06T08:28:08.078 INFO:teuthology.orchestra.run.smithi028.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 1.0 MB/s | 58 kB 00:00 2024-06-06T08:28:08.103 INFO:teuthology.orchestra.run.smithi028.stdout:(133/159): python3-portend-3.1.0-2.el9.noarch.r 681 kB/s | 16 kB 00:00 2024-06-06T08:28:08.137 INFO:teuthology.orchestra.run.smithi028.stdout:(134/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.7 MB/s | 90 kB 00:00 2024-06-06T08:28:08.155 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-06-06T08:28:08.162 INFO:teuthology.orchestra.run.smithi028.stdout:(135/159): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-06-06T08:28:08.187 INFO:teuthology.orchestra.run.smithi028.stdout:(136/159): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-06-06T08:28:08.221 INFO:teuthology.orchestra.run.smithi028.stdout:(137/159): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-06-06T08:28:08.255 INFO:teuthology.orchestra.run.smithi028.stdout:(138/159): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-06-06T08:28:08.288 INFO:teuthology.orchestra.run.smithi028.stdout:(139/159): python3-tempora-5.0.0-2.el9.noarch.r 1.1 MB/s | 36 kB 00:00 2024-06-06T08:28:08.314 INFO:teuthology.orchestra.run.smithi028.stdout:(140/159): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-06-06T08:28:08.333 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-06-06T08:28:08.333 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-06-06T08:28:08.339 INFO:teuthology.orchestra.run.smithi028.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-06T08:28:08.381 INFO:teuthology.orchestra.run.smithi028.stdout:(142/159): python3-kubernetes-26.1.0-2.el9.noar 1.2 MB/s | 1.0 MB 00:00 2024-06-06T08:28:08.414 INFO:teuthology.orchestra.run.smithi028.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-06-06T08:28:08.431 INFO:teuthology.orchestra.run.smithi028.stdout:(144/159): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-06-06T08:28:08.465 INFO:teuthology.orchestra.run.smithi028.stdout:(145/159): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-06-06T08:28:08.516 INFO:teuthology.orchestra.run.smithi028.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2024-06-06T08:28:08.549 INFO:teuthology.orchestra.run.smithi028.stdout:(147/159): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-06-06T08:28:08.633 INFO:teuthology.orchestra.run.smithi028.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-06-06T08:28:08.783 INFO:teuthology.orchestra.run.smithi028.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-06-06T08:28:08.867 INFO:teuthology.orchestra.run.smithi028.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 22 MB/s | 1.8 MB 00:00 2024-06-06T08:28:08.909 INFO:teuthology.orchestra.run.smithi028.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 1.0 MB/s | 41 kB 00:00 2024-06-06T08:28:08.951 INFO:teuthology.orchestra.run.smithi028.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 5.9 MB/s | 248 kB 00:00 2024-06-06T08:28:09.001 INFO:teuthology.orchestra.run.smithi028.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 749 kB/s | 37 kB 00:00 2024-06-06T08:28:09.043 INFO:teuthology.orchestra.run.smithi028.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 5.0 MB/s | 207 kB 00:00 2024-06-06T08:28:09.093 INFO:teuthology.orchestra.run.smithi028.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-06-06T08:28:09.177 INFO:teuthology.orchestra.run.smithi028.stdout:(156/159): openssl-3.2.1-1.el9.x86_64.rpm 16 MB/s | 1.3 MB 00:00 2024-06-06T08:28:09.286 INFO:teuthology.orchestra.run.smithi028.stdout:(157/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-06-06T08:28:09.695 INFO:teuthology.orchestra.run.smithi028.stdout:(158/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 2.7 MB/s | 3.1 MB 00:01 2024-06-06T08:28:09.877 INFO:teuthology.orchestra.run.smithi028.stdout:(159/159): librados2-19.0.0-2946.g3d89accf.el9. 2.5 MB/s | 3.4 MB 00:01 2024-06-06T08:28:09.889 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-06-06T08:28:09.890 INFO:teuthology.orchestra.run.smithi028.stdout:Total 11 MB/s | 225 MB 00:19 2024-06-06T08:28:10.256 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-06-06T08:28:10.257 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-06-06T08:28:13.214 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-06-06T08:28:13.317 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-06-06T08:28:13.456 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-06T08:28:13.485 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-06-06T08:28:13.485 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-06-06T08:28:13.630 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-06T08:28:13.684 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-06T08:28:13.724 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-06T08:28:13.749 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-06T08:28:13.795 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-06T08:28:14.149 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-06T08:28:14.274 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T08:28:14.399 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T08:28:14.425 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T08:28:14.526 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T08:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T08:28:14.588 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-06T08:28:14.805 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-06T08:28:14.862 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-06T08:28:14.898 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T08:28:14.986 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T08:28:15.007 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T08:28:15.053 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T08:28:15.074 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T08:28:15.098 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T08:28:15.301 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T08:28:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T08:28:15.564 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T08:28:15.624 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T08:28:15.720 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T08:28:15.783 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T08:28:15.990 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T08:28:16.103 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-06T08:28:16.106 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-06-06T08:28:16.107 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-06-06T08:28:16.201 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-06T08:28:16.241 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-06T08:28:16.277 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-06T08:28:16.354 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-06T08:28:16.393 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-06T08:28:16.436 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-06T08:28:16.468 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-06T08:28:16.496 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-06T08:28:16.569 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-06T08:28:16.629 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-06T08:28:16.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-06T08:28:16.702 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-06T08:28:16.781 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-06T08:28:16.813 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-06T08:28:16.832 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-06-06T08:28:16.856 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-06T08:28:16.884 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-06T08:28:16.897 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-06T08:28:16.936 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-06T08:28:16.959 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-06T08:28:16.990 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-06T08:28:17.008 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-06T08:28:17.023 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-06T08:28:17.048 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-06T08:28:17.086 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-06T08:28:17.100 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-06T08:28:17.234 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-06T08:28:17.296 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-06T08:28:17.448 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-06T08:28:17.557 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T08:28:17.665 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T08:28:17.692 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T08:28:17.776 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T08:28:17.804 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T08:28:17.838 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-06T08:28:17.854 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-06T08:28:17.945 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-06T08:28:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-06T08:28:18.015 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-06T08:28:18.030 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-06T08:28:18.073 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-06T08:28:18.078 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-06T08:28:18.097 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T08:28:18.111 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-06T08:28:18.153 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-06T08:28:18.202 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T08:28:18.231 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T08:28:18.294 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T08:28:18.316 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T08:28:18.317 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-06T08:28:18.342 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T08:28:18.364 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-06T08:28:18.421 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-06T08:28:18.484 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T08:28:18.496 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-06T08:28:18.531 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-06T08:28:18.568 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-06T08:28:18.615 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-06T08:28:18.618 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T08:28:18.650 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-06T08:28:18.694 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-06T08:28:18.736 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-06T08:28:18.771 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T08:28:18.832 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T08:28:18.936 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T08:28:18.973 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-06T08:28:19.013 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-06T08:28:19.033 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T08:28:19.055 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-06T08:28:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-06T08:28:19.187 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-06T08:28:19.227 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-06T08:28:19.245 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T08:28:19.260 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-06T08:28:19.285 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-06T08:28:19.360 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-06T08:28:19.363 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-06T08:28:19.465 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-06T08:28:19.493 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-06T08:28:19.500 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-06T08:28:19.534 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-06T08:28:19.544 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-06T08:28:19.563 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-06T08:28:19.597 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-06T08:28:19.621 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-06T08:28:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-06T08:28:19.660 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-06T08:28:19.685 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-06T08:28:19.704 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-06T08:28:19.714 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-06T08:28:19.737 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-06T08:28:19.748 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-06T08:28:19.764 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-06T08:28:19.798 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-06T08:28:19.836 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-06T08:28:19.840 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-06T08:28:19.874 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-06T08:28:19.888 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-06T08:28:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-06T08:28:19.961 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-06T08:28:19.965 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-06T08:28:20.013 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-06T08:28:20.041 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-06T08:28:20.052 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-06T08:28:20.072 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-06T08:28:20.102 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-06T08:28:20.115 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-06T08:28:20.144 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-06T08:28:20.213 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-06T08:28:20.217 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-06T08:28:20.259 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-06T08:28:20.264 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-06T08:28:20.337 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-06T08:28:20.483 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-06T08:28:20.538 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-06T08:28:21.034 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-06T08:28:21.084 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-06T08:28:21.117 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-06T08:28:21.118 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-06T08:28:21.201 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-06T08:28:21.222 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-06T08:28:21.235 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-06T08:28:21.272 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-06T08:28:21.274 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-06T08:28:21.319 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-06T08:28:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-06T08:28:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-06T08:28:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-06T08:28:21.410 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-06T08:28:21.446 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-06T08:28:21.551 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-06T08:28:21.604 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-06T08:28:21.622 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-06T08:28:21.651 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-06T08:28:21.660 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-06T08:28:21.731 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-06T08:28:21.735 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-06T08:28:21.771 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-06T08:28:21.807 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-06T08:28:21.858 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-06T08:28:21.891 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-06T08:28:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-06T08:28:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-06T08:28:22.121 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-06T08:28:22.161 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-06T08:28:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-06T08:28:22.301 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-06T08:28:22.335 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-06T08:28:22.423 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-06T08:28:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-06T08:28:22.547 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-06T08:28:22.676 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-06T08:28:22.785 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-06T08:28:22.954 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-06T08:28:23.087 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-06-06T08:28:23.095 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-06T08:28:23.133 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-06T08:28:23.161 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-06T08:28:23.184 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-06T08:28:23.204 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-06T08:28:23.243 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-06T08:28:23.258 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-06T08:28:23.283 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-06T08:28:23.313 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-06T08:28:23.347 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-06T08:28:23.382 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-06T08:28:23.383 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-06T08:28:23.430 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-06T08:28:23.441 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-06T08:28:23.464 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-06T08:28:23.478 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-06T08:28:23.548 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-06T08:28:23.586 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-06T08:28:23.595 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-06T08:28:23.626 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-06T08:28:23.674 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-06T08:28:23.785 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-06T08:28:23.846 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-06T08:28:23.870 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-06T08:28:23.947 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-06T08:28:23.976 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-06T08:28:24.008 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-06T08:28:24.029 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-06T08:28:24.142 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T08:28:24.322 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T08:28:24.336 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-06T08:28:24.343 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T08:28:24.385 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T08:28:24.479 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T08:28:24.489 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T08:28:24.509 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-06T08:28:24.527 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T08:28:24.546 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-06T08:28:24.599 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-06T08:28:24.614 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-06T08:28:24.658 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-06T08:28:24.692 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-06T08:28:24.795 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-06T08:28:24.851 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-06T08:28:24.901 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-06T08:28:24.908 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-06T08:28:24.976 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-06T08:28:24.991 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-06T08:28:24.999 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T08:28:25.036 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-06T08:28:25.043 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-06T08:28:25.074 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T08:28:25.137 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T08:28:25.167 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-06T08:28:25.170 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T08:28:25.201 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T08:28:25.222 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-06T08:28:25.258 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-06T08:28:25.295 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-06T08:28:25.318 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T08:28:25.339 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-06T08:28:25.382 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T08:28:25.662 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T08:28:25.927 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T08:28:26.022 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-06T08:28:26.108 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T08:28:26.143 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-06T08:28:26.196 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T08:28:26.370 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T08:28:26.469 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T08:28:26.820 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T08:28:26.974 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-06T08:28:27.097 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-06T08:28:27.143 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-06T08:28:27.192 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-06T08:28:27.307 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-06T08:28:27.355 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-06T08:28:27.418 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-06T08:28:27.446 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-06T08:28:27.470 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-06T08:28:27.508 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-06T08:28:27.520 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-06T08:28:27.548 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-06T08:28:27.551 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T08:28:27.581 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-06T08:28:27.588 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T08:28:27.631 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-06T08:28:27.697 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-06T08:28:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-06T08:28:27.791 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-06T08:28:27.906 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-06T08:28:27.909 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-06T08:28:27.946 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-06T08:28:27.961 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T08:28:27.997 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-06T08:28:28.029 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-06T08:28:28.052 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T08:28:28.083 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-06T08:28:28.119 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-06T08:28:28.136 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-06T08:28:28.160 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T08:28:28.200 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T08:28:28.209 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-06T08:28:28.292 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T08:28:28.292 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-06T08:28:28.292 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-06T08:28:28.292 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:28:28.322 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-06T08:28:28.326 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T08:28:28.507 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-06T08:28:28.569 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-06T08:28:28.616 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-06T08:28:28.639 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T08:28:28.710 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T08:28:28.740 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-06T08:28:29.269 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-06T08:28:29.376 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-06T08:28:29.410 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-06T08:28:29.452 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-06T08:28:29.506 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-06T08:28:29.569 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-06T08:28:29.643 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-06T08:28:29.880 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-06T08:28:29.939 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-06T08:28:30.020 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-06T08:28:30.133 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-06T08:28:30.172 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-06T08:28:30.209 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-06T08:28:30.281 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-06T08:28:30.328 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-06T08:28:30.390 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-06T08:28:30.458 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-06T08:28:30.681 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-06T08:28:30.729 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-06T08:28:30.786 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-06T08:28:30.929 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-06T08:28:30.979 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-06T08:28:31.027 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-06T08:28:31.060 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-06T08:28:31.093 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-06T08:28:31.144 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T08:28:31.178 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T08:28:31.275 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-06T08:28:31.462 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-06T08:28:31.499 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-06T08:28:31.537 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-06T08:28:31.583 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-06T08:28:31.640 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-06T08:28:31.695 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-06T08:28:31.737 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-06T08:28:31.750 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T08:28:31.783 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-06T08:28:31.790 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T08:28:31.841 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-06T08:28:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T08:28:31.865 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-06T08:28:31.865 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-06T08:28:31.865 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:28:31.899 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T08:28:31.918 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-06T08:28:31.966 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-06T08:28:32.114 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-06T08:28:32.177 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-06T08:28:32.221 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-06T08:28:32.295 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-06T08:28:32.456 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-06T08:28:32.527 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-06T08:28:33.531 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-06T08:28:33.593 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-06T08:28:33.618 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-06T08:28:33.750 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-06T08:28:33.814 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-06T08:28:33.874 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-06T08:28:33.987 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-06T08:28:34.029 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-06T08:28:34.283 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-06T08:28:34.317 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-06T08:28:34.439 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-06T08:28:35.372 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-06T08:28:35.529 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-06T08:28:37.262 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-06T08:28:37.382 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-06T08:28:37.420 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-06T08:28:37.463 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-06T08:28:37.863 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-06T08:28:37.902 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T08:28:38.008 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-06T08:28:38.067 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-06T08:28:38.126 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-06T08:28:38.718 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-06T08:28:38.755 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T08:28:38.856 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-06T08:28:38.891 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-06T08:28:40.260 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T08:28:40.260 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-06-06T08:28:40.260 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-06-06T08:28:40.260 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-06-06T08:28:40.260 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-06-06T08:28:40.260 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-06-06T08:28:40.260 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-06-06T08:28:40.260 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-06-06T08:28:40.260 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:28:40.445 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T08:28:40.462 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T08:28:40.462 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:40.462 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-06T08:28:40.462 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:28:41.694 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T08:28:41.745 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T08:28:41.990 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T08:28:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T08:28:42.017 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:42.017 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-06T08:28:42.017 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T08:28:42.017 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T08:28:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:28:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T08:28:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T08:28:42.272 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:42.272 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-06T08:28:42.272 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T08:28:42.272 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T08:28:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:28:42.440 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-06T08:28:42.489 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T08:28:42.651 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-06T08:28:42.651 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-06T08:28:42.651 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-06T08:28:42.651 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:28:42.698 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T08:28:42.733 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T08:28:42.756 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T08:28:42.757 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:42.757 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-06T08:28:42.757 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T08:28:42.757 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T08:28:42.757 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:28:42.864 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-06T08:28:42.922 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-06T08:28:42.985 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-06T08:28:43.188 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-06T08:28:43.242 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-06T08:28:43.324 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-06T08:28:43.414 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-06T08:28:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-06T08:28:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-06T08:28:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-06T08:28:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-06T08:28:43.846 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T08:28:43.846 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2024-06-06T08:28:43.846 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2024-06-06T08:28:43.847 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2024-06-06T08:28:43.847 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2024-06-06T08:28:43.847 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2024-06-06T08:28:43.847 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /root 2024-06-06T08:28:43.847 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2024-06-06T08:28:43.848 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:28:44.015 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T08:28:44.032 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T08:28:44.032 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:44.032 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-06T08:28:44.032 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:28:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T08:28:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T08:28:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-06T08:28:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-06T08:28:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T08:28:45.373 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T08:28:45.416 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T08:28:45.560 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T08:28:45.588 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T08:28:45.588 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:45.588 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-06T08:28:45.588 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T08:28:45.588 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T08:28:45.588 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:28:45.819 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T08:28:45.843 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T08:28:45.843 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:45.843 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-06T08:28:45.843 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T08:28:45.843 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T08:28:45.843 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:28:46.312 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T08:28:46.336 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T08:28:46.336 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:46.336 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-06T08:28:46.336 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T08:28:46.336 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T08:28:46.336 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:28:46.433 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T08:28:46.451 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-06T08:28:46.466 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T08:28:46.509 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-06T08:28:46.573 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-06T08:28:46.576 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T08:28:46.745 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-06T08:28:46.776 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-06T08:28:46.776 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T08:28:46.801 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T08:28:46.801 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:46.801 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-06T08:28:46.801 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T08:28:46.801 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T08:28:46.801 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:28:46.821 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-06T08:28:46.852 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T08:28:46.863 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T08:28:46.902 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-06T08:28:46.964 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-06T08:28:46.990 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-06T08:28:47.018 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-06T08:28:47.141 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-06T08:28:47.204 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-06T08:28:47.236 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-06T08:28:47.263 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-06T08:28:47.683 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T08:28:47.704 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T08:28:47.735 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-06T08:28:47.800 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-06T08:28:47.826 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T08:28:47.964 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-06T08:28:47.996 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T08:28:48.020 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T08:28:48.020 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:48.020 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-06T08:28:48.020 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T08:28:48.020 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T08:28:48.020 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:28:48.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T08:28:48.095 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T08:28:48.095 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:48.096 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-06T08:28:48.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:28:48.147 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T08:28:48.171 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T08:28:48.171 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:48.172 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-06T08:28:48.172 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T08:28:48.172 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T08:28:48.172 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:28:48.489 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T08:28:48.514 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T08:28:48.514 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:48.514 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-06T08:28:48.514 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T08:28:48.514 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T08:28:48.514 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:28:48.916 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T08:28:48.953 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T08:28:49.968 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T08:28:50.003 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T08:28:50.113 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T08:28:50.291 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-06T08:28:50.322 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T08:28:50.347 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T08:28:50.347 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:50.347 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-06T08:28:50.348 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T08:28:50.348 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T08:28:50.348 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:28:50.398 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T08:28:50.409 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T08:28:50.502 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-06T08:28:50.556 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-06T08:28:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-06T08:28:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T08:28:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T08:28:51.557 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:51.558 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-06T08:28:51.558 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T08:28:51.558 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T08:28:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:28:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T08:28:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T08:28:51.625 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:51.625 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-06T08:28:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:28:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T08:28:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T08:28:51.700 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:51.700 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-06T08:28:51.700 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T08:28:51.700 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T08:28:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:28:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T08:28:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T08:28:52.042 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:52.042 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-06T08:28:52.042 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T08:28:52.043 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T08:28:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:28:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-06T08:28:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-06T08:28:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-06T08:28:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-06T08:28:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-06T08:28:53.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-06T08:28:53.747 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-06T08:28:53.780 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-06T08:28:53.820 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-06T08:28:53.850 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-06T08:28:53.896 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T08:28:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T08:28:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T08:28:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T08:28:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-06T08:28:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-06T08:28:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-06T08:28:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-06T08:28:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-06T08:28:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T08:28:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-06T08:28:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-06T08:28:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T08:28:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T08:28:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-06T08:28:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T08:28:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T08:28:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-06T08:28:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T08:28:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T08:28:56.297 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-06T08:28:56.297 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /sys 2024-06-06T08:28:56.298 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /proc 2024-06-06T08:28:56.298 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /mnt 2024-06-06T08:28:56.298 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /var/tmp 2024-06-06T08:28:56.298 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /home 2024-06-06T08:28:56.298 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /root 2024-06-06T08:28:56.298 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /tmp 2024-06-06T08:28:56.298 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:28:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T08:28:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T08:28:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T08:28:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-06T08:28:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T08:28:56.530 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T08:28:56.582 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-06T08:28:56.582 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:56.582 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-06T08:28:56.582 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:28:56.797 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-06T08:28:56.838 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-06T08:28:56.879 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-06T08:28:56.911 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-06T08:28:56.938 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-06T08:28:57.130 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-06T08:28:57.175 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-06T08:28:57.208 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-06T08:28:57.257 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-06T08:28:57.286 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-06T08:28:57.349 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T08:28:57.920 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T08:28:57.955 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T08:28:57.976 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T08:28:58.272 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T08:28:58.358 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-06T08:28:58.358 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:58.358 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-06T08:28:58.358 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T08:28:58.358 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T08:28:58.358 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:28:58.623 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T08:28:58.694 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-06T08:28:58.695 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:58.695 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-06T08:28:58.695 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T08:28:58.695 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T08:28:58.695 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:28:58.878 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-06T08:28:58.976 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-06T08:28:59.018 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-06T08:28:59.101 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-06T08:28:59.128 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-06T08:28:59.162 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T08:28:59.187 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-06T08:28:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-06T08:28:59.214 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T08:28:59.215 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T08:28:59.286 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-06T08:28:59.286 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:28:59.286 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-06T08:28:59.286 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T08:28:59.287 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T08:28:59.287 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:28:59.298 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T08:28:59.331 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-06T08:28:59.331 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T08:28:59.399 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T08:28:59.423 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-06T08:28:59.425 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-06T08:28:59.429 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T08:28:59.429 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T08:28:59.488 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-06T08:28:59.565 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-06T08:28:59.648 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T08:28:59.648 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T08:28:59.701 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T08:28:59.733 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-06T08:28:59.800 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T08:28:59.821 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-06T08:28:59.880 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-06T08:28:59.980 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-06T08:29:00.102 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-06T08:29:00.292 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-06T08:29:00.358 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-06T08:29:00.408 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-06T08:29:00.456 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-06T08:29:01.111 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T08:29:01.151 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-06T08:29:01.198 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-06T08:29:01.302 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-06T08:29:01.335 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T08:29:01.896 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T08:29:01.896 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-06T08:29:01.896 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-06T08:29:01.896 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-06T08:29:01.896 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-06T08:29:01.896 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-06T08:29:01.896 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-06T08:29:01.896 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-06T08:29:01.897 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-06T08:29:01.898 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-06T08:29:01.898 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-06T08:29:01.898 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-06T08:29:01.898 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-06T08:29:01.898 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-06T08:29:01.898 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-06T08:29:01.898 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-06T08:29:01.911 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-06T08:29:01.911 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-06T08:29:01.911 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-06T08:29:01.912 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-06T08:29:01.912 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-06T08:29:01.912 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-06T08:29:01.912 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-06T08:29:01.912 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-06T08:29:01.912 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-06T08:29:01.912 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-06T08:29:01.912 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-06T08:29:01.912 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-06T08:29:01.912 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-06T08:29:01.912 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-06T08:29:01.913 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-06T08:29:01.914 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-06T08:29:01.915 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-06T08:29:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-06T08:29:01.917 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-06T08:29:01.918 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-06T08:29:01.918 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-06T08:29:01.918 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-06T08:29:01.918 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-06T08:29:01.918 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-06T08:29:01.918 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-06T08:29:01.918 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-06T08:29:01.918 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-06T08:29:01.918 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-06T08:29:01.918 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-06T08:29:01.919 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-06T08:29:01.919 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-06T08:29:01.919 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-06T08:29:01.919 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-06T08:29:01.919 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-06T08:29:01.919 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-06T08:29:01.919 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-06T08:29:01.919 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-06T08:29:01.919 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-06T08:29:01.920 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-06T08:29:01.921 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-06T08:29:01.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-06T08:29:01.923 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-06T08:29:02.695 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-06T08:29:02.761 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T08:29:03.933 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-06T08:29:03.962 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T08:29:04.116 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-06T08:29:04.303 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-06T08:29:04.330 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T08:29:04.417 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-06T08:29:04.417 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:29:04.417 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-06T08:29:04.417 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T08:29:04.418 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T08:29:04.418 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:29:04.481 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T08:29:04.521 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-06T08:29:04.636 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-06T08:29:04.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-06T08:29:04.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:29:04.668 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-06-06T08:29:04.668 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:04.668 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2024-06-06T08:29:04.669 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2024-06-06T08:29:04.670 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-06T08:29:04.670 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.670 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.670 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.670 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.670 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:04.670 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.670 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.670 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.670 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:04.670 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.671 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-06T08:29:04.672 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-06T08:29:04.673 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.14-1.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-06T08:29:04.674 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-06T08:29:04.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-06T08:29:04.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-06T08:29:04.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.678 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-06T08:29:04.679 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-3.el9.x86_64 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-06T08:29:04.680 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-06T08:29:04.681 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-06T08:29:04.681 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-06-06T08:29:04.681 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-06-06T08:29:04.718 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-06T08:29:05.117 DEBUG:teuthology.parallel:result is None 2024-06-06T08:29:05.120 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T08:29:05.120 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-06T08:29:05.120 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-06T08:29:05.120 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-06T08:29:05.120 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-06T08:29:05.120 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-06T08:29:05.120 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-06T08:29:05.121 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-06T08:29:05.121 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T08:29:05.121 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T08:29:05.121 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T08:29:05.121 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-06T08:29:05.121 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-06T08:29:05.121 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-06T08:29:05.121 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T08:29:05.121 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-06T08:29:05.121 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-06T08:29:05.121 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-06T08:29:05.122 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-06T08:29:05.122 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-06T08:29:05.122 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-06T08:29:05.122 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-06T08:29:05.122 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-06T08:29:05.122 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-06T08:29:05.122 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-06T08:29:05.122 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-06T08:29:05.122 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-06T08:29:05.122 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-06T08:29:05.135 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-06T08:29:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-06T08:29:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-06T08:29:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-06T08:29:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-06T08:29:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-06T08:29:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-06T08:29:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-06T08:29:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-06T08:29:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-06T08:29:05.136 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-06T08:29:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-06T08:29:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-06T08:29:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-06T08:29:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-06T08:29:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-06T08:29:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-06T08:29:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-06T08:29:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-06T08:29:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-06T08:29:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-06T08:29:05.137 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-06T08:29:05.138 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-06T08:29:05.139 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-06T08:29:05.140 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-06T08:29:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-06T08:29:05.142 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-06T08:29:05.143 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-06T08:29:05.144 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-06T08:29:05.145 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-06T08:29:05.146 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-06T08:29:05.146 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-06T08:29:05.146 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-06T08:29:05.146 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-06T08:29:05.146 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-06T08:29:05.146 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-06T08:29:05.146 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-06T08:29:05.757 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-06T08:29:05.792 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T08:29:05.864 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-06T08:29:05.864 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:29:05.864 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-06T08:29:05.864 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T08:29:05.864 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T08:29:05.864 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:29:05.918 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T08:29:05.991 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-06T08:29:05.991 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:29:05.991 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-06T08:29:05.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:29:06.068 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T08:29:06.150 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-06T08:29:06.151 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:29:06.151 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-06T08:29:06.151 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T08:29:06.151 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T08:29:06.151 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:29:06.560 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T08:29:06.637 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-06T08:29:06.638 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T08:29:06.638 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-06T08:29:06.638 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T08:29:06.638 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T08:29:06.638 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:29:07.868 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-06T08:29:07.868 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-06T08:29:07.869 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: automake-1.16.2-8.el9.noarch 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.7.4-5.el9.x86_64 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.870 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:07.871 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.4-9.el9.x86_64 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-06T08:29:07.872 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.873 INFO:teuthology.orchestra.run.smithi059.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-06T08:29:07.874 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-06T08:29:07.874 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-06T08:29:07.874 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-06T08:29:07.874 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-06T08:29:07.874 INFO:teuthology.orchestra.run.smithi059.stdout: lua-5.4.4-4.el9.x86_64 2024-06-06T08:29:07.874 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-06T08:29:07.874 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-06T08:29:07.874 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-06T08:29:07.874 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-13.14-1.el9.x86_64 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-06T08:29:07.875 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-06T08:29:07.876 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-06T08:29:07.877 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-06T08:29:07.878 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-06T08:29:07.878 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-06T08:29:07.878 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-06T08:29:07.878 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-06T08:29:07.878 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-06T08:29:07.878 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-06T08:29:07.878 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-06T08:29:07.878 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply-3.11-14.el9.noarch 2024-06-06T08:29:07.879 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-06T08:29:07.879 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-06T08:29:07.879 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-06T08:29:07.879 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-06T08:29:07.879 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-06T08:29:07.879 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-06T08:29:07.879 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-06T08:29:07.879 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-06T08:29:07.879 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-06T08:29:07.879 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-06T08:29:07.880 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: re2-1:20211101-3.el9.x86_64 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-06T08:29:07.881 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-06T08:29:07.882 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-06T08:29:07.882 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-06T08:29:07.882 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:29:07.882 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-06-06T08:29:08.312 DEBUG:teuthology.parallel:result is None 2024-06-06T08:29:11.857 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-06T08:29:11.912 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-06T08:29:12.001 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-06T08:29:12.042 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-06T08:29:12.081 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-06T08:29:12.382 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-06T08:29:12.436 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-06T08:29:12.470 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-06T08:29:12.508 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-06T08:29:12.556 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-06T08:29:12.610 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T08:29:13.536 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T08:29:13.581 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T08:29:13.640 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T08:29:15.050 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-06T08:29:15.170 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-06T08:29:15.233 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-06T08:29:15.383 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-06T08:29:15.439 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-06T08:29:15.471 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T08:29:15.507 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-06T08:29:15.550 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-06T08:29:15.550 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T08:29:15.731 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T08:29:15.785 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-06T08:29:15.785 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T08:29:15.922 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T08:29:15.960 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-06T08:29:15.997 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T08:29:15.997 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T08:29:16.357 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T08:29:16.357 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T08:29:16.502 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T08:29:16.547 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-06T08:29:16.689 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T08:29:16.967 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T08:29:16.967 INFO:teuthology.orchestra.run.smithi028.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-06-06T08:29:16.967 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:29:22.430 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-06T08:29:22.430 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-06T08:29:22.430 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-06T08:29:22.430 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-06T08:29:22.430 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-06T08:29:22.430 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-06T08:29:22.430 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-06T08:29:22.430 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-06T08:29:22.430 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-06T08:29:22.430 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-06T08:29:22.431 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-06T08:29:22.432 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-06T08:29:22.432 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-06T08:29:22.432 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-06T08:29:22.432 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-06T08:29:22.432 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-06T08:29:22.432 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-06T08:29:22.432 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-06T08:29:22.432 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-06T08:29:22.432 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-06T08:29:22.444 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-06T08:29:22.444 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-06T08:29:22.445 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-06T08:29:22.445 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-06T08:29:22.445 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-06T08:29:22.445 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-06T08:29:22.445 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-06T08:29:22.445 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-06T08:29:22.445 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-06T08:29:22.445 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-06T08:29:22.445 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-06T08:29:22.445 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-06T08:29:22.445 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-06T08:29:22.446 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-06T08:29:22.447 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-06T08:29:22.447 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-06T08:29:22.447 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-06T08:29:22.447 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-06T08:29:22.447 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-06T08:29:22.447 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-06T08:29:22.447 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-06T08:29:22.447 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-06T08:29:22.447 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-06T08:29:22.447 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-06T08:29:22.447 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-06T08:29:22.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-06T08:29:22.449 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-06T08:29:22.450 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-06T08:29:22.451 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-06T08:29:22.452 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-06T08:29:22.453 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-06T08:29:22.453 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-06T08:29:22.453 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-06T08:29:22.453 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-06T08:29:22.453 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-06T08:29:22.453 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-06T08:29:22.453 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-06T08:29:22.453 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-06T08:29:22.453 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-06T08:29:22.453 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-06T08:29:22.453 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-06T08:29:22.454 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-06T08:29:22.454 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-06T08:29:22.454 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-06T08:29:22.454 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-06T08:29:22.454 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-06T08:29:22.454 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-06T08:29:22.454 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-06T08:29:22.454 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-06T08:29:22.454 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-06T08:29:22.454 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T08:29:22.454 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-06T08:29:22.455 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-06T08:29:22.456 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-06T08:29:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-06T08:29:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:29:24.805 INFO:teuthology.orchestra.run.smithi028.stdout:Upgraded: 2024-06-06T08:29:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-06T08:29:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-06T08:29:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-06T08:29:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-06T08:29:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: automake-1.16.2-8.el9.noarch 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: bison-3.7.4-5.el9.x86_64 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: flex-2.6.4-9.el9.x86_64 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-06T08:29:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: lua-5.4.4-4.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-13.14-1.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-06T08:29:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-06T08:29:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-06T08:29:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-06T08:29:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ply-3.11-14.el9.noarch 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-06T08:29:24.818 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-06T08:29:24.819 INFO:teuthology.orchestra.run.smithi028.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: re2-1:20211101-3.el9.x86_64 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-06T08:29:24.820 INFO:teuthology.orchestra.run.smithi028.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-06T08:29:24.821 INFO:teuthology.orchestra.run.smithi028.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-06T08:29:24.821 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:29:24.821 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-06-06T08:29:25.446 DEBUG:teuthology.parallel:result is None 2024-06-06T08:29:25.447 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:29:25.604 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-06T08:29:25.658 INFO:teuthology.orchestra.run.smithi028.stdout:19.0.0-2946.g3d89accf.el9 2024-06-06T08:29:25.659 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-06T08:29:25.659 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-06T08:29:25.661 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:29:25.887 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-06T08:29:25.914 INFO:teuthology.orchestra.run.smithi037.stdout:19.0.0-2946.g3d89accf.el9 2024-06-06T08:29:25.915 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-06T08:29:25.915 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-06T08:29:25.917 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:29:26.140 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-06T08:29:26.167 INFO:teuthology.orchestra.run.smithi059.stdout:19.0.0-2946.g3d89accf.el9 2024-06-06T08:29:26.167 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-06T08:29:26.167 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-06T08:29:26.169 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-06T08:29:26.169 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:29:26.169 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-06T08:29:26.240 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-06-06T08:29:26.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-06T08:29:26.272 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-06-06T08:29:26.272 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-06T08:29:26.304 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-06T08:29:26.304 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:29:26.304 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/daemon-helper 2024-06-06T08:29:26.369 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-06T08:29:26.473 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-06-06T08:29:26.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-06-06T08:29:26.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-06T08:29:26.571 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-06-06T08:29:26.572 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-06-06T08:29:26.602 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-06T08:29:26.673 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-06T08:29:26.673 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:29:26.673 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-06T08:29:26.744 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-06T08:29:26.854 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-06-06T08:29:26.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-06T08:29:26.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-06T08:29:26.945 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-06-06T08:29:26.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-06T08:29:26.970 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-06T08:29:27.037 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-06T08:29:27.038 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:29:27.038 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/stdin-killer 2024-06-06T08:29:27.101 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-06T08:29:27.207 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-06-06T08:29:27.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-06-06T08:29:27.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-06T08:29:27.296 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-06-06T08:29:27.296 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-06-06T08:29:27.320 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-06T08:29:27.384 INFO:teuthology.run_tasks:Running task cephadm... 2024-06-06T08:29:27.478 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-06-06T08:29:27.478 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:29:27.479 INFO:tasks.cephadm:Cluster fsid is e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:29:27.479 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-06-06T08:29:27.479 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.28', 'mon.b': '172.21.15.37', 'mon.c': '172.21.15.59'} 2024-06-06T08:29:27.479 INFO:tasks.cephadm:First mon is mon.a on smithi028 2024-06-06T08:29:27.479 INFO:tasks.cephadm:First mgr is x 2024-06-06T08:29:27.479 INFO:tasks.cephadm:Normalizing hostnames... 2024-06-06T08:29:27.480 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname $(hostname -s) 2024-06-06T08:29:27.557 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2024-06-06T08:29:27.581 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname $(hostname -s) 2024-06-06T08:29:27.605 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-06-06T08:29:27.605 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:29:27.748 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55273/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2946-g3d89accf', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2946.g3d89accf'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-30 17:04:17.570799', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-06-06T08:29:27.887 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 3d89accfe3201286f000e065a1faea2a88c7a6ba from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:29:27.889 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm 2024-06-06T08:29:27.889 DEBUG:teuthology.orchestra.run.smithi028:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-06T08:29:28.313 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 6 08:29 /home/ubuntu/cephtest/cephadm 2024-06-06T08:29:28.313 DEBUG:teuthology.orchestra.run.smithi037:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-06T08:29:28.696 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 6 08:29 /home/ubuntu/cephtest/cephadm 2024-06-06T08:29:28.697 DEBUG:teuthology.orchestra.run.smithi059:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-06T08:29:29.067 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 6 08:29 /home/ubuntu/cephtest/cephadm 2024-06-06T08:29:29.067 DEBUG:teuthology.orchestra.run.smithi028:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-06T08:29:29.114 DEBUG:teuthology.orchestra.run.smithi037:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-06T08:29:29.134 DEBUG:teuthology.orchestra.run.smithi059:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-06T08:29:29.169 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba on all hosts... 2024-06-06T08:29:29.170 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-06T08:29:29.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-06T08:29:29.177 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-06T08:29:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-06T08:29:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-06T08:29:30.619 INFO:teuthology.orchestra.run.smithi028.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-06T08:30:03.363 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-06-06T08:30:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-06T08:30:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-06T08:30:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "repo_digests": [ 2024-06-06T08:30:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-06T08:30:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-06-06T08:30:03.364 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-06-06T08:30:08.901 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-06-06T08:30:08.901 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-06T08:30:08.901 INFO:teuthology.orchestra.run.smithi059.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-06T08:30:08.901 INFO:teuthology.orchestra.run.smithi059.stdout: "repo_digests": [ 2024-06-06T08:30:08.901 INFO:teuthology.orchestra.run.smithi059.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-06T08:30:08.901 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-06-06T08:30:08.901 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-06-06T08:30:09.728 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:30:09.729 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-06T08:30:09.729 INFO:teuthology.orchestra.run.smithi028.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-06T08:30:09.729 INFO:teuthology.orchestra.run.smithi028.stdout: "repo_digests": [ 2024-06-06T08:30:09.729 INFO:teuthology.orchestra.run.smithi028.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-06T08:30:09.729 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-06-06T08:30:09.729 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:30:09.793 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /etc/ceph 2024-06-06T08:30:09.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2024-06-06T08:30:09.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph 2024-06-06T08:30:09.934 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 777 /etc/ceph 2024-06-06T08:30:10.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /etc/ceph 2024-06-06T08:30:10.041 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /etc/ceph 2024-06-06T08:30:10.071 INFO:tasks.cephadm:Writing seed config... 2024-06-06T08:30:10.072 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-06-06T08:30:10.072 INFO:tasks.cephadm: override: [client] debug client = 20 2024-06-06T08:30:10.072 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-06-06T08:30:10.072 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-06-06T08:30:10.072 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-06-06T08:30:10.072 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-06-06T08:30:10.072 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-06-06T08:30:10.072 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-06-06T08:30:10.073 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-06-06T08:30:10.073 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-06-06T08:30:10.073 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-06-06T08:30:10.073 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-06-06T08:30:10.073 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-06-06T08:30:10.073 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-06-06T08:30:10.073 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-06-06T08:30:10.073 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-06-06T08:30:10.073 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-06-06T08:30:10.073 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-06-06T08:30:10.073 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-06-06T08:30:10.074 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-06-06T08:30:10.075 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-06-06T08:30:10.076 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:30:10.076 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-06-06T08:30:10.128 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e34a6934-23de-11ef-bc9b-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-06-06T08:30:10.128 DEBUG:teuthology.orchestra.run.smithi028:mon.a> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.a.service 2024-06-06T08:30:10.174 DEBUG:teuthology.orchestra.run.smithi028:mgr.x> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.x.service 2024-06-06T08:30:10.219 INFO:tasks.cephadm:Bootstrapping... 2024-06-06T08:30:10.219 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba -v bootstrap --fsid e34a6934-23de-11ef-bc9b-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.28 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-06-06T08:30:10.495 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-06-06T08:30:10.495 INFO:teuthology.orchestra.run.smithi028.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba', '-v', 'bootstrap', '--fsid', 'e34a6934-23de-11ef-bc9b-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.28', '--skip-admin-label'] 2024-06-06T08:30:10.495 INFO:teuthology.orchestra.run.smithi028.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-06-06T08:30:10.496 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying podman|docker is present... 2024-06-06T08:30:10.554 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stdout 5.0.2 2024-06-06T08:30:10.554 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying lvm2 is present... 2024-06-06T08:30:10.555 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying time synchronization is in place... 2024-06-06T08:30:10.569 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-06T08:30:10.569 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-06T08:30:10.582 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-06T08:30:10.582 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-06-06T08:30:10.597 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout enabled 2024-06-06T08:30:10.610 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout active 2024-06-06T08:30:10.610 INFO:teuthology.orchestra.run.smithi028.stdout:Unit chronyd.service is enabled and running 2024-06-06T08:30:10.610 INFO:teuthology.orchestra.run.smithi028.stdout:Repeating the final host check... 2024-06-06T08:30:10.664 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stdout 5.0.2 2024-06-06T08:30:10.664 INFO:teuthology.orchestra.run.smithi028.stdout:podman (/bin/podman) version 5.0.2 is present 2024-06-06T08:30:10.664 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl is present 2024-06-06T08:30:10.664 INFO:teuthology.orchestra.run.smithi028.stdout:lvcreate is present 2024-06-06T08:30:10.679 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-06T08:30:10.679 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-06T08:30:10.697 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-06T08:30:10.698 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-06-06T08:30:10.719 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout enabled 2024-06-06T08:30:10.736 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout active 2024-06-06T08:30:10.737 INFO:teuthology.orchestra.run.smithi028.stdout:Unit chronyd.service is enabled and running 2024-06-06T08:30:10.737 INFO:teuthology.orchestra.run.smithi028.stdout:Host looks OK 2024-06-06T08:30:10.737 INFO:teuthology.orchestra.run.smithi028.stdout:Cluster fsid: e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:30:10.737 INFO:teuthology.orchestra.run.smithi028.stdout:Acquiring lock 140227938416000 on /run/cephadm/e34a6934-23de-11ef-bc9b-c7b262605968.lock 2024-06-06T08:30:10.737 INFO:teuthology.orchestra.run.smithi028.stdout:Lock 140227938416000 acquired on /run/cephadm/e34a6934-23de-11ef-bc9b-c7b262605968.lock 2024-06-06T08:30:10.738 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying IP 172.21.15.28 port 3300 ... 2024-06-06T08:30:10.738 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying IP 172.21.15.28 port 6789 ... 2024-06-06T08:30:10.738 INFO:teuthology.orchestra.run.smithi028.stdout:Base mon IP(s) is [172.21.15.28:3300, 172.21.15.28:6789], mon addrv is [v2:172.21.15.28:3300,v1:172.21.15.28:6789] 2024-06-06T08:30:10.747 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.28 metric 100 2024-06-06T08:30:10.747 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.28 metric 100 2024-06-06T08:30:10.755 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-06-06T08:30:10.755 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-06-06T08:30:10.755 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-06-06T08:30:10.762 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-06-06T08:30:10.762 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-06-06T08:30:10.762 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-06T08:30:10.763 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-06-06T08:30:10.763 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link noprefixroute 2024-06-06T08:30:10.763 INFO:teuthology.orchestra.run.smithi028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-06T08:30:10.763 INFO:teuthology.orchestra.run.smithi028.stdout:Mon IP `172.21.15.28` is in CIDR network `172.21.0.0/20` 2024-06-06T08:30:10.764 INFO:teuthology.orchestra.run.smithi028.stdout:Mon IP `172.21.15.28` is in CIDR network `172.21.0.0/20` 2024-06-06T08:30:10.764 INFO:teuthology.orchestra.run.smithi028.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-06-06T08:30:10.765 INFO:teuthology.orchestra.run.smithi028.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-06-06T08:30:10.766 INFO:teuthology.orchestra.run.smithi028.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-06T08:30:11.358 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stdout b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-06T08:30:11.359 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-06T08:30:11.359 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Getting image source signatures 2024-06-06T08:30:11.359 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Copying blob sha256:3ca969c7b6d79946c6f10490fffc00028babe7df67f50ed53c7bc209325e0612 2024-06-06T08:30:11.359 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Copying blob sha256:53b2d4191269e9d20972bfa652565296fad6514cf6a3d99f19db644875f67876 2024-06-06T08:30:11.359 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Copying config sha256:b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-06T08:30:11.359 INFO:teuthology.orchestra.run.smithi028.stdout:/bin/podman: stderr Writing manifest to image destination 2024-06-06T08:30:12.564 INFO:teuthology.orchestra.run.smithi028.stdout:ceph: stdout ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-06T08:30:12.564 INFO:teuthology.orchestra.run.smithi028.stdout:Ceph version: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-06T08:30:12.564 INFO:teuthology.orchestra.run.smithi028.stdout:Extracting ceph user uid/gid from container image... 2024-06-06T08:30:22.211 INFO:teuthology.orchestra.run.smithi028.stdout:stat: stdout 167 167 2024-06-06T08:30:22.211 INFO:teuthology.orchestra.run.smithi028.stdout:Creating initial keys... 2024-06-06T08:30:23.241 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph-authtool: stdout AQCec2FmF6NnKBAAGj31418z4vIraQgu+GFk8g== 2024-06-06T08:30:24.384 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph-authtool: stdout AQCfc2Fm1gMgLRAA5ups27B0dzg2PrdBzykDDw== 2024-06-06T08:30:25.514 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph-authtool: stdout AQCgc2Fm0wkgNBAA04/1ZwpK0M8QhIO4GJQ++w== 2024-06-06T08:30:25.517 INFO:teuthology.orchestra.run.smithi028.stdout:Creating initial monmap... 2024-06-06T08:30:27.487 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-06T08:30:27.488 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-06-06T08:30:27.488 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:30:27.488 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-06T08:30:27.488 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool for a [v2:172.21.15.28:3300,v1:172.21.15.28:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-06T08:30:27.488 INFO:teuthology.orchestra.run.smithi028.stdout:setting min_mon_release = quincy 2024-06-06T08:30:27.488 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: set fsid to e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:30:27.488 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-06T08:30:27.488 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:30:27.488 INFO:teuthology.orchestra.run.smithi028.stdout:Creating mon... 2024-06-06T08:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout:create mon.a on 2024-06-06T08:30:28.961 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-06-06T08:30:29.201 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-06-06T08:30:29.498 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e34a6934-23de-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-e34a6934-23de-11ef-bc9b-c7b262605968.target. 2024-06-06T08:30:29.498 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e34a6934-23de-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-e34a6934-23de-11ef-bc9b-c7b262605968.target. 2024-06-06T08:30:29.885 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.a 2024-06-06T08:30:29.886 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.a.service: Unit ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.a.service not loaded. 2024-06-06T08:30:30.178 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e34a6934-23de-11ef-bc9b-c7b262605968.target.wants/ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.a.service → /etc/systemd/system/ceph-e34a6934-23de-11ef-bc9b-c7b262605968@.service. 2024-06-06T08:30:30.903 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:30 smithi028 podman[31180]: 2024-06-06 08:30:30.642231607 +0000 UTC m=+0.167168041 container create 3111ab67416861ebe1ce603c69e7b1e83e9e980a6335815194ab143714f5c748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True) 2024-06-06T08:30:30.903 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:30 smithi028 podman[31180]: 2024-06-06 08:30:30.904079522 +0000 UTC m=+0.429016022 container init 3111ab67416861ebe1ce603c69e7b1e83e9e980a6335815194ab143714f5c748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, ceph=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:30:31.042 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T08:30:31.042 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout disabled 2024-06-06T08:30:31.059 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T08:30:31.059 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-06-06T08:30:31.059 INFO:teuthology.orchestra.run.smithi028.stdout:firewalld.service is not enabled 2024-06-06T08:30:31.060 INFO:teuthology.orchestra.run.smithi028.stdout:Not possible to enable service . firewalld.service is not available 2024-06-06T08:30:31.060 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mon to start... 2024-06-06T08:30:31.060 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mon... 2024-06-06T08:30:31.211 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:30 smithi028 podman[31180]: 2024-06-06 08:30:30.914720975 +0000 UTC m=+0.439657422 container start 3111ab67416861ebe1ce603c69e7b1e83e9e980a6335815194ab143714f5c748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-06T08:30:31.211 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:30 smithi028 ceph-mon[31199]: mkfs e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:30:31.211 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:30 smithi028 ceph-mon[31199]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-06T08:30:31.211 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:31 smithi028 bash[31180]: 3111ab67416861ebe1ce603c69e7b1e83e9e980a6335815194ab143714f5c748 2024-06-06T08:30:31.212 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:31 smithi028 systemd[1]: Started Ceph mon.a for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:30:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-06T08:30:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: monmap epoch 1 2024-06-06T08:30:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:30:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: last_changed 2024-06-06T08:30:26.024887+0000 2024-06-06T08:30:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: created 2024-06-06T08:30:26.024887+0000 2024-06-06T08:30:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: min_mon_release 19 (squid) 2024-06-06T08:30:32.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: election_strategy: 1 2024-06-06T08:30:32.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-06-06T08:30:32.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: fsmap 2024-06-06T08:30:32.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: osdmap e1: 0 total, 0 up, 0 in 2024-06-06T08:30:32.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: mgrmap e1: no daemons active 2024-06-06T08:30:32.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:32 smithi028 ceph-mon[31199]: from='client.? 172.21.15.28:0/3131785728' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-06-06T08:30:32.450 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout cluster: 2024-06-06T08:30:32.451 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout id: e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:30:32.452 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-06-06T08:30:32.452 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:32.452 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout services: 2024-06-06T08:30:32.453 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.780753s) 2024-06-06T08:30:32.453 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-06-06T08:30:32.453 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-06-06T08:30:32.453 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:32.453 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout data: 2024-06-06T08:30:32.453 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-06-06T08:30:32.453 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-06-06T08:30:32.459 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-06-06T08:30:32.459 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout pgs: 2024-06-06T08:30:32.459 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:32.459 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.677+0000 7f2256600700 1 Processor -- start 2024-06-06T08:30:32.460 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.677+0000 7f2256600700 1 -- start start 2024-06-06T08:30:32.460 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.677+0000 7f2256600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225010ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:32.460 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.677+0000 7f2256600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f225007c700 con 0x7f2250108920 2024-06-06T08:30:32.460 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.679+0000 7f224f400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225010ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:32.460 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.679+0000 7f224f400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225010ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46396/0 (socket says 172.21.15.28:46396) 2024-06-06T08:30:32.460 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.679+0000 7f224f400700 1 -- 172.21.15.28:0/3609552847 learned_addr learned my addr 172.21.15.28:0/3609552847 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:32.460 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.679+0000 7f224f400700 1 -- 172.21.15.28:0/3609552847 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225010b250 con 0x7f2250108920 2024-06-06T08:30:32.460 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.679+0000 7f224f400700 1 --2- 172.21.15.28:0/3609552847 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225010ad10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f22400098a0 tx=0x7f2240009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6cdc06cc1148f6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:32.460 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.680+0000 7f224ea00700 1 -- 172.21.15.28:0/3609552847 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2240004160 con 0x7f2250108920 2024-06-06T08:30:32.460 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.680+0000 7f224ea00700 1 -- 172.21.15.28:0/3609552847 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2240004300 con 0x7f2250108920 2024-06-06T08:30:32.461 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.680+0000 7f224ea00700 1 -- 172.21.15.28:0/3609552847 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22400036a0 con 0x7f2250108920 2024-06-06T08:30:32.461 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.680+0000 7f2256600700 1 -- 172.21.15.28:0/3609552847 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 msgr2=0x7f225010ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:32.461 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.680+0000 7f2256600700 1 --2- 172.21.15.28:0/3609552847 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225010ad10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f22400098a0 tx=0x7f2240009bb0 comp rx=0 tx=0).stop 2024-06-06T08:30:32.461 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.681+0000 7f2256600700 1 -- 172.21.15.28:0/3609552847 shutdown_connections 2024-06-06T08:30:32.461 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.681+0000 7f2256600700 1 --2- 172.21.15.28:0/3609552847 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225010ad10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:32.461 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.681+0000 7f2256600700 1 -- 172.21.15.28:0/3609552847 >> 172.21.15.28:0/3609552847 conn(0x7f22501023b0 msgr2=0x7f22501047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:32.461 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.681+0000 7f2256600700 1 -- 172.21.15.28:0/3609552847 shutdown_connections 2024-06-06T08:30:32.461 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.681+0000 7f2256600700 1 -- 172.21.15.28:0/3609552847 wait complete. 2024-06-06T08:30:32.461 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.682+0000 7f2256600700 1 Processor -- start 2024-06-06T08:30:32.461 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.682+0000 7f2256600700 1 -- start start 2024-06-06T08:30:32.461 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.683+0000 7f2256600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225019d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.683+0000 7f2256600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f225010b6c0 con 0x7f2250108920 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.683+0000 7f224f400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225019d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.683+0000 7f224f400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225019d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46398/0 (socket says 172.21.15.28:46398) 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.683+0000 7f224f400700 1 -- 172.21.15.28:0/3131785728 learned_addr learned my addr 172.21.15.28:0/3131785728 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.683+0000 7f224f400700 1 -- 172.21.15.28:0/3131785728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225019dc70 con 0x7f2250108920 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.684+0000 7f224f400700 1 --2- 172.21.15.28:0/3131785728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225019d730 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2240000c00 tx=0x7f2240004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.684+0000 7f224cc00700 1 -- 172.21.15.28:0/3131785728 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2240003db0 con 0x7f2250108920 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.684+0000 7f224cc00700 1 -- 172.21.15.28:0/3131785728 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2240011630 con 0x7f2250108920 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.684+0000 7f2256600700 1 -- 172.21.15.28:0/3131785728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225019df00 con 0x7f2250108920 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.684+0000 7f224cc00700 1 -- 172.21.15.28:0/3131785728 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2240011950 con 0x7f2250108920 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.684+0000 7f2256600700 1 -- 172.21.15.28:0/3131785728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22501a0bf0 con 0x7f2250108920 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.685+0000 7f224cc00700 1 -- 172.21.15.28:0/3131785728 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f224001a460 con 0x7f2250108920 2024-06-06T08:30:32.462 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.685+0000 7f224cc00700 1 -- 172.21.15.28:0/3131785728 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f224001b780 con 0x7f2250108920 2024-06-06T08:30:32.463 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.685+0000 7f2256600700 1 -- 172.21.15.28:0/3131785728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2250063af0 con 0x7f2250108920 2024-06-06T08:30:32.463 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.689+0000 7f224cc00700 1 -- 172.21.15.28:0/3131785728 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f224001b980 con 0x7f2250108920 2024-06-06T08:30:32.463 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.769+0000 7f2256600700 1 -- 172.21.15.28:0/3131785728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f225002def0 con 0x7f2250108920 2024-06-06T08:30:32.463 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.770+0000 7f224cc00700 1 -- 172.21.15.28:0/3131785728 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f224001bb60 con 0x7f2250108920 2024-06-06T08:30:32.463 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.772+0000 7f2256600700 1 -- 172.21.15.28:0/3131785728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 msgr2=0x7f225019d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:32.463 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.772+0000 7f2256600700 1 --2- 172.21.15.28:0/3131785728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225019d730 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2240000c00 tx=0x7f2240004750 comp rx=0 tx=0).stop 2024-06-06T08:30:32.463 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.772+0000 7f2256600700 1 -- 172.21.15.28:0/3131785728 shutdown_connections 2024-06-06T08:30:32.463 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.772+0000 7f2256600700 1 --2- 172.21.15.28:0/3131785728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2250108920 0x7f225019d730 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:32.463 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.772+0000 7f2256600700 1 -- 172.21.15.28:0/3131785728 >> 172.21.15.28:0/3131785728 conn(0x7f22501023b0 msgr2=0x7f2250103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:32.463 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.772+0000 7f2256600700 1 -- 172.21.15.28:0/3131785728 shutdown_connections 2024-06-06T08:30:32.463 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:31.772+0000 7f2256600700 1 -- 172.21.15.28:0/3131785728 wait complete. 2024-06-06T08:30:32.464 INFO:teuthology.orchestra.run.smithi028.stdout:mon is available 2024-06-06T08:30:32.464 INFO:teuthology.orchestra.run.smithi028.stdout:Assimilating anything we can from ceph.conf... 2024-06-06T08:30:33.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:33 smithi028 ceph-mon[31199]: from='client.? 172.21.15.28:0/1594369292' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-06T08:30:33.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:33 smithi028 ceph-mon[31199]: from='client.? 172.21.15.28:0/1594369292' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-06-06T08:30:33.845 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:33.845 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [global] 2024-06-06T08:30:33.845 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout fsid = e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:30:33.845 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.28:3300,v1:172.21.15.28:6789] 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [osd] 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-06T08:30:33.846 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.099+0000 7f0bbca00700 1 Processor -- start 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.100+0000 7f0bbca00700 1 -- start start 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.100+0000 7f0bbca00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb810a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.100+0000 7f0bbca00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb810aab0 con 0x7f0bb810a0c0 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.100+0000 7f0bb7400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb810a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.101+0000 7f0bb7400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb810a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46408/0 (socket says 172.21.15.28:46408) 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.101+0000 7f0bb7400700 1 -- 172.21.15.28:0/1382793541 learned_addr learned my addr 172.21.15.28:0/1382793541 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.101+0000 7f0bb7400700 1 -- 172.21.15.28:0/1382793541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb810ac30 con 0x7f0bb810a0c0 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.101+0000 7f0bb7400700 1 --2- 172.21.15.28:0/1382793541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb810a4e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80098a0 tx=0x7f0ba8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7afa04757ff2fc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.101+0000 7f0bb6a00700 1 -- 172.21.15.28:0/1382793541 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba8004160 con 0x7f0bb810a0c0 2024-06-06T08:30:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.102+0000 7f0bb6a00700 1 -- 172.21.15.28:0/1382793541 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba8004300 con 0x7f0bb810a0c0 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.102+0000 7f0bb6a00700 1 -- 172.21.15.28:0/1382793541 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba80036a0 con 0x7f0bb810a0c0 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.102+0000 7f0bbca00700 1 -- 172.21.15.28:0/1382793541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 msgr2=0x7f0bb810a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.102+0000 7f0bbca00700 1 --2- 172.21.15.28:0/1382793541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb810a4e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80098a0 tx=0x7f0ba8009bb0 comp rx=0 tx=0).stop 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.102+0000 7f0bbca00700 1 -- 172.21.15.28:0/1382793541 shutdown_connections 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.102+0000 7f0bbca00700 1 --2- 172.21.15.28:0/1382793541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb810a4e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.102+0000 7f0bbca00700 1 -- 172.21.15.28:0/1382793541 >> 172.21.15.28:0/1382793541 conn(0x7f0bb807d2f0 msgr2=0x7f0bb807d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.102+0000 7f0bbca00700 1 -- 172.21.15.28:0/1382793541 shutdown_connections 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.102+0000 7f0bbca00700 1 -- 172.21.15.28:0/1382793541 wait complete. 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.103+0000 7f0bbca00700 1 Processor -- start 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.104+0000 7f0bbca00700 1 -- start start 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.104+0000 7f0bbca00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb819d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.104+0000 7f0bbca00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb810b3e0 con 0x7f0bb810a0c0 2024-06-06T08:30:33.848 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.104+0000 7f0bb7400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb819d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.104+0000 7f0bb7400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb819d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46418/0 (socket says 172.21.15.28:46418) 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.104+0000 7f0bb7400700 1 -- 172.21.15.28:0/1594369292 learned_addr learned my addr 172.21.15.28:0/1594369292 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.104+0000 7f0bb7400700 1 -- 172.21.15.28:0/1594369292 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb819da60 con 0x7f0bb810a0c0 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.105+0000 7f0bb7400700 1 --2- 172.21.15.28:0/1594369292 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb819d520 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8000c00 tx=0x7f0ba8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.105+0000 7f0bb4c00700 1 -- 172.21.15.28:0/1594369292 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba8003db0 con 0x7f0bb810a0c0 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.105+0000 7f0bb4c00700 1 -- 172.21.15.28:0/1594369292 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba8011630 con 0x7f0bb810a0c0 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.105+0000 7f0bb4c00700 1 -- 172.21.15.28:0/1594369292 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba8011950 con 0x7f0bb810a0c0 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.105+0000 7f0bbca00700 1 -- 172.21.15.28:0/1594369292 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb819dcf0 con 0x7f0bb810a0c0 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.105+0000 7f0bbca00700 1 -- 172.21.15.28:0/1594369292 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb81a09e0 con 0x7f0bb810a0c0 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.106+0000 7f0bb4c00700 1 -- 172.21.15.28:0/1594369292 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0ba8011af0 con 0x7f0bb810a0c0 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.106+0000 7f0bb4c00700 1 -- 172.21.15.28:0/1594369292 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0ba801c450 con 0x7f0bb810a0c0 2024-06-06T08:30:33.849 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.107+0000 7f0bbca00700 1 -- 172.21.15.28:0/1594369292 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb8063af0 con 0x7f0bb810a0c0 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.110+0000 7f0bb4c00700 1 -- 172.21.15.28:0/1594369292 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0ba8032020 con 0x7f0bb810a0c0 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.188+0000 7f0bbca00700 1 -- 172.21.15.28:0/1594369292 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f0bb802de20 con 0x7f0bb810a0c0 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.193+0000 7f0bb4c00700 1 -- 172.21.15.28:0/1594369292 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f0ba8004260 con 0x7f0bb810a0c0 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.194+0000 7f0bb4c00700 1 -- 172.21.15.28:0/1594369292 <== mon.0 v2:172.21.15.28:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ba801b450 con 0x7f0bb810a0c0 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.195+0000 7f0bbca00700 1 -- 172.21.15.28:0/1594369292 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 msgr2=0x7f0bb819d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.195+0000 7f0bbca00700 1 --2- 172.21.15.28:0/1594369292 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb819d520 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8000c00 tx=0x7f0ba8004750 comp rx=0 tx=0).stop 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.195+0000 7f0bbca00700 1 -- 172.21.15.28:0/1594369292 shutdown_connections 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.195+0000 7f0bbca00700 1 --2- 172.21.15.28:0/1594369292 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb810a0c0 0x7f0bb819d520 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.195+0000 7f0bbca00700 1 -- 172.21.15.28:0/1594369292 >> 172.21.15.28:0/1594369292 conn(0x7f0bb807d2f0 msgr2=0x7f0bb8194180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.195+0000 7f0bbca00700 1 -- 172.21.15.28:0/1594369292 shutdown_connections 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:33.195+0000 7f0bbca00700 1 -- 172.21.15.28:0/1594369292 wait complete. 2024-06-06T08:30:33.850 INFO:teuthology.orchestra.run.smithi028.stdout:Generating new minimal ceph.conf... 2024-06-06T08:30:34.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:34 smithi028 ceph-mon[31199]: from='client.? 172.21.15.28:0/67595048' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:30:35.129 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.435+0000 7fdba8a00700 1 Processor -- start 2024-06-06T08:30:35.129 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.435+0000 7fdba8a00700 1 -- start start 2024-06-06T08:30:35.129 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.436+0000 7fdba8a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba407c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:35.129 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.436+0000 7fdba8a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdba407c900 con 0x7fdba407ded0 2024-06-06T08:30:35.129 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.436+0000 7fdba2800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba407c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:35.130 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.436+0000 7fdba2800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba407c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46434/0 (socket says 172.21.15.28:46434) 2024-06-06T08:30:35.131 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.436+0000 7fdba2800700 1 -- 172.21.15.28:0/2181397231 learned_addr learned my addr 172.21.15.28:0/2181397231 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:35.131 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.437+0000 7fdba2800700 1 -- 172.21.15.28:0/2181397231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba407ca80 con 0x7fdba407ded0 2024-06-06T08:30:35.131 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.437+0000 7fdba2800700 1 --2- 172.21.15.28:0/2181397231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba407c330 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdb940098a0 tx=0x7fdb94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae1591395bb664 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:35.131 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.437+0000 7fdba1e00700 1 -- 172.21.15.28:0/2181397231 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb94004160 con 0x7fdba407ded0 2024-06-06T08:30:35.131 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.437+0000 7fdba1e00700 1 -- 172.21.15.28:0/2181397231 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb94004300 con 0x7fdba407ded0 2024-06-06T08:30:35.131 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.437+0000 7fdba1e00700 1 -- 172.21.15.28:0/2181397231 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb94011b50 con 0x7fdba407ded0 2024-06-06T08:30:35.131 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.438+0000 7fdba8a00700 1 -- 172.21.15.28:0/2181397231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 msgr2=0x7fdba407c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:35.131 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.438+0000 7fdba8a00700 1 --2- 172.21.15.28:0/2181397231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba407c330 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdb940098a0 tx=0x7fdb94009bb0 comp rx=0 tx=0).stop 2024-06-06T08:30:35.131 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.438+0000 7fdba8a00700 1 -- 172.21.15.28:0/2181397231 shutdown_connections 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.438+0000 7fdba8a00700 1 --2- 172.21.15.28:0/2181397231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba407c330 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.438+0000 7fdba8a00700 1 -- 172.21.15.28:0/2181397231 >> 172.21.15.28:0/2181397231 conn(0x7fdba41032f0 msgr2=0x7fdba4105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.439+0000 7fdba8a00700 1 -- 172.21.15.28:0/2181397231 shutdown_connections 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.439+0000 7fdba8a00700 1 -- 172.21.15.28:0/2181397231 wait complete. 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.440+0000 7fdba8a00700 1 Processor -- start 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.440+0000 7fdba8a00700 1 -- start start 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.440+0000 7fdba8a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba419de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.440+0000 7fdba8a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdba410e240 con 0x7fdba407ded0 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.440+0000 7fdba2800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba419de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.440+0000 7fdba2800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba419de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46440/0 (socket says 172.21.15.28:46440) 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.440+0000 7fdba2800700 1 -- 172.21.15.28:0/67595048 learned_addr learned my addr 172.21.15.28:0/67595048 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.441+0000 7fdba2800700 1 -- 172.21.15.28:0/67595048 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba419e3b0 con 0x7fdba407ded0 2024-06-06T08:30:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.441+0000 7fdba2800700 1 --2- 172.21.15.28:0/67595048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba419de70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdb94011850 tx=0x7fdb94011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:35.135 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.441+0000 7fdb9be00700 1 -- 172.21.15.28:0/67595048 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb94003af0 con 0x7fdba407ded0 2024-06-06T08:30:35.135 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.441+0000 7fdb9be00700 1 -- 172.21.15.28:0/67595048 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb94020070 con 0x7fdba407ded0 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.441+0000 7fdb9be00700 1 -- 172.21.15.28:0/67595048 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb940195a0 con 0x7fdba407ded0 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.441+0000 7fdba8a00700 1 -- 172.21.15.28:0/67595048 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba419e640 con 0x7fdba407ded0 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.442+0000 7fdba8a00700 1 -- 172.21.15.28:0/67595048 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba41a1330 con 0x7fdba407ded0 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.442+0000 7fdb9be00700 1 -- 172.21.15.28:0/67595048 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdb94019be0 con 0x7fdba407ded0 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.442+0000 7fdb9be00700 1 -- 172.21.15.28:0/67595048 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdb94011e00 con 0x7fdba407ded0 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.443+0000 7fdba8a00700 1 -- 172.21.15.28:0/67595048 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba4063af0 con 0x7fdba407ded0 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.446+0000 7fdb9be00700 1 -- 172.21.15.28:0/67595048 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fdb94003c90 con 0x7fdba407ded0 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.524+0000 7fdba8a00700 1 -- 172.21.15.28:0/67595048 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fdba41a1500 con 0x7fdba407ded0 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.525+0000 7fdb9be00700 1 -- 172.21.15.28:0/67595048 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fdb94025460 con 0x7fdba407ded0 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.526+0000 7fdba8a00700 1 -- 172.21.15.28:0/67595048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 msgr2=0x7fdba419de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.526+0000 7fdba8a00700 1 --2- 172.21.15.28:0/67595048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba419de70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdb94011850 tx=0x7fdb94011c10 comp rx=0 tx=0).stop 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.526+0000 7fdba8a00700 1 -- 172.21.15.28:0/67595048 shutdown_connections 2024-06-06T08:30:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.526+0000 7fdba8a00700 1 --2- 172.21.15.28:0/67595048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdba407ded0 0x7fdba419de70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:35.137 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.526+0000 7fdba8a00700 1 -- 172.21.15.28:0/67595048 >> 172.21.15.28:0/67595048 conn(0x7fdba41032f0 msgr2=0x7fdba4103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:35.137 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.526+0000 7fdba8a00700 1 -- 172.21.15.28:0/67595048 shutdown_connections 2024-06-06T08:30:35.137 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:34.526+0000 7fdba8a00700 1 -- 172.21.15.28:0/67595048 wait complete. 2024-06-06T08:30:35.137 INFO:teuthology.orchestra.run.smithi028.stdout:Restarting the monitor... 2024-06-06T08:30:35.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:35 smithi028 systemd[1]: Stopping Ceph mon.a for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:30:36.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:35 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a[31195]: 2024-06-06T08:30:35.663+0000 7f87e3400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:30:36.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:35 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a[31195]: 2024-06-06T08:30:35.663+0000 7f87e3400700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-06-06T08:30:36.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:35 smithi028 podman[31441]: 2024-06-06 08:30:35.808797744 +0000 UTC m=+0.268237653 container died 3111ab67416861ebe1ce603c69e7b1e83e9e980a6335815194ab143714f5c748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc) 2024-06-06T08:30:36.406 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:36 smithi028 podman[31441]: 2024-06-06 08:30:36.181371254 +0000 UTC m=+0.640811161 container cleanup 3111ab67416861ebe1ce603c69e7b1e83e9e980a6335815194ab143714f5c748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:30:36.406 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:36 smithi028 bash[31441]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a 2024-06-06T08:30:36.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:36 smithi028 podman[31453]: 2024-06-06 08:30:36.407029933 +0000 UTC m=+0.578842545 container remove 3111ab67416861ebe1ce603c69e7b1e83e9e980a6335815194ab143714f5c748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528) 2024-06-06T08:30:37.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:36 smithi028 systemd[1]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-06T08:30:37.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:36 smithi028 systemd[1]: Stopped Ceph mon.a for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:30:37.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:36 smithi028 systemd[1]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.a.service: Consumed 2.082s CPU time. 2024-06-06T08:30:37.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:36 smithi028 systemd[1]: Starting Ceph mon.a for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:30:37.623 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:37 smithi028 podman[31546]: 2024-06-06 08:30:37.238974142 +0000 UTC m=+0.037997573 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:30:37.952 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:37 smithi028 podman[31546]: 2024-06-06 08:30:37.624647805 +0000 UTC m=+0.423671273 container create 82bd645ae771c1ca54f0338e8dfca9a2da5b1dbac160f7fd4f67b05fefe09d21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-06T08:30:37.952 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:37 smithi028 podman[31546]: 2024-06-06 08:30:37.952902711 +0000 UTC m=+0.751926249 container init 82bd645ae771c1ca54f0338e8dfca9a2da5b1dbac160f7fd4f67b05fefe09d21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS) 2024-06-06T08:30:38.044 INFO:teuthology.orchestra.run.smithi028.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-06-06T08:30:38.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:37 smithi028 podman[31546]: 2024-06-06 08:30:37.96382115 +0000 UTC m=+0.762844593 container start 82bd645ae771c1ca54f0338e8dfca9a2da5b1dbac160f7fd4f67b05fefe09d21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-06-06T08:30:38.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: set uid:gid to 167:167 (ceph:ceph) 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: pidfile_write: ignore empty --pid-file 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: load: jerasure load: lrc 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: RocksDB version: 7.9.2 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Git sha 0 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: DB SUMMARY 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: DB Session ID: RQXEXRG2U3PNM2LROGHH 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: CURRENT file: CURRENT 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: IDENTITY file: IDENTITY 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-06-06T08:30:38.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104292 ; 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.error_if_exists: 0 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.create_if_missing: 0 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.paranoid_checks: 1 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.env: 0x55aa059bbc60 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.fs: PosixFileSystem 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.info_log: 0x55aa3648db60 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_file_opening_threads: 16 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.statistics: (nil) 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.use_fsync: 0 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_log_file_size: 0 2024-06-06T08:30:38.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-06T08:30:38.294 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-06T08:30:38.294 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.keep_log_file_num: 1000 2024-06-06T08:30:38.294 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.recycle_log_file_num: 0 2024-06-06T08:30:38.294 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.allow_fallocate: 1 2024-06-06T08:30:38.295 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.allow_mmap_reads: 0 2024-06-06T08:30:38.295 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.allow_mmap_writes: 0 2024-06-06T08:30:38.295 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.use_direct_reads: 0 2024-06-06T08:30:38.295 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-06T08:30:38.295 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.create_missing_column_families: 0 2024-06-06T08:30:38.295 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.db_log_dir: 2024-06-06T08:30:38.295 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.wal_dir: 2024-06-06T08:30:38.295 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-06T08:30:38.295 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-06T08:30:38.295 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.advise_random_on_open: 1 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.db_write_buffer_size: 0 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.write_buffer_manager: 0x55aa3645e1e0 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.rate_limiter: (nil) 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-06T08:30:38.296 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.wal_recovery_mode: 2 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.enable_thread_tracking: 0 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.enable_pipelined_write: 0 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.unordered_write: 0 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.row_cache: None 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.wal_filter: None 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.allow_ingest_behind: 0 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.two_write_queues: 0 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.manual_wal_flush: 0 2024-06-06T08:30:38.297 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.wal_compression: 0 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.atomic_flush: 0 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.log_readahead_size: 0 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.best_efforts_recovery: 0 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.allow_data_in_errors: 0 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.db_host_id: __hostname__ 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-06T08:30:38.298 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_background_jobs: 2 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_background_compactions: -1 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_subcompactions: 1 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_total_wal_size: 0 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_open_files: -1 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bytes_per_sync: 0 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-06T08:30:38.299 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_readahead_size: 0 2024-06-06T08:30:38.300 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_background_flushes: -1 2024-06-06T08:30:38.300 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Compression algorithms supported: 2024-06-06T08:30:38.300 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-06T08:30:38.300 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: kZSTD supported: 0 2024-06-06T08:30:38.300 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: kXpressCompression supported: 0 2024-06-06T08:30:38.300 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: kLZ4HCCompression supported: 1 2024-06-06T08:30:38.300 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: kZlibCompression supported: 1 2024-06-06T08:30:38.300 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: kSnappyCompression supported: 1 2024-06-06T08:30:38.300 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: kLZ4Compression supported: 1 2024-06-06T08:30:38.300 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: kBZip2Compression supported: 0 2024-06-06T08:30:38.300 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.merge_operator: 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_filter: None 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_filter_factory: None 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.sst_partitioner_factory: None 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55aa3648dc80) 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout: cache_index_and_filter_blocks: 1 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-06T08:30:38.301 INFO:journalctl@ceph.mon.a.smithi028.stdout: pin_top_level_index_and_filter: 1 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: index_type: 0 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: data_block_index_type: 0 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: index_shortening: 1 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: checksum: 4 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: no_block_cache: 0 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_cache: 0x55aa3648f090 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_cache_name: BinnedLRUCache 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_cache_options: 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: capacity : 536870912 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: num_shard_bits : 4 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: strict_capacity_limit : 0 2024-06-06T08:30:38.302 INFO:journalctl@ceph.mon.a.smithi028.stdout: high_pri_pool_ratio: 0.000 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_cache_compressed: (nil) 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: persistent_cache: (nil) 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_size: 4096 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_size_deviation: 10 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_restart_interval: 16 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: index_block_restart_interval: 1 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: metadata_block_size: 4096 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: partition_filters: 0 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: use_delta_encoding: 1 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: filter_policy: bloomfilter 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: whole_key_filtering: 1 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: verify_compression: 0 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: read_amp_bytes_per_bit: 0 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: format_version: 5 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: enable_index_compression: 1 2024-06-06T08:30:38.303 INFO:journalctl@ceph.mon.a.smithi028.stdout: block_align: 0 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout: max_auto_readahead_size: 262144 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout: prepopulate_block_cache: 0 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout: initial_auto_readahead_size: 8192 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout: num_file_reads_for_auto_readahead: 2 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.write_buffer_size: 33554432 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_write_buffer_number: 2 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compression: NoCompression 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bottommost_compression: Disabled 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.prefix_extractor: nullptr 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.num_levels: 7 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-06T08:30:38.304 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compression_opts.level: 32767 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compression_opts.strategy: 0 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-06T08:30:38.305 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compression_opts.enabled: false 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.target_file_size_base: 67108864 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-06T08:30:38.306 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-06T08:30:38.307 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-06T08:30:38.307 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-06T08:30:38.307 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-06T08:30:38.307 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-06T08:30:38.307 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.arena_block_size: 1048576 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.disable_auto_compactions: 0 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-06T08:30:38.308 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.table_properties_collectors: 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.inplace_update_support: 0 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.bloom_locality: 0 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.max_successive_merges: 0 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.paranoid_file_checks: 0 2024-06-06T08:30:38.309 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.force_consistency_checks: 1 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.report_bg_io_stats: 0 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.ttl: 2592000 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.enable_blob_files: false 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.min_blob_size: 0 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.blob_file_size: 268435456 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-06T08:30:38.310 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.blob_file_starting_level: 0 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c612b35d-03ad-4292-9e4a-de15f474fbeb 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717662638027568, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717662638029247, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99451, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97359, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14054, "raw_average_key_size": 49, "raw_value_size": 89733, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717662638, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c612b35d-03ad-4292-9e4a-de15f474fbeb", "db_session_id": "RQXEXRG2U3PNM2LROGHH", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717662638029411, "job": 1, "event": "recovery_finished"} 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-06-06T08:30:38.311 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-06T08:30:38.312 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55aa3657e000 2024-06-06T08:30:38.312 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: DB pointer 0x55aa36568000 2024-06-06T08:30:38.312 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-06T08:30:38.312 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-06T08:30:38.312 INFO:journalctl@ceph.mon.a.smithi028.stdout: ** DB Stats ** 2024-06-06T08:30:38.312 INFO:journalctl@ceph.mon.a.smithi028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T08:30:38.312 INFO:journalctl@ceph.mon.a.smithi028.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-06T08:30:38.312 INFO:journalctl@ceph.mon.a.smithi028.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: ** Compaction Stats [default] ** 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: L0 2/0 98.96 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: Sum 2/0 98.96 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-06-06T08:30:38.313 INFO:journalctl@ceph.mon.a.smithi028.stdout: ** Compaction Stats [default] ** 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 91.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: Cumulative compaction: 0.00 GB write, 13.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T08:30:38.314 INFO:journalctl@ceph.mon.a.smithi028.stdout: Interval compaction: 0.00 GB write, 13.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout: Block cache BinnedLRUCache@0x55aa3648f090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: starting mon.a rank 0 at public addrs [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] at bind addrs [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: mon.a@-1(???) e1 preinit fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 bash[31546]: 82bd645ae771c1ca54f0338e8dfca9a2da5b1dbac160f7fd4f67b05fefe09d21 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: mon.a@-1(???).mds e1 new map 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: mon.a@-1(???).mds e1 print_map 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout: e1 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T08:30:38.315 INFO:journalctl@ceph.mon.a.smithi028.stdout: legacy client fscid: -1 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout: 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout: No filesystems configured 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 systemd[1]: Started Ceph mon.a for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: monmap epoch 1 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: last_changed 2024-06-06T08:30:26.024887+0000 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: created 2024-06-06T08:30:26.024887+0000 2024-06-06T08:30:38.316 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: min_mon_release 19 (squid) 2024-06-06T08:30:38.317 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: election_strategy: 1 2024-06-06T08:30:38.317 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-06-06T08:30:38.317 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: fsmap 2024-06-06T08:30:38.317 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: osdmap e1: 0 total, 0 up, 0 in 2024-06-06T08:30:38.317 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:38 smithi028 ceph-mon[31564]: mgrmap e1: no daemons active 2024-06-06T08:30:39.400 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.644+0000 7f1958c00700 1 Processor -- start 2024-06-06T08:30:39.400 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.644+0000 7f1958c00700 1 -- start start 2024-06-06T08:30:39.400 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.645+0000 7f1958c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f1954108090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:39.400 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.645+0000 7f1958c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1954108660 con 0x7f1954107c70 2024-06-06T08:30:39.400 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.645+0000 7f1953400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f1954108090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:39.401 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.646+0000 7f1953400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f1954108090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36858/0 (socket says 172.21.15.28:36858) 2024-06-06T08:30:39.401 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.646+0000 7f1953400700 1 -- 172.21.15.28:0/2205197707 learned_addr learned my addr 172.21.15.28:0/2205197707 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:39.401 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.646+0000 7f1953400700 1 -- 172.21.15.28:0/2205197707 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1954108e70 con 0x7f1954107c70 2024-06-06T08:30:39.401 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.647+0000 7f1953400700 1 --2- 172.21.15.28:0/2205197707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f1954108090 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f19440098a0 tx=0x7f1944009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b0086901339922 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:39.401 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.647+0000 7f1952000700 1 -- 172.21.15.28:0/2205197707 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1944004160 con 0x7f1954107c70 2024-06-06T08:30:39.401 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.647+0000 7f1952000700 1 -- 172.21.15.28:0/2205197707 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1944004300 con 0x7f1954107c70 2024-06-06T08:30:39.401 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.647+0000 7f1952000700 1 -- 172.21.15.28:0/2205197707 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1944011b50 con 0x7f1954107c70 2024-06-06T08:30:39.401 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.648+0000 7f1958c00700 1 -- 172.21.15.28:0/2205197707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 msgr2=0x7f1954108090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:39.401 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.648+0000 7f1958c00700 1 --2- 172.21.15.28:0/2205197707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f1954108090 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f19440098a0 tx=0x7f1944009bb0 comp rx=0 tx=0).stop 2024-06-06T08:30:39.401 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.648+0000 7f1958c00700 1 -- 172.21.15.28:0/2205197707 shutdown_connections 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.648+0000 7f1958c00700 1 --2- 172.21.15.28:0/2205197707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f1954108090 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.648+0000 7f1958c00700 1 -- 172.21.15.28:0/2205197707 >> 172.21.15.28:0/2205197707 conn(0x7f1954103290 msgr2=0x7f19541056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.648+0000 7f1958c00700 1 -- 172.21.15.28:0/2205197707 shutdown_connections 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.648+0000 7f1958c00700 1 -- 172.21.15.28:0/2205197707 wait complete. 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.650+0000 7f1958c00700 1 Processor -- start 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.650+0000 7f1958c00700 1 -- start start 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.650+0000 7f1958c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f195407e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.650+0000 7f1958c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f195410c220 con 0x7f1954107c70 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.651+0000 7f1953400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f195407e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.651+0000 7f1953400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f195407e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36872/0 (socket says 172.21.15.28:36872) 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.651+0000 7f1953400700 1 -- 172.21.15.28:0/1819560450 learned_addr learned my addr 172.21.15.28:0/1819560450 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:39.402 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.651+0000 7f1953400700 1 -- 172.21.15.28:0/1819560450 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195407e950 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.651+0000 7f1953400700 1 --2- 172.21.15.28:0/1819560450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f195407e410 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1944011670 tx=0x7f1944011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.652+0000 7f194be00700 1 -- 172.21.15.28:0/1819560450 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19440039c0 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.652+0000 7f194be00700 1 -- 172.21.15.28:0/1819560450 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1944011e50 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.652+0000 7f1958c00700 1 -- 172.21.15.28:0/1819560450 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195407cb40 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.652+0000 7f194be00700 1 -- 172.21.15.28:0/1819560450 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194401a5c0 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.652+0000 7f1958c00700 1 -- 172.21.15.28:0/1819560450 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f195407d080 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.652+0000 7f194be00700 1 -- 172.21.15.28:0/1819560450 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f194401ac50 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.653+0000 7f194be00700 1 -- 172.21.15.28:0/1819560450 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1944019700 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.654+0000 7f1958c00700 1 -- 172.21.15.28:0/1819560450 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1954063af0 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.657+0000 7f194be00700 1 -- 172.21.15.28:0/1819560450 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1944003b60 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.756+0000 7f1958c00700 1 -- 172.21.15.28:0/1819560450 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f195407d5b0 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.760+0000 7f194be00700 1 -- 172.21.15.28:0/1819560450 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f1944019900 con 0x7f1954107c70 2024-06-06T08:30:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.762+0000 7f1958c00700 1 -- 172.21.15.28:0/1819560450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 msgr2=0x7f195407e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:39.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.762+0000 7f1958c00700 1 --2- 172.21.15.28:0/1819560450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f195407e410 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1944011670 tx=0x7f1944011b60 comp rx=0 tx=0).stop 2024-06-06T08:30:39.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.762+0000 7f1958c00700 1 -- 172.21.15.28:0/1819560450 shutdown_connections 2024-06-06T08:30:39.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.762+0000 7f1958c00700 1 --2- 172.21.15.28:0/1819560450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1954107c70 0x7f195407e410 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:39.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.762+0000 7f1958c00700 1 -- 172.21.15.28:0/1819560450 >> 172.21.15.28:0/1819560450 conn(0x7f1954103290 msgr2=0x7f1954103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:39.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.762+0000 7f1958c00700 1 -- 172.21.15.28:0/1819560450 shutdown_connections 2024-06-06T08:30:39.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:38.762+0000 7f1958c00700 1 -- 172.21.15.28:0/1819560450 wait complete. 2024-06-06T08:30:39.404 INFO:teuthology.orchestra.run.smithi028.stdout:Wrote config to /etc/ceph/ceph.conf 2024-06-06T08:30:39.422 INFO:teuthology.orchestra.run.smithi028.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-06-06T08:30:39.422 INFO:teuthology.orchestra.run.smithi028.stdout:Creating mgr... 2024-06-06T08:30:39.424 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying port 0.0.0.0:9283 ... 2024-06-06T08:30:39.425 INFO:teuthology.orchestra.run.smithi028.stdout:Verifying port 0.0.0.0:8765 ... 2024-06-06T08:30:39.863 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.x 2024-06-06T08:30:39.863 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.x.service: Unit ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.x.service not loaded. 2024-06-06T08:30:40.016 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:39 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1819560450' entity='client.admin' 2024-06-06T08:30:40.143 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e34a6934-23de-11ef-bc9b-c7b262605968.target.wants/ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-e34a6934-23de-11ef-bc9b-c7b262605968@.service. 2024-06-06T08:30:40.290 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:40 smithi028 systemd[1]: Starting Ceph mgr.x for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:30:40.868 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:40 smithi028 podman[31791]: 2024-06-06 08:30:40.456591403 +0000 UTC m=+0.031961041 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-06T08:30:40.868 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:40 smithi028 podman[31791]: 2024-06-06 08:30:40.559539071 +0000 UTC m=+0.134908732 container create 2b47e19df1583213a64690f111ce95a6cab353c2a1255b9ff85d15acae75f919 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:30:40.868 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:40 smithi028 podman[31791]: 2024-06-06 08:30:40.788002534 +0000 UTC m=+0.363372280 container init 2b47e19df1583213a64690f111ce95a6cab353c2a1255b9ff85d15acae75f919 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, ceph=True) 2024-06-06T08:30:40.869 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:40 smithi028 podman[31791]: 2024-06-06 08:30:40.798121313 +0000 UTC m=+0.373490986 container start 2b47e19df1583213a64690f111ce95a6cab353c2a1255b9ff85d15acae75f919 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-06T08:30:40.869 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:40 smithi028 bash[31791]: 2b47e19df1583213a64690f111ce95a6cab353c2a1255b9ff85d15acae75f919 2024-06-06T08:30:40.900 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T08:30:40.900 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout disabled 2024-06-06T08:30:40.917 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T08:30:40.918 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-06-06T08:30:40.918 INFO:teuthology.orchestra.run.smithi028.stdout:firewalld.service is not enabled 2024-06-06T08:30:40.918 INFO:teuthology.orchestra.run.smithi028.stdout:Not possible to enable service . firewalld.service is not available 2024-06-06T08:30:40.939 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T08:30:40.939 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout disabled 2024-06-06T08:30:40.957 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T08:30:40.957 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-06-06T08:30:40.957 INFO:teuthology.orchestra.run.smithi028.stdout:firewalld.service is not enabled 2024-06-06T08:30:40.957 INFO:teuthology.orchestra.run.smithi028.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-06-06T08:30:40.957 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mgr to start... 2024-06-06T08:30:40.957 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mgr... 2024-06-06T08:30:41.153 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:40 smithi028 systemd[1]: Started Ceph mgr.x for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:30:41.153 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:41 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:41.033+0000 7ff7a24cb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T08:30:41.423 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:41 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:41.289+0000 7ff7a24cb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T08:30:41.673 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:41 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:41.428+0000 7ff7a24cb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T08:30:41.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:41 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1087472820' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-06T08:30:41.993 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:41 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:41.870+0000 7ff7a24cb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T08:30:41.993 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:41 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:41.993+0000 7ff7a24cb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T08:30:42.361 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:42.363 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-06-06T08:30:42.363 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:30:42.363 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "health": { 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 0 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "a" 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-06-06T08:30:42.364 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-06T08:30:42.365 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:42.365 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-06T08:30:42.365 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-06T08:30:42.365 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:42.365 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-06T08:30:42.365 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:42.365 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-06T08:30:42.365 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-06T08:30:42.365 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-06T08:30:42.373 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-06T08:30:42.374 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "restful" 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modified": "2024-06-06T08:30:30.992087+0000", 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.582+0000 7fc81dc00700 1 Processor -- start 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.582+0000 7fc81dc00700 1 -- start start 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.583+0000 7fc81dc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81810ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:42.375 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.583+0000 7fc81dc00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc81807bec0 con 0x7fc818108750 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.583+0000 7fc817e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81810ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.583+0000 7fc817e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81810ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36906/0 (socket says 172.21.15.28:36906) 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.583+0000 7fc817e00700 1 -- 172.21.15.28:0/859858389 learned_addr learned my addr 172.21.15.28:0/859858389 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.584+0000 7fc817e00700 1 -- 172.21.15.28:0/859858389 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81810b080 con 0x7fc818108750 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.584+0000 7fc817e00700 1 --2- 172.21.15.28:0/859858389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81810ab40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc8080098a0 tx=0x7fc808009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109a02289b9fabe3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.584+0000 7fc816a00700 1 -- 172.21.15.28:0/859858389 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc808004160 con 0x7fc818108750 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.584+0000 7fc816a00700 1 -- 172.21.15.28:0/859858389 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc808004300 con 0x7fc818108750 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.584+0000 7fc816a00700 1 -- 172.21.15.28:0/859858389 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc808011b50 con 0x7fc818108750 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.585+0000 7fc81dc00700 1 -- 172.21.15.28:0/859858389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 msgr2=0x7fc81810ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.585+0000 7fc81dc00700 1 --2- 172.21.15.28:0/859858389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81810ab40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc8080098a0 tx=0x7fc808009bb0 comp rx=0 tx=0).stop 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.585+0000 7fc81dc00700 1 -- 172.21.15.28:0/859858389 shutdown_connections 2024-06-06T08:30:42.376 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.585+0000 7fc81dc00700 1 --2- 172.21.15.28:0/859858389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81810ab40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.585+0000 7fc81dc00700 1 -- 172.21.15.28:0/859858389 >> 172.21.15.28:0/859858389 conn(0x7fc8181021a0 msgr2=0x7fc8181045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.585+0000 7fc81dc00700 1 -- 172.21.15.28:0/859858389 shutdown_connections 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.585+0000 7fc81dc00700 1 -- 172.21.15.28:0/859858389 wait complete. 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.586+0000 7fc81dc00700 1 Processor -- start 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.587+0000 7fc81dc00700 1 -- start start 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.587+0000 7fc81dc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.587+0000 7fc81dc00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc81810c040 con 0x7fc818108750 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.587+0000 7fc817e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.587+0000 7fc817e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81819bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36912/0 (socket says 172.21.15.28:36912) 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.587+0000 7fc817e00700 1 -- 172.21.15.28:0/1087472820 learned_addr learned my addr 172.21.15.28:0/1087472820 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.588+0000 7fc817e00700 1 -- 172.21.15.28:0/1087472820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81819c1d0 con 0x7fc818108750 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.588+0000 7fc817e00700 1 --2- 172.21.15.28:0/1087472820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81819bc90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc808011b60 tx=0x7fc808011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.588+0000 7fc814c00700 1 -- 172.21.15.28:0/1087472820 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc808003970 con 0x7fc818108750 2024-06-06T08:30:42.377 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.588+0000 7fc814c00700 1 -- 172.21.15.28:0/1087472820 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc808003b10 con 0x7fc818108750 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.588+0000 7fc81dc00700 1 -- 172.21.15.28:0/1087472820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81819c460 con 0x7fc818108750 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.588+0000 7fc814c00700 1 -- 172.21.15.28:0/1087472820 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc808024610 con 0x7fc818108750 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.588+0000 7fc81dc00700 1 -- 172.21.15.28:0/1087472820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81819f150 con 0x7fc818108750 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.589+0000 7fc814c00700 1 -- 172.21.15.28:0/1087472820 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc808024c50 con 0x7fc818108750 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.589+0000 7fc814c00700 1 -- 172.21.15.28:0/1087472820 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc808011e00 con 0x7fc818108750 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.589+0000 7fc81dc00700 1 -- 172.21.15.28:0/1087472820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc818063af0 con 0x7fc818108750 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.592+0000 7fc814c00700 1 -- 172.21.15.28:0/1087472820 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc80801a9f0 con 0x7fc818108750 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.672+0000 7fc81dc00700 1 -- 172.21.15.28:0/1087472820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc81819f320 con 0x7fc818108750 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.673+0000 7fc814c00700 1 -- 172.21.15.28:0/1087472820 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fc80801a430 con 0x7fc818108750 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.674+0000 7fc81dc00700 1 -- 172.21.15.28:0/1087472820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 msgr2=0x7fc81819bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.674+0000 7fc81dc00700 1 --2- 172.21.15.28:0/1087472820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81819bc90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc808011b60 tx=0x7fc808011c40 comp rx=0 tx=0).stop 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.675+0000 7fc81dc00700 1 -- 172.21.15.28:0/1087472820 shutdown_connections 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.675+0000 7fc81dc00700 1 --2- 172.21.15.28:0/1087472820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc818108750 0x7fc81819bc90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:42.378 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.675+0000 7fc81dc00700 1 -- 172.21.15.28:0/1087472820 >> 172.21.15.28:0/1087472820 conn(0x7fc8181021a0 msgr2=0x7fc818102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:42.379 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.675+0000 7fc81dc00700 1 -- 172.21.15.28:0/1087472820 shutdown_connections 2024-06-06T08:30:42.379 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:41.675+0000 7fc81dc00700 1 -- 172.21.15.28:0/1087472820 wait complete. 2024-06-06T08:30:42.379 INFO:teuthology.orchestra.run.smithi028.stdout:mgr not available, waiting (1/15)... 2024-06-06T08:30:44.041 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:43 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:43.630+0000 7ff7a24cb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T08:30:44.041 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:43 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:43.862+0000 7ff7a24cb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T08:30:44.474 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:44.082+0000 7ff7a24cb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T08:30:44.791 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:44.475+0000 7ff7a24cb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T08:30:44.791 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:44.603+0000 7ff7a24cb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T08:30:45.083 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:44.865+0000 7ff7a24cb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T08:30:45.407 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:45 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1529724988' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-06T08:30:45.407 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:45 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:45.152+0000 7ff7a24cb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T08:30:45.751 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:45.751 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-06-06T08:30:45.751 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:30:45.752 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "health": { 2024-06-06T08:30:45.752 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-06T08:30:45.753 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-06T08:30:45.753 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-06T08:30:45.753 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:45.753 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-06T08:30:45.753 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-06T08:30:45.753 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 0 2024-06-06T08:30:45.753 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "a" 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-06T08:30:45.755 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-06T08:30:45.759 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-06T08:30:45.759 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-06T08:30:45.759 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-06T08:30:45.759 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:45.759 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-06T08:30:45.759 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-06T08:30:45.759 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-06T08:30:45.759 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-06T08:30:45.759 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-06T08:30:45.759 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-06T08:30:45.760 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "restful" 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modified": "2024-06-06T08:30:30.992087+0000", 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-06T08:30:45.761 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-06-06T08:30:45.766 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.974+0000 7f1bcea00700 1 Processor -- start 2024-06-06T08:30:45.766 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.974+0000 7f1bcea00700 1 -- start start 2024-06-06T08:30:45.766 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.975+0000 7f1bcea00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc81082f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:45.766 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.975+0000 7f1bcea00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc8108830 con 0x7f1bc8107ed0 2024-06-06T08:30:45.766 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.975+0000 7f1bc7e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc81082f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:45.766 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.975+0000 7f1bc7e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc81082f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36920/0 (socket says 172.21.15.28:36920) 2024-06-06T08:30:45.766 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.975+0000 7f1bc7e00700 1 -- 172.21.15.28:0/2660571998 learned_addr learned my addr 172.21.15.28:0/2660571998 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:45.766 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.976+0000 7f1bc7e00700 1 -- 172.21.15.28:0/2660571998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc8108fe0 con 0x7f1bc8107ed0 2024-06-06T08:30:45.766 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.976+0000 7f1bc7e00700 1 --2- 172.21.15.28:0/2660571998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc81082f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80098a0 tx=0x7f1bb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5ccc0b1b3f47b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:45.766 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.976+0000 7f1bc6a00700 1 -- 172.21.15.28:0/2660571998 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8004160 con 0x7f1bc8107ed0 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.976+0000 7f1bc6a00700 1 -- 172.21.15.28:0/2660571998 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bb8004300 con 0x7f1bc8107ed0 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.976+0000 7f1bc6a00700 1 -- 172.21.15.28:0/2660571998 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8011b50 con 0x7f1bc8107ed0 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.977+0000 7f1bcea00700 1 -- 172.21.15.28:0/2660571998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 msgr2=0x7f1bc81082f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.977+0000 7f1bcea00700 1 --2- 172.21.15.28:0/2660571998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc81082f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80098a0 tx=0x7f1bb8009bb0 comp rx=0 tx=0).stop 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.977+0000 7f1bcea00700 1 -- 172.21.15.28:0/2660571998 shutdown_connections 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.977+0000 7f1bcea00700 1 --2- 172.21.15.28:0/2660571998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc81082f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.977+0000 7f1bcea00700 1 -- 172.21.15.28:0/2660571998 >> 172.21.15.28:0/2660571998 conn(0x7f1bc8103470 msgr2=0x7f1bc81058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.977+0000 7f1bcea00700 1 -- 172.21.15.28:0/2660571998 shutdown_connections 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.977+0000 7f1bcea00700 1 -- 172.21.15.28:0/2660571998 wait complete. 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.978+0000 7f1bcea00700 1 Processor -- start 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.978+0000 7f1bcea00700 1 -- start start 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.979+0000 7f1bcea00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc819e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.979+0000 7f1bcea00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc810c2a0 con 0x7f1bc8107ed0 2024-06-06T08:30:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.979+0000 7f1bc7e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc819e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.979+0000 7f1bc7e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc819e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36924/0 (socket says 172.21.15.28:36924) 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.979+0000 7f1bc7e00700 1 -- 172.21.15.28:0/1529724988 learned_addr learned my addr 172.21.15.28:0/1529724988 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.979+0000 7f1bc7e00700 1 -- 172.21.15.28:0/1529724988 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc819e5a0 con 0x7f1bc8107ed0 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.980+0000 7f1bc7e00700 1 --2- 172.21.15.28:0/1529724988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc819e060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8011b60 tx=0x7f1bb8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.980+0000 7f1bc4c00700 1 -- 172.21.15.28:0/1529724988 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8003970 con 0x7f1bc8107ed0 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.980+0000 7f1bc4c00700 1 -- 172.21.15.28:0/1529724988 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bb8003b10 con 0x7f1bc8107ed0 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.980+0000 7f1bcea00700 1 -- 172.21.15.28:0/1529724988 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc819e830 con 0x7f1bc8107ed0 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.980+0000 7f1bc4c00700 1 -- 172.21.15.28:0/1529724988 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8024610 con 0x7f1bc8107ed0 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.980+0000 7f1bcea00700 1 -- 172.21.15.28:0/1529724988 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc81a1520 con 0x7f1bc8107ed0 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.980+0000 7f1bc4c00700 1 -- 172.21.15.28:0/1529724988 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1bb8024c50 con 0x7f1bc8107ed0 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.981+0000 7f1bc4c00700 1 -- 172.21.15.28:0/1529724988 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1bb8011e00 con 0x7f1bc8107ed0 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.981+0000 7f1bcea00700 1 -- 172.21.15.28:0/1529724988 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc810c420 con 0x7f1bc8107ed0 2024-06-06T08:30:45.768 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:44.984+0000 7f1bc4c00700 1 -- 172.21.15.28:0/1529724988 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1bb8043dd0 con 0x7f1bc8107ed0 2024-06-06T08:30:45.769 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:45.064+0000 7f1bcea00700 1 -- 172.21.15.28:0/1529724988 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1bc8063af0 con 0x7f1bc8107ed0 2024-06-06T08:30:45.769 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:45.065+0000 7f1bc4c00700 1 -- 172.21.15.28:0/1529724988 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f1bb8032030 con 0x7f1bc8107ed0 2024-06-06T08:30:45.769 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:45.066+0000 7f1bcea00700 1 -- 172.21.15.28:0/1529724988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 msgr2=0x7f1bc819e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:45.769 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:45.066+0000 7f1bcea00700 1 --2- 172.21.15.28:0/1529724988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc819e060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8011b60 tx=0x7f1bb8011c40 comp rx=0 tx=0).stop 2024-06-06T08:30:45.769 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:45.066+0000 7f1bcea00700 1 -- 172.21.15.28:0/1529724988 shutdown_connections 2024-06-06T08:30:45.769 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:45.066+0000 7f1bcea00700 1 --2- 172.21.15.28:0/1529724988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bc8107ed0 0x7f1bc819e060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:45.769 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:45.066+0000 7f1bcea00700 1 -- 172.21.15.28:0/1529724988 >> 172.21.15.28:0/1529724988 conn(0x7f1bc8103470 msgr2=0x7f1bc8103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:45.769 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:45.066+0000 7f1bcea00700 1 -- 172.21.15.28:0/1529724988 shutdown_connections 2024-06-06T08:30:45.769 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:45.066+0000 7f1bcea00700 1 -- 172.21.15.28:0/1529724988 wait complete. 2024-06-06T08:30:45.769 INFO:teuthology.orchestra.run.smithi028.stdout:mgr not available, waiting (2/15)... 2024-06-06T08:30:46.040 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:45 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:45.979+0000 7ff7a24cb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T08:30:46.953 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:46 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:46.549+0000 7ff7a24cb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T08:30:46.953 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:46 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:46.680+0000 7ff7a24cb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T08:30:46.953 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:46 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:46.952+0000 7ff7a24cb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T08:30:47.929 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:47 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:47.621+0000 7ff7a24cb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T08:30:47.929 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:47 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:47.748+0000 7ff7a24cb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T08:30:48.267 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:48 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:48.090+0000 7ff7a24cb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T08:30:48.517 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:48 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:48.278+0000 7ff7a24cb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T08:30:48.517 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:48 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:48.412+0000 7ff7a24cb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T08:30:48.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:48 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/204831722' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-06T08:30:48.791 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:48 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:48.580+0000 7ff7a24cb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T08:30:49.253 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:48 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:48.956+0000 7ff7a24cb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T08:30:49.273 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:49.273 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-06-06T08:30:49.273 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:30:49.273 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "health": { 2024-06-06T08:30:49.273 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-06T08:30:49.273 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-06T08:30:49.273 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-06T08:30:49.273 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:49.274 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-06T08:30:49.274 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-06T08:30:49.274 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 0 2024-06-06T08:30:49.274 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:49.274 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-06T08:30:49.274 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "a" 2024-06-06T08:30:49.274 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:49.274 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-06-06T08:30:49.274 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-06T08:30:49.275 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:49.275 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-06T08:30:49.275 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-06T08:30:49.275 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:49.275 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-06T08:30:49.275 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:49.275 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-06T08:30:49.275 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-06T08:30:49.284 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-06T08:30:49.284 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-06T08:30:49.284 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-06T08:30:49.284 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-06T08:30:49.284 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:49.284 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-06T08:30:49.284 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-06T08:30:49.284 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-06T08:30:49.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:49.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-06T08:30:49.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-06T08:30:49.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-06T08:30:49.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-06T08:30:49.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-06T08:30:49.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-06T08:30:49.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "restful" 2024-06-06T08:30:49.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:49.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T08:30:49.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:49.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-06T08:30:49.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:49.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modified": "2024-06-06T08:30:30.992087+0000", 2024-06-06T08:30:49.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T08:30:49.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:49.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-06T08:30:49.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-06-06T08:30:49.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.427+0000 7fd351600700 1 Processor -- start 2024-06-06T08:30:49.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.427+0000 7fd351600700 1 -- start start 2024-06-06T08:30:49.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.428+0000 7fd351600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c10ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:49.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.428+0000 7fd351600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c07be80 con 0x7fd34c108790 2024-06-06T08:30:49.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.428+0000 7fd34be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c10ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:49.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.428+0000 7fd34be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c10ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59372/0 (socket says 172.21.15.28:59372) 2024-06-06T08:30:49.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.428+0000 7fd34be00700 1 -- 172.21.15.28:0/2983812186 learned_addr learned my addr 172.21.15.28:0/2983812186 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:49.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.429+0000 7fd34be00700 1 -- 172.21.15.28:0/2983812186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c10b0c0 con 0x7fd34c108790 2024-06-06T08:30:49.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.429+0000 7fd34be00700 1 --2- 172.21.15.28:0/2983812186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c10ab80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0098a0 tx=0x7fd33c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c990b0194e80a0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:49.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.429+0000 7fd34aa00700 1 -- 172.21.15.28:0/2983812186 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd33c004160 con 0x7fd34c108790 2024-06-06T08:30:49.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.429+0000 7fd34aa00700 1 -- 172.21.15.28:0/2983812186 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd33c004300 con 0x7fd34c108790 2024-06-06T08:30:49.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.429+0000 7fd34aa00700 1 -- 172.21.15.28:0/2983812186 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd33c011b50 con 0x7fd34c108790 2024-06-06T08:30:49.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.430+0000 7fd351600700 1 -- 172.21.15.28:0/2983812186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 msgr2=0x7fd34c10ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:49.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.430+0000 7fd351600700 1 --2- 172.21.15.28:0/2983812186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c10ab80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0098a0 tx=0x7fd33c009bb0 comp rx=0 tx=0).stop 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.430+0000 7fd351600700 1 -- 172.21.15.28:0/2983812186 shutdown_connections 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.430+0000 7fd351600700 1 --2- 172.21.15.28:0/2983812186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c10ab80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.430+0000 7fd351600700 1 -- 172.21.15.28:0/2983812186 >> 172.21.15.28:0/2983812186 conn(0x7fd34c1021a0 msgr2=0x7fd34c1045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.430+0000 7fd351600700 1 -- 172.21.15.28:0/2983812186 shutdown_connections 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.430+0000 7fd351600700 1 -- 172.21.15.28:0/2983812186 wait complete. 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.431+0000 7fd351600700 1 Processor -- start 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.431+0000 7fd351600700 1 -- start start 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.432+0000 7fd351600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c19ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.432+0000 7fd351600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c10c070 con 0x7fd34c108790 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.432+0000 7fd34be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c19ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.432+0000 7fd34be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c19ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59374/0 (socket says 172.21.15.28:59374) 2024-06-06T08:30:49.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.432+0000 7fd34be00700 1 -- 172.21.15.28:0/204831722 learned_addr learned my addr 172.21.15.28:0/204831722 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:49.290 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.432+0000 7fd34be00700 1 -- 172.21.15.28:0/204831722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c19e410 con 0x7fd34c108790 2024-06-06T08:30:49.290 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.433+0000 7fd34be00700 1 --2- 172.21.15.28:0/204831722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c19ded0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd33c011b60 tx=0x7fd33c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:49.290 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.433+0000 7fd348c00700 1 -- 172.21.15.28:0/204831722 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd33c003970 con 0x7fd34c108790 2024-06-06T08:30:49.290 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.433+0000 7fd348c00700 1 -- 172.21.15.28:0/204831722 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd33c003b10 con 0x7fd34c108790 2024-06-06T08:30:49.290 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.433+0000 7fd348c00700 1 -- 172.21.15.28:0/204831722 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd33c024610 con 0x7fd34c108790 2024-06-06T08:30:49.290 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.433+0000 7fd351600700 1 -- 172.21.15.28:0/204831722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34c19e6a0 con 0x7fd34c108790 2024-06-06T08:30:49.290 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.433+0000 7fd351600700 1 -- 172.21.15.28:0/204831722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34c1a1390 con 0x7fd34c108790 2024-06-06T08:30:49.290 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.434+0000 7fd348c00700 1 -- 172.21.15.28:0/204831722 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd33c0248c0 con 0x7fd34c108790 2024-06-06T08:30:49.290 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.434+0000 7fd348c00700 1 -- 172.21.15.28:0/204831722 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd33c011e00 con 0x7fd34c108790 2024-06-06T08:30:49.290 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.434+0000 7fd351600700 1 -- 172.21.15.28:0/204831722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34c063af0 con 0x7fd34c108790 2024-06-06T08:30:49.291 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.437+0000 7fd348c00700 1 -- 172.21.15.28:0/204831722 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd33c01a7c0 con 0x7fd34c108790 2024-06-06T08:30:49.291 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.517+0000 7fd351600700 1 -- 172.21.15.28:0/204831722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd34c1a1560 con 0x7fd34c108790 2024-06-06T08:30:49.291 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.518+0000 7fd348c00700 1 -- 172.21.15.28:0/204831722 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7fd33c02dd70 con 0x7fd34c108790 2024-06-06T08:30:49.291 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.520+0000 7fd351600700 1 -- 172.21.15.28:0/204831722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 msgr2=0x7fd34c19ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:49.291 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.520+0000 7fd351600700 1 --2- 172.21.15.28:0/204831722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c19ded0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd33c011b60 tx=0x7fd33c011c40 comp rx=0 tx=0).stop 2024-06-06T08:30:49.291 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.520+0000 7fd351600700 1 -- 172.21.15.28:0/204831722 shutdown_connections 2024-06-06T08:30:49.291 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.520+0000 7fd351600700 1 --2- 172.21.15.28:0/204831722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd34c108790 0x7fd34c19ded0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:49.291 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.520+0000 7fd351600700 1 -- 172.21.15.28:0/204831722 >> 172.21.15.28:0/204831722 conn(0x7fd34c1021a0 msgr2=0x7fd34c102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:49.291 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.520+0000 7fd351600700 1 -- 172.21.15.28:0/204831722 shutdown_connections 2024-06-06T08:30:49.291 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:48.520+0000 7fd351600700 1 -- 172.21.15.28:0/204831722 wait complete. 2024-06-06T08:30:49.291 INFO:teuthology.orchestra.run.smithi028.stdout:mgr not available, waiting (3/15)... 2024-06-06T08:30:50.040 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:49 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:49.764+0000 7ff7a24cb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T08:30:50.541 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:50.058+0000 7ff7a24cb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T08:30:50.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: Activating manager daemon x 2024-06-06T08:30:50.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: mgrmap e2: x(active, starting, since 0.0109293s) 2024-06-06T08:30:50.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: from='mgr.14100 172.21.15.28:0/2088568550' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-06T08:30:50.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: from='mgr.14100 172.21.15.28:0/2088568550' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-06T08:30:50.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: from='mgr.14100 172.21.15.28:0/2088568550' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-06T08:30:50.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: from='mgr.14100 172.21.15.28:0/2088568550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:30:50.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: from='mgr.14100 172.21.15.28:0/2088568550' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-06T08:30:50.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: Manager daemon x is now available 2024-06-06T08:30:50.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: from='mgr.14100 172.21.15.28:0/2088568550' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-06T08:30:50.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: from='mgr.14100 172.21.15.28:0/2088568550' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-06T08:30:50.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: from='mgr.14100 172.21.15.28:0/2088568550' entity='mgr.x' 2024-06-06T08:30:50.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:50 smithi028 ceph-mon[31564]: from='mgr.14100 172.21.15.28:0/2088568550' entity='mgr.x' 2024-06-06T08:30:51.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:51 smithi028 ceph-mon[31564]: from='mgr.14100 172.21.15.28:0/2088568550' entity='mgr.x' 2024-06-06T08:30:51.438 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:51 smithi028 ceph-mon[31564]: mgrmap e3: x(active, since 1.021s) 2024-06-06T08:30:52.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:52.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-06-06T08:30:52.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:30:52.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "health": { 2024-06-06T08:30:52.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-06T08:30:52.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-06T08:30:52.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-06T08:30:52.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:52.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-06T08:30:52.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-06T08:30:52.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 0 2024-06-06T08:30:52.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:52.919 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-06T08:30:52.919 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "a" 2024-06-06T08:30:52.919 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:52.920 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-06-06T08:30:52.920 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-06T08:30:52.920 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:52.920 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-06T08:30:52.920 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-06T08:30:52.920 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:52.920 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-06T08:30:52.921 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:52.921 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-06T08:30:52.921 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-06T08:30:52.921 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-06T08:30:52.927 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-06T08:30:52.927 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-06T08:30:52.927 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-06T08:30:52.927 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:52.927 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-06T08:30:52.927 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-06T08:30:52.927 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-06T08:30:52.928 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-06T08:30:52.928 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-06T08:30:52.928 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-06T08:30:52.928 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-06T08:30:52.928 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-06T08:30:52.928 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-06T08:30:52.928 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:52.928 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-06T08:30:52.928 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:52.928 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-06T08:30:52.928 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "restful" 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ], 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:52.929 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-06T08:30:52.930 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T08:30:52.930 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "modified": "2024-06-06T08:30:30.992087+0000", 2024-06-06T08:30:52.930 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T08:30:52.930 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout }, 2024-06-06T08:30:52.930 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-06T08:30:52.930 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-06-06T08:30:52.930 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.931+0000 7fba6e800700 1 Processor -- start 2024-06-06T08:30:52.930 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.932+0000 7fba6e800700 1 -- start start 2024-06-06T08:30:52.930 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.932+0000 7fba6e800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6810a110 0x7fba6810a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:52.930 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.932+0000 7fba6e800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fba6810ab00 con 0x7fba6810a110 2024-06-06T08:30:52.930 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.933+0000 7fba6d400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6810a110 0x7fba6810a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.933+0000 7fba6d400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6810a110 0x7fba6810a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59438/0 (socket says 172.21.15.28:59438) 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.933+0000 7fba6d400700 1 -- 172.21.15.28:0/1503122745 learned_addr learned my addr 172.21.15.28:0/1503122745 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.933+0000 7fba6d400700 1 -- 172.21.15.28:0/1503122745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6810b050 con 0x7fba6810a110 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.933+0000 7fba6d400700 1 --2- 172.21.15.28:0/1503122745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6810a110 0x7fba6810a530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0098a0 tx=0x7fba5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cc1e817e9f6dcc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.934+0000 7fba67e00700 1 -- 172.21.15.28:0/1503122745 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba5c004160 con 0x7fba6810a110 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.934+0000 7fba67e00700 1 -- 172.21.15.28:0/1503122745 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba5c004300 con 0x7fba6810a110 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.934+0000 7fba67e00700 1 -- 172.21.15.28:0/1503122745 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba5c011b50 con 0x7fba6810a110 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.935+0000 7fba6e800700 1 -- 172.21.15.28:0/1503122745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6810a110 msgr2=0x7fba6810a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.935+0000 7fba6e800700 1 --2- 172.21.15.28:0/1503122745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6810a110 0x7fba6810a530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0098a0 tx=0x7fba5c009bb0 comp rx=0 tx=0).stop 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.935+0000 7fba6e800700 1 -- 172.21.15.28:0/1503122745 shutdown_connections 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.935+0000 7fba6e800700 1 --2- 172.21.15.28:0/1503122745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6810a110 0x7fba6810a530 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:52.931 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.935+0000 7fba6e800700 1 -- 172.21.15.28:0/1503122745 >> 172.21.15.28:0/1503122745 conn(0x7fba6807d2a0 msgr2=0x7fba6807d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:52.932 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.935+0000 7fba6e800700 1 -- 172.21.15.28:0/1503122745 shutdown_connections 2024-06-06T08:30:52.935 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.935+0000 7fba6e800700 1 -- 172.21.15.28:0/1503122745 wait complete. 2024-06-06T08:30:52.935 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.936+0000 7fba6e800700 1 Processor -- start 2024-06-06T08:30:52.935 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.936+0000 7fba6e800700 1 -- start start 2024-06-06T08:30:52.935 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.936+0000 7fba6e800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6819e090 0x7fba6819e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.936+0000 7fba6e800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fba6810e310 con 0x7fba6819e090 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.937+0000 7fba6d400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6819e090 0x7fba6819e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.937+0000 7fba6d400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6819e090 0x7fba6819e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59450/0 (socket says 172.21.15.28:59450) 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.937+0000 7fba6d400700 1 -- 172.21.15.28:0/600247508 learned_addr learned my addr 172.21.15.28:0/600247508 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.937+0000 7fba6d400700 1 -- 172.21.15.28:0/600247508 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6819e9f0 con 0x7fba6819e090 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.937+0000 7fba6d400700 1 --2- 172.21.15.28:0/600247508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6819e090 0x7fba6819e4b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba5c000c00 tx=0x7fba5c0119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.938+0000 7fba66000700 1 -- 172.21.15.28:0/600247508 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba5c0038b0 con 0x7fba6819e090 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.938+0000 7fba66000700 1 -- 172.21.15.28:0/600247508 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba5c003a50 con 0x7fba6819e090 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.938+0000 7fba6e800700 1 -- 172.21.15.28:0/600247508 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6819ec80 con 0x7fba6819e090 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.938+0000 7fba66000700 1 -- 172.21.15.28:0/600247508 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba5c01b440 con 0x7fba6819e090 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.938+0000 7fba6e800700 1 -- 172.21.15.28:0/600247508 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba681a1760 con 0x7fba6819e090 2024-06-06T08:30:52.936 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.939+0000 7fba66000700 1 -- 172.21.15.28:0/600247508 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7fba5c01a440 con 0x7fba6819e090 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.939+0000 7fba6e800700 1 -- 172.21.15.28:0/600247508 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba68063af0 con 0x7fba6819e090 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.940+0000 7fba66000700 1 --2- 172.21.15.28:0/600247508 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fba50038f30 0x7fba5003b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.940+0000 7fba66000700 1 -- 172.21.15.28:0/600247508 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fba5c04d200 con 0x7fba6819e090 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.940+0000 7fba6ca00700 1 --2- 172.21.15.28:0/600247508 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fba50038f30 0x7fba5003b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.941+0000 7fba6ca00700 1 --2- 172.21.15.28:0/600247508 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fba50038f30 0x7fba5003b3f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba54006fd0 tx=0x7fba54006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:51.947+0000 7fba66000700 1 -- 172.21.15.28:0/600247508 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fba5c016df0 con 0x7fba6819e090 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.125+0000 7fba66000700 1 -- 172.21.15.28:0/600247508 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fba5c01b640 con 0x7fba6819e090 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.268+0000 7fba6e800700 1 -- 172.21.15.28:0/600247508 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fba681a1f60 con 0x7fba6819e090 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.268+0000 7fba66000700 1 -- 172.21.15.28:0/600247508 <== mon.0 v2:172.21.15.28:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fba5c044670 con 0x7fba6819e090 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.271+0000 7fba6e800700 1 -- 172.21.15.28:0/600247508 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fba50038f30 msgr2=0x7fba5003b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.271+0000 7fba6e800700 1 --2- 172.21.15.28:0/600247508 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fba50038f30 0x7fba5003b3f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba54006fd0 tx=0x7fba54006e40 comp rx=0 tx=0).stop 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.272+0000 7fba6e800700 1 -- 172.21.15.28:0/600247508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6819e090 msgr2=0x7fba6819e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.272+0000 7fba6e800700 1 --2- 172.21.15.28:0/600247508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6819e090 0x7fba6819e4b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba5c000c00 tx=0x7fba5c0119e0 comp rx=0 tx=0).stop 2024-06-06T08:30:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.272+0000 7fba6e800700 1 -- 172.21.15.28:0/600247508 shutdown_connections 2024-06-06T08:30:52.938 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.272+0000 7fba6e800700 1 --2- 172.21.15.28:0/600247508 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fba50038f30 0x7fba5003b3f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:52.938 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.272+0000 7fba6e800700 1 --2- 172.21.15.28:0/600247508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba6819e090 0x7fba6819e4b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:52.938 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.272+0000 7fba6e800700 1 -- 172.21.15.28:0/600247508 >> 172.21.15.28:0/600247508 conn(0x7fba6807d2a0 msgr2=0x7fba68107ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:52.938 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.272+0000 7fba6e800700 1 -- 172.21.15.28:0/600247508 shutdown_connections 2024-06-06T08:30:52.938 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:52.272+0000 7fba6e800700 1 -- 172.21.15.28:0/600247508 wait complete. 2024-06-06T08:30:52.938 INFO:teuthology.orchestra.run.smithi028.stdout:mgr is available 2024-06-06T08:30:53.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:53 smithi028 ceph-mon[31564]: mgrmap e4: x(active, since 2s) 2024-06-06T08:30:53.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:53 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/600247508' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-06T08:30:54.524 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:54 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/805413323' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-06T08:30:54.538 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:54.538 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [global] 2024-06-06T08:30:54.538 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout fsid = e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:30:54.540 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-06T08:30:54.540 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-06T08:30:54.540 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-06T08:30:54.540 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-06T08:30:54.541 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:54.541 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-06T08:30:54.541 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-06T08:30:54.541 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 2024-06-06T08:30:54.541 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout [osd] 2024-06-06T08:30:54.541 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-06T08:30:54.541 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-06T08:30:54.541 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-06T08:30:54.541 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-06T08:30:54.541 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-06T08:30:54.547 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.580+0000 7fac81a00700 1 Processor -- start 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.581+0000 7fac81a00700 1 -- start start 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.581+0000 7fac81a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c07c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.581+0000 7fac81a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c07c900 con 0x7fac7c07ded0 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.582+0000 7fac7aa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c07c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.582+0000 7fac7aa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c07c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59460/0 (socket says 172.21.15.28:59460) 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.582+0000 7fac7aa00700 1 -- 172.21.15.28:0/1781479827 learned_addr learned my addr 172.21.15.28:0/1781479827 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.582+0000 7fac7aa00700 1 -- 172.21.15.28:0/1781479827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c07ca80 con 0x7fac7c07ded0 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.582+0000 7fac7aa00700 1 --2- 172.21.15.28:0/1781479827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c07c330 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009e80 tx=0x7fac6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca051e4803fcf886 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.583+0000 7fac7a000700 1 -- 172.21.15.28:0/1781479827 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac6c017070 con 0x7fac7c07ded0 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.583+0000 7fac7a000700 1 -- 172.21.15.28:0/1781479827 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac6c00b8c0 con 0x7fac7c07ded0 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.583+0000 7fac7a000700 1 -- 172.21.15.28:0/1781479827 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac6c0045c0 con 0x7fac7c07ded0 2024-06-06T08:30:54.548 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.583+0000 7fac81a00700 1 -- 172.21.15.28:0/1781479827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 msgr2=0x7fac7c07c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.583+0000 7fac81a00700 1 --2- 172.21.15.28:0/1781479827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c07c330 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009e80 tx=0x7fac6c00b330 comp rx=0 tx=0).stop 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.584+0000 7fac81a00700 1 -- 172.21.15.28:0/1781479827 shutdown_connections 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.584+0000 7fac81a00700 1 --2- 172.21.15.28:0/1781479827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c07c330 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.584+0000 7fac81a00700 1 -- 172.21.15.28:0/1781479827 >> 172.21.15.28:0/1781479827 conn(0x7fac7c103420 msgr2=0x7fac7c105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.584+0000 7fac81a00700 1 -- 172.21.15.28:0/1781479827 shutdown_connections 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.584+0000 7fac81a00700 1 -- 172.21.15.28:0/1781479827 wait complete. 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.585+0000 7fac81a00700 1 Processor -- start 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.585+0000 7fac81a00700 1 -- start start 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.585+0000 7fac81a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c19df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.585+0000 7fac81a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c10e430 con 0x7fac7c07ded0 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.586+0000 7fac7aa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c19df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:54.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.586+0000 7fac7aa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c19df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59466/0 (socket says 172.21.15.28:59466) 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.586+0000 7fac7aa00700 1 -- 172.21.15.28:0/805413323 learned_addr learned my addr 172.21.15.28:0/805413323 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.586+0000 7fac7aa00700 1 -- 172.21.15.28:0/805413323 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c19e490 con 0x7fac7c07ded0 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.586+0000 7fac7aa00700 1 --2- 172.21.15.28:0/805413323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c19df50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009530 tx=0x7fac6c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.587+0000 7fac73e00700 1 -- 172.21.15.28:0/805413323 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac6c020020 con 0x7fac7c07ded0 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.587+0000 7fac73e00700 1 -- 172.21.15.28:0/805413323 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac6c003b50 con 0x7fac7c07ded0 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.587+0000 7fac81a00700 1 -- 172.21.15.28:0/805413323 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7c19e720 con 0x7fac7c07ded0 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.587+0000 7fac73e00700 1 -- 172.21.15.28:0/805413323 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac6c017040 con 0x7fac7c07ded0 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.587+0000 7fac81a00700 1 -- 172.21.15.28:0/805413323 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7c1a1410 con 0x7fac7c07ded0 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.588+0000 7fac73e00700 1 -- 172.21.15.28:0/805413323 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fac6c023020 con 0x7fac7c07ded0 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.588+0000 7fac81a00700 1 -- 172.21.15.28:0/805413323 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac7c063af0 con 0x7fac7c07ded0 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.589+0000 7fac73e00700 1 --2- 172.21.15.28:0/805413323 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fac600390a0 0x7fac6003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.589+0000 7fac73e00700 1 -- 172.21.15.28:0/805413323 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fac6c00f050 con 0x7fac7c07ded0 2024-06-06T08:30:54.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.589+0000 7fac72000700 1 --2- 172.21.15.28:0/805413323 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fac600390a0 0x7fac6003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.590+0000 7fac72000700 1 --2- 172.21.15.28:0/805413323 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fac600390a0 0x7fac6003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fac64006fd0 tx=0x7fac64006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.594+0000 7fac73e00700 1 -- 172.21.15.28:0/805413323 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fac6c02a020 con 0x7fac7c07ded0 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.819+0000 7fac81a00700 1 -- 172.21.15.28:0/805413323 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fac7c1a15e0 con 0x7fac7c07ded0 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.821+0000 7fac73e00700 1 -- 172.21.15.28:0/805413323 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7fac7c1a15e0 con 0x7fac7c07ded0 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.824+0000 7fac81a00700 1 -- 172.21.15.28:0/805413323 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fac600390a0 msgr2=0x7fac6003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.824+0000 7fac81a00700 1 --2- 172.21.15.28:0/805413323 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fac600390a0 0x7fac6003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fac64006fd0 tx=0x7fac64006e40 comp rx=0 tx=0).stop 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.824+0000 7fac81a00700 1 -- 172.21.15.28:0/805413323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 msgr2=0x7fac7c19df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.824+0000 7fac81a00700 1 --2- 172.21.15.28:0/805413323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c19df50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009530 tx=0x7fac6c00bd50 comp rx=0 tx=0).stop 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.824+0000 7fac81a00700 1 -- 172.21.15.28:0/805413323 shutdown_connections 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.824+0000 7fac81a00700 1 --2- 172.21.15.28:0/805413323 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7fac600390a0 0x7fac6003b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.824+0000 7fac81a00700 1 --2- 172.21.15.28:0/805413323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac7c07ded0 0x7fac7c19df50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.824+0000 7fac81a00700 1 -- 172.21.15.28:0/805413323 >> 172.21.15.28:0/805413323 conn(0x7fac7c103420 msgr2=0x7fac7c103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.825+0000 7fac81a00700 1 -- 172.21.15.28:0/805413323 shutdown_connections 2024-06-06T08:30:54.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:53.825+0000 7fac81a00700 1 -- 172.21.15.28:0/805413323 wait complete. 2024-06-06T08:30:54.552 INFO:teuthology.orchestra.run.smithi028.stdout:Enabling cephadm module... 2024-06-06T08:30:55.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:55 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2097902853' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-06-06T08:30:55.791 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:55 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: ignoring --setuser ceph since I am not root 2024-06-06T08:30:55.791 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:55 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: ignoring --setgroup ceph since I am not root 2024-06-06T08:30:56.104 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:55 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:55.849+0000 7f8d1e4e9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T08:30:56.104 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:56 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:56.104+0000 7f8d1e4e9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T08:30:56.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.206+0000 7f71cfc00700 1 Processor -- start 2024-06-06T08:30:56.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.206+0000 7f71cfc00700 1 -- start start 2024-06-06T08:30:56.285 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.207+0000 7f71cfc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c8108290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.207+0000 7f71cfc00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71c81087d0 con 0x7f71c8107e70 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.207+0000 7f71cd200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c8108290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.207+0000 7f71cd200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c8108290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59470/0 (socket says 172.21.15.28:59470) 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.207+0000 7f71cd200700 1 -- 172.21.15.28:0/2229963249 learned_addr learned my addr 172.21.15.28:0/2229963249 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.208+0000 7f71cd200700 1 -- 172.21.15.28:0/2229963249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c8109060 con 0x7f71c8107e70 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.208+0000 7f71cd200700 1 --2- 172.21.15.28:0/2229963249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c8108290 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0098a0 tx=0x7f71bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ff768cad84ede2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.208+0000 7f71c7400700 1 -- 172.21.15.28:0/2229963249 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71bc004160 con 0x7f71c8107e70 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.208+0000 7f71c7400700 1 -- 172.21.15.28:0/2229963249 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71bc004300 con 0x7f71c8107e70 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.208+0000 7f71c7400700 1 -- 172.21.15.28:0/2229963249 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71bc011b50 con 0x7f71c8107e70 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.209+0000 7f71cfc00700 1 -- 172.21.15.28:0/2229963249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 msgr2=0x7f71c8108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.209+0000 7f71cfc00700 1 --2- 172.21.15.28:0/2229963249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c8108290 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0098a0 tx=0x7f71bc009bb0 comp rx=0 tx=0).stop 2024-06-06T08:30:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.209+0000 7f71cfc00700 1 -- 172.21.15.28:0/2229963249 shutdown_connections 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.209+0000 7f71cfc00700 1 --2- 172.21.15.28:0/2229963249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c8108290 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.209+0000 7f71cfc00700 1 -- 172.21.15.28:0/2229963249 >> 172.21.15.28:0/2229963249 conn(0x7f71c8103480 msgr2=0x7f71c81058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.209+0000 7f71cfc00700 1 -- 172.21.15.28:0/2229963249 shutdown_connections 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.209+0000 7f71cfc00700 1 -- 172.21.15.28:0/2229963249 wait complete. 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.210+0000 7f71cfc00700 1 Processor -- start 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.211+0000 7f71cfc00700 1 -- start start 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.211+0000 7f71cfc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c807db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.211+0000 7f71cfc00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71c8108950 con 0x7f71c8107e70 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.211+0000 7f71cd200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c807db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.211+0000 7f71cd200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c807db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59480/0 (socket says 172.21.15.28:59480) 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.211+0000 7f71cd200700 1 -- 172.21.15.28:0/2097902853 learned_addr learned my addr 172.21.15.28:0/2097902853 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.212+0000 7f71cd200700 1 -- 172.21.15.28:0/2097902853 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c807e0c0 con 0x7f71c8107e70 2024-06-06T08:30:56.287 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.212+0000 7f71cd200700 1 --2- 172.21.15.28:0/2097902853 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c807db80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f71bc011670 tx=0x7f71bc011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.212+0000 7f71c5600700 1 -- 172.21.15.28:0/2097902853 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71bc0039c0 con 0x7f71c8107e70 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.212+0000 7f71c5600700 1 -- 172.21.15.28:0/2097902853 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71bc011e50 con 0x7f71c8107e70 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.212+0000 7f71c5600700 1 -- 172.21.15.28:0/2097902853 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71bc01a5c0 con 0x7f71c8107e70 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.212+0000 7f71cfc00700 1 -- 172.21.15.28:0/2097902853 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c807c2b0 con 0x7f71c8107e70 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.213+0000 7f71cfc00700 1 -- 172.21.15.28:0/2097902853 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c807c7f0 con 0x7f71c8107e70 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.214+0000 7f71c5600700 1 -- 172.21.15.28:0/2097902853 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f71bc024430 con 0x7f71c8107e70 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.214+0000 7f71cfc00700 1 -- 172.21.15.28:0/2097902853 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c8063af0 con 0x7f71c8107e70 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.214+0000 7f71c5600700 1 --2- 172.21.15.28:0/2097902853 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f71b0039000 0x7f71b003b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.214+0000 7f71c5600700 1 -- 172.21.15.28:0/2097902853 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f71bc04d3b0 con 0x7f71c8107e70 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.214+0000 7f71c7e00700 1 --2- 172.21.15.28:0/2097902853 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f71b0039000 0x7f71b003b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.215+0000 7f71c7e00700 1 --2- 172.21.15.28:0/2097902853 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f71b0039000 0x7f71b003b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f71b4006fd0 tx=0x7f71b4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.220+0000 7f71c5600700 1 -- 172.21.15.28:0/2097902853 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f71bc04cdd0 con 0x7f71c8107e70 2024-06-06T08:30:56.288 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.508+0000 7f71cfc00700 1 -- 172.21.15.28:0/2097902853 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f71c807cfe0 con 0x7f71c8107e70 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.562+0000 7f71c5600700 1 -- 172.21.15.28:0/2097902853 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f71bc02d3f0 con 0x7f71c8107e70 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.565+0000 7f71c5600700 1 -- 172.21.15.28:0/2097902853 <== mon.0 v2:172.21.15.28:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f71bc024720 con 0x7f71c8107e70 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.566+0000 7f71cfc00700 1 -- 172.21.15.28:0/2097902853 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f71b0039000 msgr2=0x7f71b003b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.566+0000 7f71cfc00700 1 --2- 172.21.15.28:0/2097902853 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f71b0039000 0x7f71b003b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f71b4006fd0 tx=0x7f71b4006e40 comp rx=0 tx=0).stop 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.566+0000 7f71cfc00700 1 -- 172.21.15.28:0/2097902853 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 msgr2=0x7f71c807db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.566+0000 7f71cfc00700 1 --2- 172.21.15.28:0/2097902853 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c807db80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f71bc011670 tx=0x7f71bc011b60 comp rx=0 tx=0).stop 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.567+0000 7f71cfc00700 1 -- 172.21.15.28:0/2097902853 shutdown_connections 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.567+0000 7f71cfc00700 1 --2- 172.21.15.28:0/2097902853 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f71b0039000 0x7f71b003b4c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.567+0000 7f71cfc00700 1 --2- 172.21.15.28:0/2097902853 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c8107e70 0x7f71c807db80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.567+0000 7f71cfc00700 1 -- 172.21.15.28:0/2097902853 >> 172.21.15.28:0/2097902853 conn(0x7f71c8103480 msgr2=0x7f71c8103f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.567+0000 7f71cfc00700 1 -- 172.21.15.28:0/2097902853 shutdown_connections 2024-06-06T08:30:56.289 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:55.568+0000 7f71cfc00700 1 -- 172.21.15.28:0/2097902853 wait complete. 2024-06-06T08:30:56.433 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:56 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:56.239+0000 7f8d1e4e9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T08:30:56.718 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:56 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2097902853' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-06-06T08:30:56.718 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:56 smithi028 ceph-mon[31564]: mgrmap e5: x(active, since 5s) 2024-06-06T08:30:56.718 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:56 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:56.668+0000 7f8d1e4e9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T08:30:57.040 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:56 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:56.786+0000 7f8d1e4e9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T08:30:57.871 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:30:57 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1056729646' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-06T08:30:57.884 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-06-06T08:30:57.884 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-06-06T08:30:57.884 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-06T08:30:57.885 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-06T08:30:57.885 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-06T08:30:57.886 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-06-06T08:30:57.886 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.881+0000 7f8c08e00700 1 Processor -- start 2024-06-06T08:30:57.886 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.881+0000 7f8c08e00700 1 -- start start 2024-06-06T08:30:57.886 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.881+0000 7f8c08e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c04108270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:57.887 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.881+0000 7f8c08e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c041087b0 con 0x7f8c04107e50 2024-06-06T08:30:57.887 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.882+0000 7f8bf9e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c04108270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:57.887 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.882+0000 7f8bf9e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c04108270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53720/0 (socket says 172.21.15.28:53720) 2024-06-06T08:30:57.888 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.882+0000 7f8bf9e00700 1 -- 172.21.15.28:0/4005450945 learned_addr learned my addr 172.21.15.28:0/4005450945 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:57.888 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.882+0000 7f8bf9e00700 1 -- 172.21.15.28:0/4005450945 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c04109040 con 0x7f8c04107e50 2024-06-06T08:30:57.888 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.883+0000 7f8bf9e00700 1 --2- 172.21.15.28:0/4005450945 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c04108270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40098a0 tx=0x7f8bf4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d143866c0b51865c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.883+0000 7f8c01400700 1 -- 172.21.15.28:0/4005450945 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bf4004160 con 0x7f8c04107e50 2024-06-06T08:30:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.883+0000 7f8c01400700 1 -- 172.21.15.28:0/4005450945 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8bf4004300 con 0x7f8c04107e50 2024-06-06T08:30:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.883+0000 7f8c01400700 1 -- 172.21.15.28:0/4005450945 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bf4011b50 con 0x7f8c04107e50 2024-06-06T08:30:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.884+0000 7f8c08e00700 1 -- 172.21.15.28:0/4005450945 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 msgr2=0x7f8c04108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.884+0000 7f8c08e00700 1 --2- 172.21.15.28:0/4005450945 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c04108270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40098a0 tx=0x7f8bf4009bb0 comp rx=0 tx=0).stop 2024-06-06T08:30:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.884+0000 7f8c08e00700 1 -- 172.21.15.28:0/4005450945 shutdown_connections 2024-06-06T08:30:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.884+0000 7f8c08e00700 1 --2- 172.21.15.28:0/4005450945 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c04108270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.884+0000 7f8c08e00700 1 -- 172.21.15.28:0/4005450945 >> 172.21.15.28:0/4005450945 conn(0x7f8c04103420 msgr2=0x7f8c04105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.884+0000 7f8c08e00700 1 -- 172.21.15.28:0/4005450945 shutdown_connections 2024-06-06T08:30:57.892 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.884+0000 7f8c08e00700 1 -- 172.21.15.28:0/4005450945 wait complete. 2024-06-06T08:30:57.892 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.885+0000 7f8c08e00700 1 Processor -- start 2024-06-06T08:30:57.892 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.885+0000 7f8c08e00700 1 -- start start 2024-06-06T08:30:57.892 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.885+0000 7f8c08e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c0419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:57.892 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.886+0000 7f8c08e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c04108930 con 0x7f8c04107e50 2024-06-06T08:30:57.892 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.886+0000 7f8bf9e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c0419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:30:57.892 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.886+0000 7f8bf9e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c0419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53732/0 (socket says 172.21.15.28:53732) 2024-06-06T08:30:57.892 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.886+0000 7f8bf9e00700 1 -- 172.21.15.28:0/1056729646 learned_addr learned my addr 172.21.15.28:0/1056729646 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:30:57.892 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.886+0000 7f8bf9e00700 1 -- 172.21.15.28:0/1056729646 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0419c320 con 0x7f8c04107e50 2024-06-06T08:30:57.892 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.886+0000 7f8bf9e00700 1 --2- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c0419bde0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4011670 tx=0x7f8bf4011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:30:57.892 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.887+0000 7f8bfb400700 1 -- 172.21.15.28:0/1056729646 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bf40039c0 con 0x7f8c04107e50 2024-06-06T08:30:57.896 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.887+0000 7f8bfb400700 1 -- 172.21.15.28:0/1056729646 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8bf4011e50 con 0x7f8c04107e50 2024-06-06T08:30:57.896 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.887+0000 7f8bfb400700 1 -- 172.21.15.28:0/1056729646 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bf401a5c0 con 0x7f8c04107e50 2024-06-06T08:30:57.896 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.887+0000 7f8c08e00700 1 -- 172.21.15.28:0/1056729646 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0419c5b0 con 0x7f8c04107e50 2024-06-06T08:30:57.896 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.887+0000 7f8c08e00700 1 -- 172.21.15.28:0/1056729646 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0419f2a0 con 0x7f8c04107e50 2024-06-06T08:30:57.896 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.888+0000 7f8c08e00700 1 -- 172.21.15.28:0/1056729646 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c04063af0 con 0x7f8c04107e50 2024-06-06T08:30:57.896 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.888+0000 7f8bfb400700 1 -- 172.21.15.28:0/1056729646 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f8bf4024430 con 0x7f8c04107e50 2024-06-06T08:30:57.896 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.889+0000 7f8bfb400700 1 --2- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f8be8039000 0x7f8be803b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.889+0000 7f8bfb400700 1 -- 172.21.15.28:0/1056729646 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8bf404d450 con 0x7f8c04107e50 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.889+0000 7f8c01e00700 1 -- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f8be8039000 msgr2=0x7f8be803b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/3383589520 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.889+0000 7f8c01e00700 1 --2- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f8be8039000 0x7f8be803b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:56.894+0000 7f8bfb400700 1 -- 172.21.15.28:0/1056729646 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8bf404ce70 con 0x7f8c04107e50 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.090+0000 7f8c01e00700 1 -- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f8be8039000 msgr2=0x7f8be803b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/3383589520 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.090+0000 7f8c01e00700 1 --2- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f8be8039000 0x7f8be803b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.182+0000 7f8c08e00700 1 -- 172.21.15.28:0/1056729646 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f8c0419f470 con 0x7f8c04107e50 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.182+0000 7f8bfb400700 1 -- 172.21.15.28:0/1056729646 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f8c0419f470 con 0x7f8c04107e50 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.186+0000 7f8c08e00700 1 -- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f8be8039000 msgr2=0x7f8be803b4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.186+0000 7f8c08e00700 1 --2- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f8be8039000 0x7f8be803b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.186+0000 7f8c08e00700 1 -- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 msgr2=0x7f8c0419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.186+0000 7f8c08e00700 1 --2- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c0419bde0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4011670 tx=0x7f8bf4011b60 comp rx=0 tx=0).stop 2024-06-06T08:30:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.186+0000 7f8c08e00700 1 -- 172.21.15.28:0/1056729646 shutdown_connections 2024-06-06T08:30:57.898 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.186+0000 7f8c08e00700 1 --2- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f8be8039000 0x7f8be803b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:57.898 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.186+0000 7f8c08e00700 1 --2- 172.21.15.28:0/1056729646 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c04107e50 0x7f8c0419bde0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:30:57.898 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.186+0000 7f8c08e00700 1 -- 172.21.15.28:0/1056729646 >> 172.21.15.28:0/1056729646 conn(0x7f8c04103420 msgr2=0x7f8c04104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:30:57.898 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.186+0000 7f8c08e00700 1 -- 172.21.15.28:0/1056729646 shutdown_connections 2024-06-06T08:30:57.898 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:57.186+0000 7f8c08e00700 1 -- 172.21.15.28:0/1056729646 wait complete. 2024-06-06T08:30:57.898 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for the mgr to restart... 2024-06-06T08:30:57.898 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mgr epoch 5... 2024-06-06T08:30:58.466 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:58 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:58.407+0000 7f8d1e4e9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T08:30:58.790 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:58 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:58.640+0000 7f8d1e4e9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T08:30:59.253 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:58 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:58.859+0000 7f8d1e4e9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T08:30:59.253 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:59 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:59.253+0000 7f8d1e4e9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T08:30:59.540 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:59 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:59.380+0000 7f8d1e4e9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T08:30:59.903 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:59 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:59.638+0000 7f8d1e4e9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T08:30:59.903 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:30:59 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:30:59.904+0000 7f8d1e4e9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T08:31:01.040 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:00 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:00.724+0000 7f8d1e4e9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T08:31:01.700 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:01 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:01.295+0000 7f8d1e4e9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T08:31:01.700 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:01 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:01.428+0000 7f8d1e4e9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T08:31:01.700 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:01 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:01.700+0000 7f8d1e4e9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T08:31:02.790 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:02 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:02.370+0000 7f8d1e4e9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T08:31:02.791 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:02 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:02.498+0000 7f8d1e4e9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T08:31:03.146 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:02 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:02.830+0000 7f8d1e4e9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T08:31:03.146 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:03 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:03.016+0000 7f8d1e4e9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T08:31:03.146 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:03 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:03.146+0000 7f8d1e4e9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T08:31:03.540 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:03 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:03.305+0000 7f8d1e4e9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T08:31:04.040 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:03 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:03.679+0000 7f8d1e4e9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T08:31:04.766 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:04.468+0000 7f8d1e4e9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T08:31:05.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-mon[31564]: Active manager daemon x restarted 2024-06-06T08:31:05.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-mon[31564]: Activating manager daemon x 2024-06-06T08:31:05.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-mon[31564]: osdmap e2: 0 total, 0 up, 0 in 2024-06-06T08:31:05.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-mon[31564]: mgrmap e6: x(active, starting, since 0.00937178s) 2024-06-06T08:31:05.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:31:05.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-06T08:31:05.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-06T08:31:05.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-06T08:31:05.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-06T08:31:05.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-mon[31564]: Manager daemon x is now available 2024-06-06T08:31:05.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:05.041 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:04 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:04.766+0000 7f8d1e4e9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T08:31:06.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:05 smithi028 ceph-mon[31564]: Found migration_current of "None". Setting to last migration. 2024-06-06T08:31:06.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:05 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:06.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:05 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:31:06.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:05 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:31:06.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:05 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-06T08:31:06.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:05 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-06T08:31:06.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:05 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:06.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:05 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:06.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:05 smithi028 ceph-mon[31564]: mgrmap e7: x(active, since 1.01648s) 2024-06-06T08:31:06.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-06-06T08:31:06.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-06-06T08:31:06.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-06T08:31:06.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-06-06T08:31:06.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.467+0000 7f3413200700 1 Processor -- start 2024-06-06T08:31:06.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.467+0000 7f3413200700 1 -- start start 2024-06-06T08:31:06.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.468+0000 7f3413200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341407c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:06.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.468+0000 7f3413200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f341407c900 con 0x7f341407ded0 2024-06-06T08:31:06.557 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.468+0000 7f3411e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341407c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:06.557 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.468+0000 7f3411e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341407c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53744/0 (socket says 172.21.15.28:53744) 2024-06-06T08:31:06.557 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.468+0000 7f3411e00700 1 -- 172.21.15.28:0/3388467056 learned_addr learned my addr 172.21.15.28:0/3388467056 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:06.557 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.469+0000 7f3411e00700 1 -- 172.21.15.28:0/3388467056 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341407ca80 con 0x7f341407ded0 2024-06-06T08:31:06.557 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.469+0000 7f3411e00700 1 --2- 172.21.15.28:0/3388467056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341407c330 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f34040098a0 tx=0x7f3404009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79e3c380c90d9b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:06.557 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.469+0000 7f3410a00700 1 -- 172.21.15.28:0/3388467056 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3404004160 con 0x7f341407ded0 2024-06-06T08:31:06.557 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.469+0000 7f3410a00700 1 -- 172.21.15.28:0/3388467056 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3404004300 con 0x7f341407ded0 2024-06-06T08:31:06.557 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.469+0000 7f3410a00700 1 -- 172.21.15.28:0/3388467056 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3404011b50 con 0x7f341407ded0 2024-06-06T08:31:06.557 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.470+0000 7f3413200700 1 -- 172.21.15.28:0/3388467056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 msgr2=0x7f341407c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.470+0000 7f3413200700 1 --2- 172.21.15.28:0/3388467056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341407c330 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f34040098a0 tx=0x7f3404009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.470+0000 7f3413200700 1 -- 172.21.15.28:0/3388467056 shutdown_connections 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.470+0000 7f3413200700 1 --2- 172.21.15.28:0/3388467056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341407c330 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.470+0000 7f3413200700 1 -- 172.21.15.28:0/3388467056 >> 172.21.15.28:0/3388467056 conn(0x7f34141032f0 msgr2=0x7f3414105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.470+0000 7f3413200700 1 -- 172.21.15.28:0/3388467056 shutdown_connections 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.470+0000 7f3413200700 1 -- 172.21.15.28:0/3388467056 wait complete. 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.471+0000 7f3413200700 1 Processor -- start 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.471+0000 7f3413200700 1 -- start start 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.472+0000 7f3413200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341419ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.472+0000 7f3413200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f341410e220 con 0x7f341407ded0 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.472+0000 7f3411e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341419ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.472+0000 7f3411e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341419ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53752/0 (socket says 172.21.15.28:53752) 2024-06-06T08:31:06.558 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.472+0000 7f3411e00700 1 -- 172.21.15.28:0/2758393684 learned_addr learned my addr 172.21.15.28:0/2758393684 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.472+0000 7f3411e00700 1 -- 172.21.15.28:0/2758393684 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341419e310 con 0x7f341407ded0 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.473+0000 7f3411e00700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341419ddd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3404011850 tx=0x7f3404011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.473+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3404003af0 con 0x7f341407ded0 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.473+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3404020070 con 0x7f341407ded0 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.473+0000 7f3413200700 1 -- 172.21.15.28:0/2758393684 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341419e5a0 con 0x7f341407ded0 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.473+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34040195a0 con 0x7f341407ded0 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.473+0000 7f3413200700 1 -- 172.21.15.28:0/2758393684 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34141a1290 con 0x7f341407ded0 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.474+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f34040198a0 con 0x7f341407ded0 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.475+0000 7f340aa00700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 0x7f33f803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.475+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 --> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f33f803bc20 con 0x7f33f8039050 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.475+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3404011e00 con 0x7f341407ded0 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.475+0000 7f3411400700 1 -- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 msgr2=0x7f33f803b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/3383589520 2024-06-06T08:31:06.559 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.475+0000 7f3411400700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 0x7f33f803b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T08:31:06.560 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.676+0000 7f3411400700 1 -- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 msgr2=0x7f33f803b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/3383589520 2024-06-06T08:31:06.560 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:58.676+0000 7f3411400700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 0x7f33f803b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-06T08:31:06.560 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:59.077+0000 7f3411400700 1 -- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 msgr2=0x7f33f803b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/3383589520 2024-06-06T08:31:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:59.077+0000 7f3411400700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 0x7f33f803b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-06T08:31:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:59.878+0000 7f3411400700 1 -- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 msgr2=0x7f33f803b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/3383589520 2024-06-06T08:31:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:30:59.878+0000 7f3411400700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 0x7f33f803b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-06T08:31:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:01.480+0000 7f3411400700 1 -- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 msgr2=0x7f33f803b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/3383589520 2024-06-06T08:31:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:01.480+0000 7f3411400700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 0x7f33f803b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-06T08:31:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:04.683+0000 7f3411400700 1 -- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 msgr2=0x7f33f803b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/3383589520 2024-06-06T08:31:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:04.683+0000 7f3411400700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 0x7f33f803b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-06-06T08:31:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:04.777+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f340401a430 con 0x7f341407ded0 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:04.777+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 msgr2=0x7f33f803b510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:04.777+0000 7f340aa00700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 0x7f33f803b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.781+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f340404e920 con 0x7f341407ded0 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.781+0000 7f340aa00700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f33f803c980 0x7f33f803ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.781+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 --> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3404024a80 con 0x7f33f803c980 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.783+0000 7f3411400700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f33f803c980 0x7f33f803ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.786+0000 7f3411400700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f33f803c980 0x7f33f803ed70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3400003a10 tx=0x7f3400009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.788+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 <== mgr.14120 v2:172.21.15.28:6800/2022015677 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f3404024a80 con 0x7f33f803c980 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.801+0000 7f3413200700 1 -- 172.21.15.28:0/2758393684 --> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f3414063af0 con 0x7f33f803c980 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.801+0000 7f340aa00700 1 -- 172.21.15.28:0/2758393684 <== mgr.14120 v2:172.21.15.28:6800/2022015677 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f3414063af0 con 0x7f33f803c980 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.802+0000 7f3413200700 1 -- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f33f803c980 msgr2=0x7f33f803ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:06.564 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.802+0000 7f3413200700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f33f803c980 0x7f33f803ed70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3400003a10 tx=0x7f3400009290 comp rx=0 tx=0).stop 2024-06-06T08:31:06.565 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.802+0000 7f3413200700 1 -- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 msgr2=0x7f341419ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:06.565 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.802+0000 7f3413200700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341419ddd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3404011850 tx=0x7f3404011c10 comp rx=0 tx=0).stop 2024-06-06T08:31:06.565 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.802+0000 7f3413200700 1 -- 172.21.15.28:0/2758393684 shutdown_connections 2024-06-06T08:31:06.565 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.802+0000 7f3413200700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f33f803c980 0x7f33f803ed70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:06.565 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.802+0000 7f3413200700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f341407ded0 0x7f341419ddd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:06.565 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.802+0000 7f3413200700 1 --2- 172.21.15.28:0/2758393684 >> [v2:172.21.15.28:6800/3383589520,v1:172.21.15.28:6801/3383589520] conn(0x7f33f8039050 0x7f33f803b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:06.565 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.802+0000 7f3413200700 1 -- 172.21.15.28:0/2758393684 >> 172.21.15.28:0/2758393684 conn(0x7f34141032f0 msgr2=0x7f3414103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:06.565 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.803+0000 7f3413200700 1 -- 172.21.15.28:0/2758393684 shutdown_connections 2024-06-06T08:31:06.565 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:05.803+0000 7f3413200700 1 -- 172.21.15.28:0/2758393684 wait complete. 2024-06-06T08:31:06.565 INFO:teuthology.orchestra.run.smithi028.stdout:mgr epoch 5 is available 2024-06-06T08:31:06.565 INFO:teuthology.orchestra.run.smithi028.stdout:Setting orchestrator backend to cephadm... 2024-06-06T08:31:07.110 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:06 smithi028 ceph-mon[31564]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-06T08:31:07.110 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:06 smithi028 ceph-mon[31564]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-06T08:31:08.240 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:07 smithi028 ceph-mon[31564]: mgrmap e8: x(active, since 2s) 2024-06-06T08:31:08.240 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:07 smithi028 ceph-mon[31564]: [06/Jun/2024:08:31:07] ENGINE Bus STARTING 2024-06-06T08:31:08.240 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:07 smithi028 ceph-mon[31564]: [06/Jun/2024:08:31:07] ENGINE Serving on https://172.21.15.28:7150 2024-06-06T08:31:08.240 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:07 smithi028 ceph-mon[31564]: [06/Jun/2024:08:31:07] ENGINE Serving on http://172.21.15.28:8765 2024-06-06T08:31:08.240 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:07 smithi028 ceph-mon[31564]: [06/Jun/2024:08:31:07] ENGINE Bus STARTED 2024-06-06T08:31:08.240 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:07 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:31:08.240 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:07 smithi028 ceph-mon[31564]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:31:08.240 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:07 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:08.241 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:07 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:31:08.248 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.180+0000 7f30a7e00700 1 Processor -- start 2024-06-06T08:31:08.256 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.180+0000 7f30a7e00700 1 -- start start 2024-06-06T08:31:08.256 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.181+0000 7f30a7e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a810ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:08.256 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.181+0000 7f30a7e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f30a807c730 con 0x7f30a8108740 2024-06-06T08:31:08.257 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.181+0000 7f30a6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a810ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:08.257 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.181+0000 7f30a6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a810ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50436/0 (socket says 172.21.15.28:50436) 2024-06-06T08:31:08.257 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.181+0000 7f30a6a00700 1 -- 172.21.15.28:0/1687651575 learned_addr learned my addr 172.21.15.28:0/1687651575 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:08.257 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.182+0000 7f30a6a00700 1 -- 172.21.15.28:0/1687651575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a810b070 con 0x7f30a8108740 2024-06-06T08:31:08.257 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.182+0000 7f30a6a00700 1 --2- 172.21.15.28:0/1687651575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a810ab30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f309800b180 tx=0x7f309800b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb17bfe33c11f11 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:08.257 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.182+0000 7f30a5600700 1 -- 172.21.15.28:0/1687651575 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3098017070 con 0x7f30a8108740 2024-06-06T08:31:08.257 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.183+0000 7f30a5600700 1 -- 172.21.15.28:0/1687651575 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3098003a20 con 0x7f30a8108740 2024-06-06T08:31:08.257 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.183+0000 7f30a5600700 1 -- 172.21.15.28:0/1687651575 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3098004820 con 0x7f30a8108740 2024-06-06T08:31:08.258 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.183+0000 7f30a7e00700 1 -- 172.21.15.28:0/1687651575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 msgr2=0x7f30a810ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:08.258 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.183+0000 7f30a7e00700 1 --2- 172.21.15.28:0/1687651575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a810ab30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f309800b180 tx=0x7f309800b490 comp rx=0 tx=0).stop 2024-06-06T08:31:08.258 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.183+0000 7f30a7e00700 1 -- 172.21.15.28:0/1687651575 shutdown_connections 2024-06-06T08:31:08.258 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.183+0000 7f30a7e00700 1 --2- 172.21.15.28:0/1687651575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a810ab30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:08.258 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.183+0000 7f30a7e00700 1 -- 172.21.15.28:0/1687651575 >> 172.21.15.28:0/1687651575 conn(0x7f30a8102190 msgr2=0x7f30a81045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:08.258 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.184+0000 7f30a7e00700 1 -- 172.21.15.28:0/1687651575 shutdown_connections 2024-06-06T08:31:08.258 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.184+0000 7f30a7e00700 1 -- 172.21.15.28:0/1687651575 wait complete. 2024-06-06T08:31:08.258 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.185+0000 7f30a7e00700 1 Processor -- start 2024-06-06T08:31:08.258 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.185+0000 7f30a7e00700 1 -- start start 2024-06-06T08:31:08.258 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.185+0000 7f30a7e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a819bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.185+0000 7f30a7e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f30a810bfb0 con 0x7f30a8108740 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.185+0000 7f30a6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a819bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.185+0000 7f30a6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a819bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50440/0 (socket says 172.21.15.28:50440) 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.185+0000 7f30a6a00700 1 -- 172.21.15.28:0/1126950171 learned_addr learned my addr 172.21.15.28:0/1126950171 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.186+0000 7f30a6a00700 1 -- 172.21.15.28:0/1126950171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a819c0f0 con 0x7f30a8108740 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.186+0000 7f30a6a00700 1 --2- 172.21.15.28:0/1126950171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a819bbb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f30980043d0 tx=0x7f3098003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.186+0000 7f309f400700 1 -- 172.21.15.28:0/1126950171 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3098020020 con 0x7f30a8108740 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.186+0000 7f309f400700 1 -- 172.21.15.28:0/1126950171 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3098012990 con 0x7f30a8108740 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.186+0000 7f309f400700 1 -- 172.21.15.28:0/1126950171 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3098017040 con 0x7f30a8108740 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.186+0000 7f30a7e00700 1 -- 172.21.15.28:0/1126950171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a819c380 con 0x7f30a8108740 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.187+0000 7f30a7e00700 1 -- 172.21.15.28:0/1126950171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a819f070 con 0x7f30a8108740 2024-06-06T08:31:08.259 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.188+0000 7f309f400700 1 -- 172.21.15.28:0/1126950171 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3098023020 con 0x7f30a8108740 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.188+0000 7f30a7e00700 1 -- 172.21.15.28:0/1126950171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a8063af0 con 0x7f30a8108740 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.188+0000 7f309f400700 1 --2- 172.21.15.28:0/1126950171 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f308c0390a0 0x7f308c03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.188+0000 7f309f400700 1 -- 172.21.15.28:0/1126950171 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f309800f050 con 0x7f30a8108740 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.189+0000 7f30a6000700 1 --2- 172.21.15.28:0/1126950171 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f308c0390a0 0x7f308c03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.189+0000 7f30a6000700 1 --2- 172.21.15.28:0/1126950171 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f308c0390a0 0x7f308c03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3094006fd0 tx=0x7f3094006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.195+0000 7f309f400700 1 -- 172.21.15.28:0/1126950171 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f309802a020 con 0x7f30a8108740 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.439+0000 7f30a7e00700 1 -- 172.21.15.28:0/1126950171 --> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f30a8103400 con 0x7f308c0390a0 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.447+0000 7f309f400700 1 -- 172.21.15.28:0/1126950171 <== mgr.14120 v2:172.21.15.28:6800/2022015677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f30a8103400 con 0x7f308c0390a0 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.450+0000 7f30a7e00700 1 -- 172.21.15.28:0/1126950171 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f308c0390a0 msgr2=0x7f308c03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.450+0000 7f30a7e00700 1 --2- 172.21.15.28:0/1126950171 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f308c0390a0 0x7f308c03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3094006fd0 tx=0x7f3094006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.450+0000 7f30a7e00700 1 -- 172.21.15.28:0/1126950171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 msgr2=0x7f30a819bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.450+0000 7f30a7e00700 1 --2- 172.21.15.28:0/1126950171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a819bbb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f30980043d0 tx=0x7f3098003eb0 comp rx=0 tx=0).stop 2024-06-06T08:31:08.260 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.451+0000 7f30a7e00700 1 -- 172.21.15.28:0/1126950171 shutdown_connections 2024-06-06T08:31:08.261 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.451+0000 7f30a7e00700 1 --2- 172.21.15.28:0/1126950171 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f308c0390a0 0x7f308c03b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:08.261 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.451+0000 7f30a7e00700 1 --2- 172.21.15.28:0/1126950171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30a8108740 0x7f30a819bbb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:08.261 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.451+0000 7f30a7e00700 1 -- 172.21.15.28:0/1126950171 >> 172.21.15.28:0/1126950171 conn(0x7f30a8102190 msgr2=0x7f30a8102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:08.261 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.451+0000 7f30a7e00700 1 -- 172.21.15.28:0/1126950171 shutdown_connections 2024-06-06T08:31:08.261 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:07.451+0000 7f30a7e00700 1 -- 172.21.15.28:0/1126950171 wait complete. 2024-06-06T08:31:09.813 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout value unchanged 2024-06-06T08:31:09.813 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.908+0000 7f22bd600700 1 Processor -- start 2024-06-06T08:31:09.813 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.908+0000 7f22bd600700 1 -- start start 2024-06-06T08:31:09.813 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.909+0000 7f22bd600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b8108310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:09.813 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.909+0000 7f22bd600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22b8108850 con 0x7f22b8107ef0 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.909+0000 7f22b6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b8108310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.909+0000 7f22b6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b8108310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50442/0 (socket says 172.21.15.28:50442) 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.909+0000 7f22b6a00700 1 -- 172.21.15.28:0/198302530 learned_addr learned my addr 172.21.15.28:0/198302530 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.910+0000 7f22b6a00700 1 -- 172.21.15.28:0/198302530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b8108fb0 con 0x7f22b8107ef0 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.910+0000 7f22b6a00700 1 --2- 172.21.15.28:0/198302530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b8108310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f22a80098a0 tx=0x7f22a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94171e5b2339bac0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.911+0000 7f22b6000700 1 -- 172.21.15.28:0/198302530 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a8004160 con 0x7f22b8107ef0 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.911+0000 7f22b6000700 1 -- 172.21.15.28:0/198302530 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f22a8004300 con 0x7f22b8107ef0 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.911+0000 7f22b6000700 1 -- 172.21.15.28:0/198302530 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a8011b50 con 0x7f22b8107ef0 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.911+0000 7f22bd600700 1 -- 172.21.15.28:0/198302530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 msgr2=0x7f22b8108310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.911+0000 7f22bd600700 1 --2- 172.21.15.28:0/198302530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b8108310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f22a80098a0 tx=0x7f22a8009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.912+0000 7f22bd600700 1 -- 172.21.15.28:0/198302530 shutdown_connections 2024-06-06T08:31:09.814 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.912+0000 7f22bd600700 1 --2- 172.21.15.28:0/198302530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b8108310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.912+0000 7f22bd600700 1 -- 172.21.15.28:0/198302530 >> 172.21.15.28:0/198302530 conn(0x7f22b81034d0 msgr2=0x7f22b81058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.912+0000 7f22bd600700 1 -- 172.21.15.28:0/198302530 shutdown_connections 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.912+0000 7f22bd600700 1 -- 172.21.15.28:0/198302530 wait complete. 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.913+0000 7f22bd600700 1 Processor -- start 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.913+0000 7f22bd600700 1 -- start start 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.913+0000 7f22bd600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b819dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.913+0000 7f22bd600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22b810c270 con 0x7f22b8107ef0 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.914+0000 7f22b6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b819dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.914+0000 7f22b6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b819dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50448/0 (socket says 172.21.15.28:50448) 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.914+0000 7f22b6a00700 1 -- 172.21.15.28:0/1109576938 learned_addr learned my addr 172.21.15.28:0/1109576938 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.914+0000 7f22b6a00700 1 -- 172.21.15.28:0/1109576938 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b819e530 con 0x7f22b8107ef0 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.914+0000 7f22b6a00700 1 --2- 172.21.15.28:0/1109576938 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b819dff0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f22a8011b60 tx=0x7f22a8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.915+0000 7f22af400700 1 -- 172.21.15.28:0/1109576938 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a8003970 con 0x7f22b8107ef0 2024-06-06T08:31:09.815 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.915+0000 7f22af400700 1 -- 172.21.15.28:0/1109576938 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f22a8003b10 con 0x7f22b8107ef0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.915+0000 7f22bd600700 1 -- 172.21.15.28:0/1109576938 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b819e7c0 con 0x7f22b8107ef0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.915+0000 7f22af400700 1 -- 172.21.15.28:0/1109576938 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a8024610 con 0x7f22b8107ef0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.915+0000 7f22bd600700 1 -- 172.21.15.28:0/1109576938 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b81a14b0 con 0x7f22b8107ef0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.916+0000 7f22af400700 1 -- 172.21.15.28:0/1109576938 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f22a801a430 con 0x7f22b8107ef0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.916+0000 7f22bd600700 1 -- 172.21.15.28:0/1109576938 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b810c3f0 con 0x7f22b8107ef0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.916+0000 7f22af400700 1 --2- 172.21.15.28:0/1109576938 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f229c0390a0 0x7f229c03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.917+0000 7f22af400700 1 -- 172.21.15.28:0/1109576938 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f22a8011e00 con 0x7f22b8107ef0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.917+0000 7f22afe00700 1 --2- 172.21.15.28:0/1109576938 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f229c0390a0 0x7f229c03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.918+0000 7f22afe00700 1 --2- 172.21.15.28:0/1109576938 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f229c0390a0 0x7f229c03b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f22a0006fd0 tx=0x7f22a0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:08.922+0000 7f22af400700 1 -- 172.21.15.28:0/1109576938 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f22a8016260 con 0x7f22b8107ef0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.151+0000 7f22bd600700 1 -- 172.21.15.28:0/1109576938 --> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f22b8104680 con 0x7f229c0390a0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.153+0000 7f22af400700 1 -- 172.21.15.28:0/1109576938 <== mgr.14120 v2:172.21.15.28:6800/2022015677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f22b8104680 con 0x7f229c0390a0 2024-06-06T08:31:09.816 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.157+0000 7f22bd600700 1 -- 172.21.15.28:0/1109576938 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f229c0390a0 msgr2=0x7f229c03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:09.817 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.157+0000 7f22bd600700 1 --2- 172.21.15.28:0/1109576938 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f229c0390a0 0x7f229c03b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f22a0006fd0 tx=0x7f22a0006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:09.817 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.157+0000 7f22bd600700 1 -- 172.21.15.28:0/1109576938 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 msgr2=0x7f22b819dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:09.817 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.157+0000 7f22bd600700 1 --2- 172.21.15.28:0/1109576938 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b819dff0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f22a8011b60 tx=0x7f22a8011c40 comp rx=0 tx=0).stop 2024-06-06T08:31:09.817 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.157+0000 7f22bd600700 1 -- 172.21.15.28:0/1109576938 shutdown_connections 2024-06-06T08:31:09.817 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.157+0000 7f22bd600700 1 --2- 172.21.15.28:0/1109576938 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f229c0390a0 0x7f229c03b560 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:09.817 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.157+0000 7f22bd600700 1 --2- 172.21.15.28:0/1109576938 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22b8107ef0 0x7f22b819dff0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:09.817 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.157+0000 7f22bd600700 1 -- 172.21.15.28:0/1109576938 >> 172.21.15.28:0/1109576938 conn(0x7f22b81034d0 msgr2=0x7f22b8103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:09.817 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.158+0000 7f22bd600700 1 -- 172.21.15.28:0/1109576938 shutdown_connections 2024-06-06T08:31:09.817 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:09.158+0000 7f22bd600700 1 -- 172.21.15.28:0/1109576938 wait complete. 2024-06-06T08:31:09.817 INFO:teuthology.orchestra.run.smithi028.stdout:Generating ssh key... 2024-06-06T08:31:10.004 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:09 smithi028 ceph-mon[31564]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:31:10.933 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-mon[31564]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:31:10.933 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-mon[31564]: Generating ssh key... 2024-06-06T08:31:10.933 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: Generating public/private rsa key pair. 2024-06-06T08:31:10.934 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: Your identification has been saved in /tmp/tmpas6380pl/key. 2024-06-06T08:31:10.934 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: Your public key has been saved in /tmp/tmpas6380pl/key.pub. 2024-06-06T08:31:10.934 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: The key fingerprint is: 2024-06-06T08:31:10.934 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: SHA256:/UlioCvEuhOUFa0TdWYngz1QR+hiPoQ87zTVZl8OjiE ceph-e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:31:10.934 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: The key's randomart image is: 2024-06-06T08:31:10.934 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: +---[RSA 3072]----+ 2024-06-06T08:31:10.934 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: | .+o=Bo+ | 2024-06-06T08:31:10.934 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: | o o++= | 2024-06-06T08:31:10.934 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: | + + ..o | 2024-06-06T08:31:10.934 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: | o.* +.Eo= . . | 2024-06-06T08:31:10.934 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: | . oB.oS++=.+ | 2024-06-06T08:31:10.935 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: | .o *. ..+o.. | 2024-06-06T08:31:10.935 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: | ...o.o o | 2024-06-06T08:31:10.935 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: | .. .. | 2024-06-06T08:31:10.935 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: | .. | 2024-06-06T08:31:10.935 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: +----[SHA256]-----+ 2024-06-06T08:31:11.544 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.427+0000 7f67f1c00700 1 Processor -- start 2024-06-06T08:31:11.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.428+0000 7f67f1c00700 1 -- start start 2024-06-06T08:31:11.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.428+0000 7f67f1c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:11.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.428+0000 7f67f1c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec07c8c0 con 0x7f67ec07de90 2024-06-06T08:31:11.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.429+0000 7f67eaa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:11.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.429+0000 7f67eaa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec07c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50450/0 (socket says 172.21.15.28:50450) 2024-06-06T08:31:11.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.429+0000 7f67eaa00700 1 -- 172.21.15.28:0/4030389730 learned_addr learned my addr 172.21.15.28:0/4030389730 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:11.549 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.429+0000 7f67eaa00700 1 -- 172.21.15.28:0/4030389730 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec07ca40 con 0x7f67ec07de90 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.429+0000 7f67eaa00700 1 --2- 172.21.15.28:0/4030389730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec07c2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0098a0 tx=0x7f67dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd12cc7e8620c85 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.430+0000 7f67e9600700 1 -- 172.21.15.28:0/4030389730 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67dc004160 con 0x7f67ec07de90 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.430+0000 7f67e9600700 1 -- 172.21.15.28:0/4030389730 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67dc004300 con 0x7f67ec07de90 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.430+0000 7f67e9600700 1 -- 172.21.15.28:0/4030389730 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67dc011b50 con 0x7f67ec07de90 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.430+0000 7f67f1c00700 1 -- 172.21.15.28:0/4030389730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 msgr2=0x7f67ec07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.430+0000 7f67f1c00700 1 --2- 172.21.15.28:0/4030389730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec07c2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0098a0 tx=0x7f67dc009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.431+0000 7f67f1c00700 1 -- 172.21.15.28:0/4030389730 shutdown_connections 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.431+0000 7f67f1c00700 1 --2- 172.21.15.28:0/4030389730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec07c2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.431+0000 7f67f1c00700 1 -- 172.21.15.28:0/4030389730 >> 172.21.15.28:0/4030389730 conn(0x7f67ec103420 msgr2=0x7f67ec105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.431+0000 7f67f1c00700 1 -- 172.21.15.28:0/4030389730 shutdown_connections 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.431+0000 7f67f1c00700 1 -- 172.21.15.28:0/4030389730 wait complete. 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.432+0000 7f67f1c00700 1 Processor -- start 2024-06-06T08:31:11.550 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.432+0000 7f67f1c00700 1 -- start start 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.432+0000 7f67f1c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.432+0000 7f67f1c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec10e470 con 0x7f67ec07de90 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.432+0000 7f67eaa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.432+0000 7f67eaa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec19df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50452/0 (socket says 172.21.15.28:50452) 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.432+0000 7f67eaa00700 1 -- 172.21.15.28:0/3483653998 learned_addr learned my addr 172.21.15.28:0/3483653998 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.433+0000 7f67eaa00700 1 -- 172.21.15.28:0/3483653998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec19e4d0 con 0x7f67ec07de90 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.433+0000 7f67eaa00700 1 --2- 172.21.15.28:0/3483653998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec19df90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f67dc011b60 tx=0x7f67dc011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.433+0000 7f67e3400700 1 -- 172.21.15.28:0/3483653998 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67dc003b20 con 0x7f67ec07de90 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.433+0000 7f67e3400700 1 -- 172.21.15.28:0/3483653998 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67dc003cc0 con 0x7f67ec07de90 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.433+0000 7f67e3400700 1 -- 172.21.15.28:0/3483653998 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67dc024840 con 0x7f67ec07de90 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.433+0000 7f67f1c00700 1 -- 172.21.15.28:0/3483653998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ec19e760 con 0x7f67ec07de90 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.434+0000 7f67f1c00700 1 -- 172.21.15.28:0/3483653998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ec1a1450 con 0x7f67ec07de90 2024-06-06T08:31:11.551 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.435+0000 7f67f1c00700 1 -- 172.21.15.28:0/3483653998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67ec063af0 con 0x7f67ec07de90 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.435+0000 7f67e3400700 1 -- 172.21.15.28:0/3483653998 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f67dc022020 con 0x7f67ec07de90 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.436+0000 7f67e3400700 1 --2- 172.21.15.28:0/3483653998 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f67d0039050 0x7f67d003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.436+0000 7f67e3400700 1 -- 172.21.15.28:0/3483653998 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f67dc011e00 con 0x7f67ec07de90 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.436+0000 7f67ea000700 1 --2- 172.21.15.28:0/3483653998 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f67d0039050 0x7f67d003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.437+0000 7f67ea000700 1 --2- 172.21.15.28:0/3483653998 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f67d0039050 0x7f67d003b510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f67d8006fd0 tx=0x7f67d8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.441+0000 7f67e3400700 1 -- 172.21.15.28:0/3483653998 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f67dc01a950 con 0x7f67ec07de90 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.667+0000 7f67f1c00700 1 -- 172.21.15.28:0/3483653998 --> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f67ec104600 con 0x7f67d0039050 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.933+0000 7f67e3400700 1 -- 172.21.15.28:0/3483653998 <== mgr.14120 v2:172.21.15.28:6800/2022015677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f67ec104600 con 0x7f67d0039050 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.937+0000 7f67f1c00700 1 -- 172.21.15.28:0/3483653998 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f67d0039050 msgr2=0x7f67d003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.937+0000 7f67f1c00700 1 --2- 172.21.15.28:0/3483653998 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f67d0039050 0x7f67d003b510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f67d8006fd0 tx=0x7f67d8006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.937+0000 7f67f1c00700 1 -- 172.21.15.28:0/3483653998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 msgr2=0x7f67ec19df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.937+0000 7f67f1c00700 1 --2- 172.21.15.28:0/3483653998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec19df90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f67dc011b60 tx=0x7f67dc011c40 comp rx=0 tx=0).stop 2024-06-06T08:31:11.552 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.937+0000 7f67f1c00700 1 -- 172.21.15.28:0/3483653998 shutdown_connections 2024-06-06T08:31:11.553 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.937+0000 7f67f1c00700 1 --2- 172.21.15.28:0/3483653998 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f67d0039050 0x7f67d003b510 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:11.553 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.937+0000 7f67f1c00700 1 --2- 172.21.15.28:0/3483653998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67ec07de90 0x7f67ec19df90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:11.553 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.937+0000 7f67f1c00700 1 -- 172.21.15.28:0/3483653998 >> 172.21.15.28:0/3483653998 conn(0x7f67ec103420 msgr2=0x7f67ec103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:11.553 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.937+0000 7f67f1c00700 1 -- 172.21.15.28:0/3483653998 shutdown_connections 2024-06-06T08:31:11.553 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:10.937+0000 7f67f1c00700 1 -- 172.21.15.28:0/3483653998 wait complete. 2024-06-06T08:31:12.145 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:11 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:12.145 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:11 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:13.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:12 smithi028 ceph-mon[31564]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:31:13.087 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU4eikog6Ahx7rqmhxCoHCZWGPm6g1dgL8NUdJ6Ka0NsQrZuOK4pzuMWvS3FGT+EdqYDzFWiBZRDv/dZARtQfEZaYhlYmU1RDEb4xpw0wEPUFWeKCWXBFI8NbToxiinIaxbPqbfw31KDIMPuMk+RQay7DwBAWG8S4WXYRIzGdWmPF5kNabTe0qyx4vBZtjlEv7nr4/T48/xvl7109HYLF6udlcJWmI+vlNLR4O//Q/RHVfwkIZIwccj5beFxRimjoy0N4pzZI3SZDxQCFbr5FllDhm3azYy4vk9+aaGm7hKQuPA62MgkoEgQg91a+meC+ANwF+NMoitBFU/xHjiBao1ciSwoIrstXYkOPDGzAmSzBq00NGPfnh5c8C1+88nbK1Vi6Fe9Ra2dE+TtxqLaBmQDDPqgafyYndtQPnH058cGeeze5mFGrt5aMGYldPCWFzonhegMwRLDkY4kAm0/Obywk6k78ojVxeFPz+f/POH4BI/1J7RkOqPm4rMPT+BlM= ceph-e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:31:13.088 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.145+0000 7ff942a00700 1 Processor -- start 2024-06-06T08:31:13.088 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.145+0000 7ff942a00700 1 -- start start 2024-06-06T08:31:13.088 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.146+0000 7ff942a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c07c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:13.089 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.146+0000 7ff942a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff93c07c920 con 0x7ff93c07def0 2024-06-06T08:31:13.089 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.146+0000 7ff941600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c07c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:13.089 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.146+0000 7ff941600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c07c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50462/0 (socket says 172.21.15.28:50462) 2024-06-06T08:31:13.089 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.146+0000 7ff941600700 1 -- 172.21.15.28:0/2005134864 learned_addr learned my addr 172.21.15.28:0/2005134864 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:13.089 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.147+0000 7ff941600700 1 -- 172.21.15.28:0/2005134864 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c07caa0 con 0x7ff93c07def0 2024-06-06T08:31:13.089 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.147+0000 7ff941600700 1 --2- 172.21.15.28:0/2005134864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c07c350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff930009e80 tx=0x7ff93000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3c1bbee99689be server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:13.089 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.148+0000 7ff93be00700 1 -- 172.21.15.28:0/2005134864 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff930017070 con 0x7ff93c07def0 2024-06-06T08:31:13.089 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.148+0000 7ff93be00700 1 -- 172.21.15.28:0/2005134864 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff93000b8c0 con 0x7ff93c07def0 2024-06-06T08:31:13.090 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.148+0000 7ff93be00700 1 -- 172.21.15.28:0/2005134864 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9300045c0 con 0x7ff93c07def0 2024-06-06T08:31:13.092 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.148+0000 7ff942a00700 1 -- 172.21.15.28:0/2005134864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 msgr2=0x7ff93c07c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:13.092 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.148+0000 7ff942a00700 1 --2- 172.21.15.28:0/2005134864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c07c350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff930009e80 tx=0x7ff93000b330 comp rx=0 tx=0).stop 2024-06-06T08:31:13.092 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.149+0000 7ff942a00700 1 -- 172.21.15.28:0/2005134864 shutdown_connections 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.149+0000 7ff942a00700 1 --2- 172.21.15.28:0/2005134864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c07c350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.149+0000 7ff942a00700 1 -- 172.21.15.28:0/2005134864 >> 172.21.15.28:0/2005134864 conn(0x7ff93c1032f0 msgr2=0x7ff93c105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.149+0000 7ff942a00700 1 -- 172.21.15.28:0/2005134864 shutdown_connections 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.149+0000 7ff942a00700 1 -- 172.21.15.28:0/2005134864 wait complete. 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.150+0000 7ff942a00700 1 Processor -- start 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.150+0000 7ff942a00700 1 -- start start 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.150+0000 7ff942a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c19de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.150+0000 7ff942a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff93c10e270 con 0x7ff93c07def0 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.151+0000 7ff941600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c19de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.151+0000 7ff941600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c19de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50478/0 (socket says 172.21.15.28:50478) 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.151+0000 7ff941600700 1 -- 172.21.15.28:0/909635846 learned_addr learned my addr 172.21.15.28:0/909635846 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.151+0000 7ff941600700 1 -- 172.21.15.28:0/909635846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c19e3d0 con 0x7ff93c07def0 2024-06-06T08:31:13.093 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.151+0000 7ff941600700 1 --2- 172.21.15.28:0/909635846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c19de90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff930004210 tx=0x7ff93000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:13.094 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.152+0000 7ff93a000700 1 -- 172.21.15.28:0/909635846 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff930020020 con 0x7ff93c07def0 2024-06-06T08:31:13.094 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.152+0000 7ff93a000700 1 -- 172.21.15.28:0/909635846 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff930003b50 con 0x7ff93c07def0 2024-06-06T08:31:13.094 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.152+0000 7ff93a000700 1 -- 172.21.15.28:0/909635846 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff930017040 con 0x7ff93c07def0 2024-06-06T08:31:13.094 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.152+0000 7ff942a00700 1 -- 172.21.15.28:0/909635846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93c19e660 con 0x7ff93c07def0 2024-06-06T08:31:13.094 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.152+0000 7ff942a00700 1 -- 172.21.15.28:0/909635846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff93c1a1350 con 0x7ff93c07def0 2024-06-06T08:31:13.094 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.153+0000 7ff93a000700 1 -- 172.21.15.28:0/909635846 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff930023020 con 0x7ff93c07def0 2024-06-06T08:31:13.094 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.153+0000 7ff942a00700 1 -- 172.21.15.28:0/909635846 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff93c063af0 con 0x7ff93c07def0 2024-06-06T08:31:13.094 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.154+0000 7ff93a000700 1 --2- 172.21.15.28:0/909635846 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7ff9240390a0 0x7ff92403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:13.094 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.154+0000 7ff93a000700 1 -- 172.21.15.28:0/909635846 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff93000f050 con 0x7ff93c07def0 2024-06-06T08:31:13.096 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.154+0000 7ff940c00700 1 --2- 172.21.15.28:0/909635846 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7ff9240390a0 0x7ff92403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:13.096 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.155+0000 7ff940c00700 1 --2- 172.21.15.28:0/909635846 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7ff9240390a0 0x7ff92403b560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff928006fd0 tx=0x7ff928006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:13.096 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.159+0000 7ff93a000700 1 -- 172.21.15.28:0/909635846 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff93002a020 con 0x7ff93c07def0 2024-06-06T08:31:13.096 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.390+0000 7ff942a00700 1 -- 172.21.15.28:0/909635846 --> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7ff93c104560 con 0x7ff9240390a0 2024-06-06T08:31:13.096 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.392+0000 7ff93a000700 1 -- 172.21.15.28:0/909635846 <== mgr.14120 v2:172.21.15.28:6800/2022015677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7ff93c104560 con 0x7ff9240390a0 2024-06-06T08:31:13.096 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.394+0000 7ff942a00700 1 -- 172.21.15.28:0/909635846 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7ff9240390a0 msgr2=0x7ff92403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:13.097 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.394+0000 7ff942a00700 1 --2- 172.21.15.28:0/909635846 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7ff9240390a0 0x7ff92403b560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff928006fd0 tx=0x7ff928006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:13.097 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.395+0000 7ff942a00700 1 -- 172.21.15.28:0/909635846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 msgr2=0x7ff93c19de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:13.097 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.395+0000 7ff942a00700 1 --2- 172.21.15.28:0/909635846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c19de90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff930004210 tx=0x7ff93000bd50 comp rx=0 tx=0).stop 2024-06-06T08:31:13.097 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.395+0000 7ff942a00700 1 -- 172.21.15.28:0/909635846 shutdown_connections 2024-06-06T08:31:13.097 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.395+0000 7ff942a00700 1 --2- 172.21.15.28:0/909635846 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7ff9240390a0 0x7ff92403b560 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:13.097 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.395+0000 7ff942a00700 1 --2- 172.21.15.28:0/909635846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff93c07def0 0x7ff93c19de90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:13.097 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.395+0000 7ff942a00700 1 -- 172.21.15.28:0/909635846 >> 172.21.15.28:0/909635846 conn(0x7ff93c1032f0 msgr2=0x7ff93c103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:13.097 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.395+0000 7ff942a00700 1 -- 172.21.15.28:0/909635846 shutdown_connections 2024-06-06T08:31:13.097 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:12.395+0000 7ff942a00700 1 -- 172.21.15.28:0/909635846 wait complete. 2024-06-06T08:31:13.097 INFO:teuthology.orchestra.run.smithi028.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-06-06T08:31:13.097 INFO:teuthology.orchestra.run.smithi028.stdout:Adding key to root@localhost authorized_keys... 2024-06-06T08:31:13.098 INFO:teuthology.orchestra.run.smithi028.stdout:Adding host smithi028... 2024-06-06T08:31:15.001 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:14 smithi028 ceph-mon[31564]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi028", "addr": "172.21.15.28", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:31:15.937 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:15 smithi028 ceph-mon[31564]: Deploying cephadm binary to smithi028 2024-06-06T08:31:21.067 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout Added host 'smithi028' with addr '172.21.15.28' 2024-06-06T08:31:21.067 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.734+0000 7f3dfa600700 1 Processor -- start 2024-06-06T08:31:21.067 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.734+0000 7f3dfa600700 1 -- start start 2024-06-06T08:31:21.067 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.735+0000 7f3dfa600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:21.067 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.735+0000 7f3dfa600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3df407d170 con 0x7f3df407e740 2024-06-06T08:31:21.067 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.735+0000 7f3df3400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:21.067 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.735+0000 7f3df3400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df407cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50494/0 (socket says 172.21.15.28:50494) 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.735+0000 7f3df3400700 1 -- 172.21.15.28:0/1789973081 learned_addr learned my addr 172.21.15.28:0/1789973081 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.736+0000 7f3df3400700 1 -- 172.21.15.28:0/1789973081 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df407d2f0 con 0x7f3df407e740 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.736+0000 7f3df3400700 1 --2- 172.21.15.28:0/1789973081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df407cba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3de40098a0 tx=0x7f3de4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b683ffd8ce16c822 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.736+0000 7f3df2000700 1 -- 172.21.15.28:0/1789973081 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3de4004160 con 0x7f3df407e740 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.736+0000 7f3df2000700 1 -- 172.21.15.28:0/1789973081 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3de4004300 con 0x7f3df407e740 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.736+0000 7f3df2000700 1 -- 172.21.15.28:0/1789973081 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3de4011b50 con 0x7f3df407e740 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.737+0000 7f3dfa600700 1 -- 172.21.15.28:0/1789973081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 msgr2=0x7f3df407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.737+0000 7f3dfa600700 1 --2- 172.21.15.28:0/1789973081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df407cba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3de40098a0 tx=0x7f3de4009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.737+0000 7f3dfa600700 1 -- 172.21.15.28:0/1789973081 shutdown_connections 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.737+0000 7f3dfa600700 1 --2- 172.21.15.28:0/1789973081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df407cba0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.737+0000 7f3dfa600700 1 -- 172.21.15.28:0/1789973081 >> 172.21.15.28:0/1789973081 conn(0x7f3df4103420 msgr2=0x7f3df4105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.738+0000 7f3dfa600700 1 -- 172.21.15.28:0/1789973081 shutdown_connections 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.738+0000 7f3dfa600700 1 -- 172.21.15.28:0/1789973081 wait complete. 2024-06-06T08:31:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.739+0000 7f3dfa600700 1 Processor -- start 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.739+0000 7f3dfa600700 1 -- start start 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.739+0000 7f3dfa600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.739+0000 7f3dfa600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3df410e410 con 0x7f3df407e740 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.740+0000 7f3df3400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.740+0000 7f3df3400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df419dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50510/0 (socket says 172.21.15.28:50510) 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.740+0000 7f3df3400700 1 -- 172.21.15.28:0/2840316296 learned_addr learned my addr 172.21.15.28:0/2840316296 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.740+0000 7f3df3400700 1 -- 172.21.15.28:0/2840316296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df419e530 con 0x7f3df407e740 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.740+0000 7f3df3400700 1 --2- 172.21.15.28:0/2840316296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df419dff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3de4011850 tx=0x7f3de4011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.741+0000 7f3debe00700 1 -- 172.21.15.28:0/2840316296 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3de4003af0 con 0x7f3df407e740 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.741+0000 7f3debe00700 1 -- 172.21.15.28:0/2840316296 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3de4020070 con 0x7f3df407e740 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.741+0000 7f3dfa600700 1 -- 172.21.15.28:0/2840316296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df419e7c0 con 0x7f3df407e740 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.741+0000 7f3debe00700 1 -- 172.21.15.28:0/2840316296 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3de40195a0 con 0x7f3df407e740 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.741+0000 7f3dfa600700 1 -- 172.21.15.28:0/2840316296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df41a14b0 con 0x7f3df407e740 2024-06-06T08:31:21.069 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.742+0000 7f3dfa600700 1 -- 172.21.15.28:0/2840316296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df4063af0 con 0x7f3df407e740 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.743+0000 7f3debe00700 1 -- 172.21.15.28:0/2840316296 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3de4019850 con 0x7f3df407e740 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.743+0000 7f3debe00700 1 --2- 172.21.15.28:0/2840316296 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3dd80390a0 0x7f3dd803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.743+0000 7f3debe00700 1 -- 172.21.15.28:0/2840316296 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3de4011e00 con 0x7f3df407e740 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.744+0000 7f3df2a00700 1 --2- 172.21.15.28:0/2840316296 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3dd80390a0 0x7f3dd803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.745+0000 7f3df2a00700 1 --2- 172.21.15.28:0/2840316296 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3dd80390a0 0x7f3dd803b560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3de0006fd0 tx=0x7f3de0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.749+0000 7f3debe00700 1 -- 172.21.15.28:0/2840316296 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3de402a070 con 0x7f3df407e740 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:13.982+0000 7f3dfa600700 1 -- 172.21.15.28:0/2840316296 --> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi028", "addr": "172.21.15.28", "target": ["mon-mgr", ""]}) -- 0x7f3df41046a0 con 0x7f3dd80390a0 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:20.401+0000 7f3debe00700 1 -- 172.21.15.28:0/2840316296 <== mgr.14120 v2:172.21.15.28:6800/2022015677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f3df41046a0 con 0x7f3dd80390a0 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:20.405+0000 7f3dfa600700 1 -- 172.21.15.28:0/2840316296 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3dd80390a0 msgr2=0x7f3dd803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:20.405+0000 7f3dfa600700 1 --2- 172.21.15.28:0/2840316296 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3dd80390a0 0x7f3dd803b560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3de0006fd0 tx=0x7f3de0006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:20.405+0000 7f3dfa600700 1 -- 172.21.15.28:0/2840316296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 msgr2=0x7f3df419dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:21.070 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:20.405+0000 7f3dfa600700 1 --2- 172.21.15.28:0/2840316296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df419dff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3de4011850 tx=0x7f3de4011c10 comp rx=0 tx=0).stop 2024-06-06T08:31:21.071 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:20.405+0000 7f3dfa600700 1 -- 172.21.15.28:0/2840316296 shutdown_connections 2024-06-06T08:31:21.071 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:20.405+0000 7f3dfa600700 1 --2- 172.21.15.28:0/2840316296 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3dd80390a0 0x7f3dd803b560 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:21.071 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:20.405+0000 7f3dfa600700 1 --2- 172.21.15.28:0/2840316296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3df407e740 0x7f3df419dff0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:21.071 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:20.405+0000 7f3dfa600700 1 -- 172.21.15.28:0/2840316296 >> 172.21.15.28:0/2840316296 conn(0x7f3df4103420 msgr2=0x7f3df4103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:21.071 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:20.405+0000 7f3dfa600700 1 -- 172.21.15.28:0/2840316296 shutdown_connections 2024-06-06T08:31:21.071 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:20.405+0000 7f3dfa600700 1 -- 172.21.15.28:0/2840316296 wait complete. 2024-06-06T08:31:21.071 INFO:teuthology.orchestra.run.smithi028.stdout:Deploying unmanaged mon service... 2024-06-06T08:31:21.684 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:21 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:21.684 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:21 smithi028 ceph-mon[31564]: Added host smithi028 2024-06-06T08:31:21.684 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:21 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:31:23.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:22 smithi028 ceph-mon[31564]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:31:23.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:22 smithi028 ceph-mon[31564]: Saving service mon spec with placement count:5 2024-06-06T08:31:23.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:22 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:23.663 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-06-06T08:31:23.663 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.721+0000 7fadebe00700 1 Processor -- start 2024-06-06T08:31:23.663 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.721+0000 7fadebe00700 1 -- start start 2024-06-06T08:31:23.663 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.722+0000 7fadebe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:23.663 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.722+0000 7fadebe00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fadec07d170 con 0x7fadec07e740 2024-06-06T08:31:23.663 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.723+0000 7fadeaa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:23.663 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.723+0000 7fadeaa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec07cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:37642/0 (socket says 172.21.15.28:37642) 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.723+0000 7fadeaa00700 1 -- 172.21.15.28:0/709998826 learned_addr learned my addr 172.21.15.28:0/709998826 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.723+0000 7fadeaa00700 1 -- 172.21.15.28:0/709998826 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadec07d2f0 con 0x7fadec07e740 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.723+0000 7fadeaa00700 1 --2- 172.21.15.28:0/709998826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec07cba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faddc0098a0 tx=0x7faddc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50fabd23b77ddcc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.724+0000 7fade9600700 1 -- 172.21.15.28:0/709998826 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faddc004160 con 0x7fadec07e740 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.724+0000 7fade9600700 1 -- 172.21.15.28:0/709998826 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faddc004300 con 0x7fadec07e740 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.724+0000 7fade9600700 1 -- 172.21.15.28:0/709998826 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faddc011b50 con 0x7fadec07e740 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.725+0000 7fadebe00700 1 -- 172.21.15.28:0/709998826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 msgr2=0x7fadec07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.725+0000 7fadebe00700 1 --2- 172.21.15.28:0/709998826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec07cba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faddc0098a0 tx=0x7faddc009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.725+0000 7fadebe00700 1 -- 172.21.15.28:0/709998826 shutdown_connections 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.725+0000 7fadebe00700 1 --2- 172.21.15.28:0/709998826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec07cba0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.725+0000 7fadebe00700 1 -- 172.21.15.28:0/709998826 >> 172.21.15.28:0/709998826 conn(0x7fadec1032e0 msgr2=0x7fadec105700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.725+0000 7fadebe00700 1 -- 172.21.15.28:0/709998826 shutdown_connections 2024-06-06T08:31:23.664 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.725+0000 7fadebe00700 1 -- 172.21.15.28:0/709998826 wait complete. 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.726+0000 7fadebe00700 1 Processor -- start 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.726+0000 7fadebe00700 1 -- start start 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.727+0000 7fadebe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec19dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.727+0000 7fadebe00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fadec10e250 con 0x7fadec07e740 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.727+0000 7fadeaa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec19dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.727+0000 7fadeaa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec19dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:37652/0 (socket says 172.21.15.28:37652) 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.727+0000 7fadeaa00700 1 -- 172.21.15.28:0/3983488000 learned_addr learned my addr 172.21.15.28:0/3983488000 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.727+0000 7fadeaa00700 1 -- 172.21.15.28:0/3983488000 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadec19e2e0 con 0x7fadec07e740 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.728+0000 7fadeaa00700 1 --2- 172.21.15.28:0/3983488000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec19dda0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faddc000c00 tx=0x7faddc011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.728+0000 7fade3400700 1 -- 172.21.15.28:0/3983488000 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faddc003b20 con 0x7fadec07e740 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.728+0000 7fade3400700 1 -- 172.21.15.28:0/3983488000 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faddc003cc0 con 0x7fadec07e740 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.728+0000 7fade3400700 1 -- 172.21.15.28:0/3983488000 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faddc024910 con 0x7fadec07e740 2024-06-06T08:31:23.665 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.728+0000 7fadebe00700 1 -- 172.21.15.28:0/3983488000 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadec19e570 con 0x7fadec07e740 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.728+0000 7fadebe00700 1 -- 172.21.15.28:0/3983488000 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadec1a1260 con 0x7fadec07e740 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.729+0000 7fadebe00700 1 -- 172.21.15.28:0/3983488000 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadec063af0 con 0x7fadec07e740 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.730+0000 7fade3400700 1 -- 172.21.15.28:0/3983488000 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7faddc022020 con 0x7fadec07e740 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.730+0000 7fade3400700 1 --2- 172.21.15.28:0/3983488000 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fadd00390a0 0x7fadd003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.730+0000 7fade3400700 1 -- 172.21.15.28:0/3983488000 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faddc011e00 con 0x7fadec07e740 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.730+0000 7fadea000700 1 --2- 172.21.15.28:0/3983488000 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fadd00390a0 0x7fadd003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.731+0000 7fadea000700 1 --2- 172.21.15.28:0/3983488000 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fadd00390a0 0x7fadd003b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fadd8006fd0 tx=0x7fadd8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.736+0000 7fade3400700 1 -- 172.21.15.28:0/3983488000 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faddc01ad80 con 0x7fadec07e740 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.984+0000 7fadebe00700 1 -- 172.21.15.28:0/3983488000 --> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fadec1044d0 con 0x7fadd00390a0 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.992+0000 7fade3400700 1 -- 172.21.15.28:0/3983488000 <== mgr.14120 v2:172.21.15.28:6800/2022015677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fadec1044d0 con 0x7fadd00390a0 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.995+0000 7fadebe00700 1 -- 172.21.15.28:0/3983488000 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fadd00390a0 msgr2=0x7fadd003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:23.666 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.995+0000 7fadebe00700 1 --2- 172.21.15.28:0/3983488000 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fadd00390a0 0x7fadd003b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fadd8006fd0 tx=0x7fadd8006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:23.667 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.995+0000 7fadebe00700 1 -- 172.21.15.28:0/3983488000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 msgr2=0x7fadec19dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:23.667 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.995+0000 7fadebe00700 1 --2- 172.21.15.28:0/3983488000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec19dda0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faddc000c00 tx=0x7faddc011c10 comp rx=0 tx=0).stop 2024-06-06T08:31:23.667 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.995+0000 7fadebe00700 1 -- 172.21.15.28:0/3983488000 shutdown_connections 2024-06-06T08:31:23.667 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.995+0000 7fadebe00700 1 --2- 172.21.15.28:0/3983488000 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fadd00390a0 0x7fadd003b560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:23.667 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.995+0000 7fadebe00700 1 --2- 172.21.15.28:0/3983488000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadec07e740 0x7fadec19dda0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:23.667 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.995+0000 7fadebe00700 1 -- 172.21.15.28:0/3983488000 >> 172.21.15.28:0/3983488000 conn(0x7fadec1032e0 msgr2=0x7fadec103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:23.667 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.996+0000 7fadebe00700 1 -- 172.21.15.28:0/3983488000 shutdown_connections 2024-06-06T08:31:23.667 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:21.996+0000 7fadebe00700 1 -- 172.21.15.28:0/3983488000 wait complete. 2024-06-06T08:31:23.667 INFO:teuthology.orchestra.run.smithi028.stdout:Deploying unmanaged mgr service... 2024-06-06T08:31:24.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:24 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:24.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:24 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:25.304 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-06-06T08:31:25.304 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.292+0000 7f958f600700 1 Processor -- start 2024-06-06T08:31:25.304 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.292+0000 7f958f600700 1 -- start start 2024-06-06T08:31:25.304 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.292+0000 7f958f600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f958810ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:25.304 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.292+0000 7f958f600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f958807be60 con 0x7f9588108990 2024-06-06T08:31:25.305 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.293+0000 7f958cc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f958810ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:25.305 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.293+0000 7f958cc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f958810ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:37656/0 (socket says 172.21.15.28:37656) 2024-06-06T08:31:25.305 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.293+0000 7f958cc00700 1 -- 172.21.15.28:0/4187787969 learned_addr learned my addr 172.21.15.28:0/4187787969 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:25.305 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.293+0000 7f958cc00700 1 -- 172.21.15.28:0/4187787969 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958810b2c0 con 0x7f9588108990 2024-06-06T08:31:25.305 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.294+0000 7f958cc00700 1 --2- 172.21.15.28:0/4187787969 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f958810ad80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f957c0098a0 tx=0x7f957c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff778aea04a7ff78 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:25.305 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.294+0000 7f9587400700 1 -- 172.21.15.28:0/4187787969 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c004160 con 0x7f9588108990 2024-06-06T08:31:25.305 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.294+0000 7f9587400700 1 -- 172.21.15.28:0/4187787969 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f957c004300 con 0x7f9588108990 2024-06-06T08:31:25.305 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.294+0000 7f9587400700 1 -- 172.21.15.28:0/4187787969 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c011b20 con 0x7f9588108990 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.295+0000 7f958f600700 1 -- 172.21.15.28:0/4187787969 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 msgr2=0x7f958810ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.295+0000 7f958f600700 1 --2- 172.21.15.28:0/4187787969 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f958810ad80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f957c0098a0 tx=0x7f957c009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.295+0000 7f958f600700 1 -- 172.21.15.28:0/4187787969 shutdown_connections 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.295+0000 7f958f600700 1 --2- 172.21.15.28:0/4187787969 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f958810ad80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.295+0000 7f958f600700 1 -- 172.21.15.28:0/4187787969 >> 172.21.15.28:0/4187787969 conn(0x7f9588102340 msgr2=0x7f95881047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.295+0000 7f958f600700 1 -- 172.21.15.28:0/4187787969 shutdown_connections 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.295+0000 7f958f600700 1 -- 172.21.15.28:0/4187787969 wait complete. 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.296+0000 7f958f600700 1 Processor -- start 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.296+0000 7f958f600700 1 -- start start 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.296+0000 7f958f600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f9588108210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.296+0000 7f958f600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f958810c2d0 con 0x7f9588108990 2024-06-06T08:31:25.306 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.297+0000 7f958cc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f9588108210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.297+0000 7f958cc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f9588108210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:37658/0 (socket says 172.21.15.28:37658) 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.297+0000 7f958cc00700 1 -- 172.21.15.28:0/2768257348 learned_addr learned my addr 172.21.15.28:0/2768257348 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.297+0000 7f958cc00700 1 -- 172.21.15.28:0/2768257348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9588108750 con 0x7f9588108990 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.298+0000 7f958cc00700 1 --2- 172.21.15.28:0/2768257348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f9588108210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f957c0117e0 tx=0x7f957c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.298+0000 7f9585600700 1 -- 172.21.15.28:0/2768257348 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c003ba0 con 0x7f9588108990 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.298+0000 7f9585600700 1 -- 172.21.15.28:0/2768257348 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f957c01a910 con 0x7f9588108990 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.298+0000 7f9585600700 1 -- 172.21.15.28:0/2768257348 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c0248f0 con 0x7f9588108990 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.298+0000 7f958f600700 1 -- 172.21.15.28:0/2768257348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9588106940 con 0x7f9588108990 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.298+0000 7f958f600700 1 -- 172.21.15.28:0/2768257348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9588106e00 con 0x7f9588108990 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.299+0000 7f958f600700 1 -- 172.21.15.28:0/2768257348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9588063af0 con 0x7f9588108990 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.300+0000 7f9585600700 1 -- 172.21.15.28:0/2768257348 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f957c022020 con 0x7f9588108990 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.301+0000 7f9585600700 1 --2- 172.21.15.28:0/2768257348 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f95700390a0 0x7f957003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:25.307 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.301+0000 7f9585600700 1 -- 172.21.15.28:0/2768257348 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f957c04d530 con 0x7f9588108990 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.301+0000 7f9587e00700 1 --2- 172.21.15.28:0/2768257348 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f95700390a0 0x7f957003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.302+0000 7f9587e00700 1 --2- 172.21.15.28:0/2768257348 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f95700390a0 0x7f957003b560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9574006fd0 tx=0x7f9574006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.306+0000 7f9585600700 1 -- 172.21.15.28:0/2768257348 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f957c01ab70 con 0x7f9588108990 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.566+0000 7f958f600700 1 -- 172.21.15.28:0/2768257348 --> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f95881075c0 con 0x7f95700390a0 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.570+0000 7f9585600700 1 -- 172.21.15.28:0/2768257348 <== mgr.14120 v2:172.21.15.28:6800/2022015677 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f95881075c0 con 0x7f95700390a0 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.573+0000 7f958f600700 1 -- 172.21.15.28:0/2768257348 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f95700390a0 msgr2=0x7f957003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.573+0000 7f958f600700 1 --2- 172.21.15.28:0/2768257348 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f95700390a0 0x7f957003b560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9574006fd0 tx=0x7f9574006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.573+0000 7f958f600700 1 -- 172.21.15.28:0/2768257348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 msgr2=0x7f9588108210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.573+0000 7f958f600700 1 --2- 172.21.15.28:0/2768257348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f9588108210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f957c0117e0 tx=0x7f957c011ba0 comp rx=0 tx=0).stop 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.573+0000 7f958f600700 1 -- 172.21.15.28:0/2768257348 shutdown_connections 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.573+0000 7f958f600700 1 --2- 172.21.15.28:0/2768257348 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f95700390a0 0x7f957003b560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.573+0000 7f958f600700 1 --2- 172.21.15.28:0/2768257348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9588108990 0x7f9588108210 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:25.308 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.573+0000 7f958f600700 1 -- 172.21.15.28:0/2768257348 >> 172.21.15.28:0/2768257348 conn(0x7f9588102340 msgr2=0x7f9588102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:25.309 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.573+0000 7f958f600700 1 -- 172.21.15.28:0/2768257348 shutdown_connections 2024-06-06T08:31:25.309 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:24.573+0000 7f958f600700 1 -- 172.21.15.28:0/2768257348 wait complete. 2024-06-06T08:31:25.878 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:25 smithi028 ceph-mon[31564]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:31:25.879 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:25 smithi028 ceph-mon[31564]: Saving service mgr spec with placement count:2 2024-06-06T08:31:25.879 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:25 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:26.839 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:26 smithi028 ceph-mon[31564]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:31:26.839 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:26 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1143048009' entity='client.admin' 2024-06-06T08:31:27.398 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.967+0000 7f8548a00700 1 Processor -- start 2024-06-06T08:31:27.398 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.968+0000 7f8548a00700 1 -- start start 2024-06-06T08:31:27.398 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.968+0000 7f8548a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854407c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:27.398 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.968+0000 7f8548a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f854407c8e0 con 0x7f854407deb0 2024-06-06T08:31:27.398 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.968+0000 7f8541e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854407c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:27.398 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.969+0000 7f8541e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854407c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60058/0 (socket says 172.21.15.28:60058) 2024-06-06T08:31:27.399 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.969+0000 7f8541e00700 1 -- 172.21.15.28:0/1602926961 learned_addr learned my addr 172.21.15.28:0/1602926961 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:27.399 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.969+0000 7f8541e00700 1 -- 172.21.15.28:0/1602926961 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854407ca60 con 0x7f854407deb0 2024-06-06T08:31:27.399 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.970+0000 7f8541e00700 1 --2- 172.21.15.28:0/1602926961 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854407c310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85340098a0 tx=0x7f8534009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9b28c74ab9562b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:27.399 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.970+0000 7f8540a00700 1 -- 172.21.15.28:0/1602926961 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534004160 con 0x7f854407deb0 2024-06-06T08:31:27.399 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.970+0000 7f8540a00700 1 -- 172.21.15.28:0/1602926961 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8534004300 con 0x7f854407deb0 2024-06-06T08:31:27.399 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.970+0000 7f8540a00700 1 -- 172.21.15.28:0/1602926961 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534011b20 con 0x7f854407deb0 2024-06-06T08:31:27.399 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.971+0000 7f8548a00700 1 -- 172.21.15.28:0/1602926961 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 msgr2=0x7f854407c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:27.399 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.971+0000 7f8548a00700 1 --2- 172.21.15.28:0/1602926961 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854407c310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85340098a0 tx=0x7f8534009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:27.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.971+0000 7f8548a00700 1 -- 172.21.15.28:0/1602926961 shutdown_connections 2024-06-06T08:31:27.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.971+0000 7f8548a00700 1 --2- 172.21.15.28:0/1602926961 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854407c310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:27.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.971+0000 7f8548a00700 1 -- 172.21.15.28:0/1602926961 >> 172.21.15.28:0/1602926961 conn(0x7f8544103420 msgr2=0x7f8544105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:27.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.971+0000 7f8548a00700 1 -- 172.21.15.28:0/1602926961 shutdown_connections 2024-06-06T08:31:27.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.971+0000 7f8548a00700 1 -- 172.21.15.28:0/1602926961 wait complete. 2024-06-06T08:31:27.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.972+0000 7f8548a00700 1 Processor -- start 2024-06-06T08:31:27.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.972+0000 7f8548a00700 1 -- start start 2024-06-06T08:31:27.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.972+0000 7f8548a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854419df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:27.404 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.973+0000 7f8548a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f854410e500 con 0x7f854407deb0 2024-06-06T08:31:27.405 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.973+0000 7f8541e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854419df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:27.405 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.973+0000 7f8541e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854419df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60070/0 (socket says 172.21.15.28:60070) 2024-06-06T08:31:27.405 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.973+0000 7f8541e00700 1 -- 172.21.15.28:0/1143048009 learned_addr learned my addr 172.21.15.28:0/1143048009 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:27.405 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.974+0000 7f8541e00700 1 -- 172.21.15.28:0/1143048009 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854419e4a0 con 0x7f854407deb0 2024-06-06T08:31:27.405 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.974+0000 7f8541e00700 1 --2- 172.21.15.28:0/1143048009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854419df60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85340117e0 tx=0x7f8534011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:27.405 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.974+0000 7f853aa00700 1 -- 172.21.15.28:0/1143048009 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534003bf0 con 0x7f854407deb0 2024-06-06T08:31:27.405 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.975+0000 7f8548a00700 1 -- 172.21.15.28:0/1143048009 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854419e730 con 0x7f854407deb0 2024-06-06T08:31:27.405 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.975+0000 7f853aa00700 1 -- 172.21.15.28:0/1143048009 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f853401a910 con 0x7f854407deb0 2024-06-06T08:31:27.405 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.975+0000 7f853aa00700 1 -- 172.21.15.28:0/1143048009 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534024970 con 0x7f854407deb0 2024-06-06T08:31:27.405 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.975+0000 7f8548a00700 1 -- 172.21.15.28:0/1143048009 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854419eb90 con 0x7f854407deb0 2024-06-06T08:31:27.406 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.976+0000 7f853aa00700 1 -- 172.21.15.28:0/1143048009 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8534022020 con 0x7f854407deb0 2024-06-06T08:31:27.406 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.976+0000 7f8548a00700 1 -- 172.21.15.28:0/1143048009 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8544063af0 con 0x7f854407deb0 2024-06-06T08:31:27.406 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.977+0000 7f853aa00700 1 --2- 172.21.15.28:0/1143048009 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f85280390a0 0x7f852803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:27.406 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.977+0000 7f853aa00700 1 -- 172.21.15.28:0/1143048009 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f853404d480 con 0x7f854407deb0 2024-06-06T08:31:27.406 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.977+0000 7f8541400700 1 --2- 172.21.15.28:0/1143048009 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f85280390a0 0x7f852803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:27.406 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.978+0000 7f8541400700 1 --2- 172.21.15.28:0/1143048009 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f85280390a0 0x7f852803b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8530006fd0 tx=0x7f8530006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:27.406 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:25.982+0000 7f853aa00700 1 -- 172.21.15.28:0/1143048009 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f85340212c0 con 0x7f854407deb0 2024-06-06T08:31:27.406 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.227+0000 7f8548a00700 1 -- 172.21.15.28:0/1143048009 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f85441a14e0 con 0x7f854407deb0 2024-06-06T08:31:27.406 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.230+0000 7f853aa00700 1 -- 172.21.15.28:0/1143048009 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f853404cdd0 con 0x7f854407deb0 2024-06-06T08:31:27.406 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.233+0000 7f8548a00700 1 -- 172.21.15.28:0/1143048009 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f85280390a0 msgr2=0x7f852803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:27.406 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.233+0000 7f8548a00700 1 --2- 172.21.15.28:0/1143048009 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f85280390a0 0x7f852803b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8530006fd0 tx=0x7f8530006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:27.407 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.233+0000 7f8548a00700 1 -- 172.21.15.28:0/1143048009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 msgr2=0x7f854419df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:27.407 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.233+0000 7f8548a00700 1 --2- 172.21.15.28:0/1143048009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854419df60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85340117e0 tx=0x7f8534011ba0 comp rx=0 tx=0).stop 2024-06-06T08:31:27.407 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.234+0000 7f8548a00700 1 -- 172.21.15.28:0/1143048009 shutdown_connections 2024-06-06T08:31:27.407 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.234+0000 7f8548a00700 1 --2- 172.21.15.28:0/1143048009 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f85280390a0 0x7f852803b560 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:27.407 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.234+0000 7f8548a00700 1 --2- 172.21.15.28:0/1143048009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f854407deb0 0x7f854419df60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:27.407 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.234+0000 7f8548a00700 1 -- 172.21.15.28:0/1143048009 >> 172.21.15.28:0/1143048009 conn(0x7f8544103420 msgr2=0x7f8544103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:27.407 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.234+0000 7f8548a00700 1 -- 172.21.15.28:0/1143048009 shutdown_connections 2024-06-06T08:31:27.407 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:26.234+0000 7f8548a00700 1 -- 172.21.15.28:0/1143048009 wait complete. 2024-06-06T08:31:28.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:28 smithi028 ceph-mon[31564]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:31:28.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:28 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:28.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:28 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2037362609' entity='client.admin' 2024-06-06T08:31:28.955 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.026+0000 7fe06da00700 1 Processor -- start 2024-06-06T08:31:28.955 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.026+0000 7fe06da00700 1 -- start start 2024-06-06T08:31:28.955 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.027+0000 7fe06da00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06807cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:28.955 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.027+0000 7fe06da00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe06807d1b0 con 0x7fe06807e780 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.027+0000 7fe066a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06807cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.027+0000 7fe066a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06807cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60074/0 (socket says 172.21.15.28:60074) 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.027+0000 7fe066a00700 1 -- 172.21.15.28:0/2492067274 learned_addr learned my addr 172.21.15.28:0/2492067274 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.028+0000 7fe066a00700 1 -- 172.21.15.28:0/2492067274 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06807d330 con 0x7fe06807e780 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.028+0000 7fe066a00700 1 --2- 172.21.15.28:0/2492067274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06807cbe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0580098a0 tx=0x7fe058009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59e8461fd932167 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.028+0000 7fe065600700 1 -- 172.21.15.28:0/2492067274 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe058004160 con 0x7fe06807e780 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.028+0000 7fe065600700 1 -- 172.21.15.28:0/2492067274 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe058004300 con 0x7fe06807e780 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.028+0000 7fe065600700 1 -- 172.21.15.28:0/2492067274 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe058011b20 con 0x7fe06807e780 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.029+0000 7fe06da00700 1 -- 172.21.15.28:0/2492067274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 msgr2=0x7fe06807cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.029+0000 7fe06da00700 1 --2- 172.21.15.28:0/2492067274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06807cbe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0580098a0 tx=0x7fe058009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.029+0000 7fe06da00700 1 -- 172.21.15.28:0/2492067274 shutdown_connections 2024-06-06T08:31:28.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.029+0000 7fe06da00700 1 --2- 172.21.15.28:0/2492067274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06807cbe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.029+0000 7fe06da00700 1 -- 172.21.15.28:0/2492067274 >> 172.21.15.28:0/2492067274 conn(0x7fe068103460 msgr2=0x7fe068105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.030+0000 7fe06da00700 1 -- 172.21.15.28:0/2492067274 shutdown_connections 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.030+0000 7fe06da00700 1 -- 172.21.15.28:0/2492067274 wait complete. 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.031+0000 7fe06da00700 1 Processor -- start 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.031+0000 7fe06da00700 1 -- start start 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.032+0000 7fe06da00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.032+0000 7fe06da00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe06810e510 con 0x7fe06807e780 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.032+0000 7fe066a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.032+0000 7fe066a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06819e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60082/0 (socket says 172.21.15.28:60082) 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.032+0000 7fe066a00700 1 -- 172.21.15.28:0/2037362609 learned_addr learned my addr 172.21.15.28:0/2037362609 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.033+0000 7fe066a00700 1 -- 172.21.15.28:0/2037362609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06819e550 con 0x7fe06807e780 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.033+0000 7fe066a00700 1 --2- 172.21.15.28:0/2037362609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06819e010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0580116a0 tx=0x7fe058011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:28.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.033+0000 7fe05f400700 1 -- 172.21.15.28:0/2037362609 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe058003a40 con 0x7fe06807e780 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.033+0000 7fe05f400700 1 -- 172.21.15.28:0/2037362609 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe058003be0 con 0x7fe06807e780 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.033+0000 7fe06da00700 1 -- 172.21.15.28:0/2037362609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe06819e7e0 con 0x7fe06807e780 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.033+0000 7fe05f400700 1 -- 172.21.15.28:0/2037362609 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe05801a5e0 con 0x7fe06807e780 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.034+0000 7fe06da00700 1 -- 172.21.15.28:0/2037362609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe06819ec40 con 0x7fe06807e780 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.035+0000 7fe05f400700 1 -- 172.21.15.28:0/2037362609 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe05801a900 con 0x7fe06807e780 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.035+0000 7fe05f400700 1 --2- 172.21.15.28:0/2037362609 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fe04c039000 0x7fe04c03b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.035+0000 7fe06da00700 1 -- 172.21.15.28:0/2037362609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe068063af0 con 0x7fe06807e780 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.035+0000 7fe05f400700 1 -- 172.21.15.28:0/2037362609 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe05804d610 con 0x7fe06807e780 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.035+0000 7fe066000700 1 --2- 172.21.15.28:0/2037362609 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fe04c039000 0x7fe04c03b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.036+0000 7fe066000700 1 --2- 172.21.15.28:0/2037362609 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fe04c039000 0x7fe04c03b4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe054006fd0 tx=0x7fe054006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.041+0000 7fe05f400700 1 -- 172.21.15.28:0/2037362609 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe058011e20 con 0x7fe06807e780 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.282+0000 7fe06da00700 1 -- 172.21.15.28:0/2037362609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fe0681a16d0 con 0x7fe06807e780 2024-06-06T08:31:28.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.286+0000 7fe05f400700 1 -- 172.21.15.28:0/2037362609 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fe058019c70 con 0x7fe06807e780 2024-06-06T08:31:28.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.289+0000 7fe06da00700 1 -- 172.21.15.28:0/2037362609 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fe04c039000 msgr2=0x7fe04c03b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:28.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.289+0000 7fe06da00700 1 --2- 172.21.15.28:0/2037362609 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fe04c039000 0x7fe04c03b4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe054006fd0 tx=0x7fe054006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:28.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.289+0000 7fe06da00700 1 -- 172.21.15.28:0/2037362609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 msgr2=0x7fe06819e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:28.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.289+0000 7fe06da00700 1 --2- 172.21.15.28:0/2037362609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06819e010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0580116a0 tx=0x7fe058011ba0 comp rx=0 tx=0).stop 2024-06-06T08:31:28.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.290+0000 7fe06da00700 1 -- 172.21.15.28:0/2037362609 shutdown_connections 2024-06-06T08:31:28.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.290+0000 7fe06da00700 1 --2- 172.21.15.28:0/2037362609 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7fe04c039000 0x7fe04c03b4c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:28.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.290+0000 7fe06da00700 1 --2- 172.21.15.28:0/2037362609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe06807e780 0x7fe06819e010 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:28.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.290+0000 7fe06da00700 1 -- 172.21.15.28:0/2037362609 >> 172.21.15.28:0/2037362609 conn(0x7fe068103460 msgr2=0x7fe068103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:28.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.290+0000 7fe06da00700 1 -- 172.21.15.28:0/2037362609 shutdown_connections 2024-06-06T08:31:28.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:28.290+0000 7fe06da00700 1 -- 172.21.15.28:0/2037362609 wait complete. 2024-06-06T08:31:28.959 INFO:teuthology.orchestra.run.smithi028.stdout:Enabling the dashboard module... 2024-06-06T08:31:30.836 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:30 smithi028 ceph-mon[31564]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:31:30.837 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:30 smithi028 ceph-mon[31564]: from='mgr.14120 172.21.15.28:0/607639329' entity='mgr.x' 2024-06-06T08:31:30.837 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:30 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1416235033' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-06-06T08:31:30.837 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:30 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: ignoring --setuser ceph since I am not root 2024-06-06T08:31:30.837 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:30 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: ignoring --setgroup ceph since I am not root 2024-06-06T08:31:31.090 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:31 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:31.021+0000 7ff52938f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T08:31:31.417 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:31 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:31.279+0000 7ff52938f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T08:31:31.417 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:31 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:31.417+0000 7ff52938f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T08:31:31.956 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:31 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:31.837+0000 7ff52938f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T08:31:31.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:31 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1416235033' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-06-06T08:31:31.957 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:31 smithi028 ceph-mon[31564]: mgrmap e9: x(active, since 25s) 2024-06-06T08:31:32.290 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:31 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:31.956+0000 7ff52938f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T08:31:32.319 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.637+0000 7f934c600700 1 Processor -- start 2024-06-06T08:31:32.319 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.638+0000 7f934c600700 1 -- start start 2024-06-06T08:31:32.319 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.638+0000 7f934c600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f93441082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:32.319 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.638+0000 7f934c600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9344108810 con 0x7f9344107eb0 2024-06-06T08:31:32.319 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.639+0000 7f9349c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f93441082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:32.319 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.639+0000 7f9349c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f93441082d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60084/0 (socket says 172.21.15.28:60084) 2024-06-06T08:31:32.319 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.639+0000 7f9349c00700 1 -- 172.21.15.28:0/3335148704 learned_addr learned my addr 172.21.15.28:0/3335148704 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:32.319 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.639+0000 7f9349c00700 1 -- 172.21.15.28:0/3335148704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9344108fc0 con 0x7f9344107eb0 2024-06-06T08:31:32.319 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.640+0000 7f9349c00700 1 --2- 172.21.15.28:0/3335148704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f93441082d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f93380098a0 tx=0x7f9338009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e1fa523e6d0d26 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:32.319 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.640+0000 7f9343e00700 1 -- 172.21.15.28:0/3335148704 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9338004160 con 0x7f9344107eb0 2024-06-06T08:31:32.319 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.640+0000 7f9343e00700 1 -- 172.21.15.28:0/3335148704 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9338004300 con 0x7f9344107eb0 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.640+0000 7f9343e00700 1 -- 172.21.15.28:0/3335148704 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9338011b20 con 0x7f9344107eb0 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.641+0000 7f934c600700 1 -- 172.21.15.28:0/3335148704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 msgr2=0x7f93441082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.641+0000 7f934c600700 1 --2- 172.21.15.28:0/3335148704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f93441082d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f93380098a0 tx=0x7f9338009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.641+0000 7f934c600700 1 -- 172.21.15.28:0/3335148704 shutdown_connections 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.641+0000 7f934c600700 1 --2- 172.21.15.28:0/3335148704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f93441082d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.641+0000 7f934c600700 1 -- 172.21.15.28:0/3335148704 >> 172.21.15.28:0/3335148704 conn(0x7f93441034d0 msgr2=0x7f93441058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.641+0000 7f934c600700 1 -- 172.21.15.28:0/3335148704 shutdown_connections 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.642+0000 7f934c600700 1 -- 172.21.15.28:0/3335148704 wait complete. 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.643+0000 7f934c600700 1 Processor -- start 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.643+0000 7f934c600700 1 -- start start 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.643+0000 7f934c600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f934419dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.643+0000 7f934c600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f934410c400 con 0x7f9344107eb0 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.644+0000 7f9349c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f934419dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.644+0000 7f9349c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f934419dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60100/0 (socket says 172.21.15.28:60100) 2024-06-06T08:31:32.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.644+0000 7f9349c00700 1 -- 172.21.15.28:0/1416235033 learned_addr learned my addr 172.21.15.28:0/1416235033 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.644+0000 7f9349c00700 1 -- 172.21.15.28:0/1416235033 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934419e4f0 con 0x7f9344107eb0 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.644+0000 7f9349c00700 1 --2- 172.21.15.28:0/1416235033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f934419dfb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9338011b60 tx=0x7f9338011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.645+0000 7f9342000700 1 -- 172.21.15.28:0/1416235033 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9338003b60 con 0x7f9344107eb0 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.645+0000 7f9342000700 1 -- 172.21.15.28:0/1416235033 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f933801a910 con 0x7f9344107eb0 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.645+0000 7f934c600700 1 -- 172.21.15.28:0/1416235033 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934419e780 con 0x7f9344107eb0 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.645+0000 7f9342000700 1 -- 172.21.15.28:0/1416235033 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9338024930 con 0x7f9344107eb0 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.645+0000 7f934c600700 1 -- 172.21.15.28:0/1416235033 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934419ebe0 con 0x7f9344107eb0 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.646+0000 7f9342000700 1 -- 172.21.15.28:0/1416235033 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9338022020 con 0x7f9344107eb0 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.647+0000 7f9342000700 1 --2- 172.21.15.28:0/1416235033 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f932c0390a0 0x7f932c03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.647+0000 7f934c600700 1 -- 172.21.15.28:0/1416235033 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9344063af0 con 0x7f9344107eb0 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.647+0000 7f9342000700 1 -- 172.21.15.28:0/1416235033 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f933804e2b0 con 0x7f9344107eb0 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.647+0000 7f9349200700 1 --2- 172.21.15.28:0/1416235033 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f932c0390a0 0x7f932c03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:32.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.648+0000 7f9349200700 1 --2- 172.21.15.28:0/1416235033 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f932c0390a0 0x7f932c03b560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9330006fd0 tx=0x7f9330006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.653+0000 7f9342000700 1 -- 172.21.15.28:0/1416235033 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f933800fdd0 con 0x7f9344107eb0 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:29.956+0000 7f934c600700 1 -- 172.21.15.28:0/1416235033 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f93441a19c0 con 0x7f9344107eb0 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.668+0000 7f9342000700 1 -- 172.21.15.28:0/1416235033 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f933804dc00 con 0x7f9344107eb0 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.672+0000 7f9342000700 1 -- 172.21.15.28:0/1416235033 <== mon.0 v2:172.21.15.28:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f933802d770 con 0x7f9344107eb0 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.672+0000 7f934c600700 1 -- 172.21.15.28:0/1416235033 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f932c0390a0 msgr2=0x7f932c03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.672+0000 7f934c600700 1 --2- 172.21.15.28:0/1416235033 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f932c0390a0 0x7f932c03b560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9330006fd0 tx=0x7f9330006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.672+0000 7f934c600700 1 -- 172.21.15.28:0/1416235033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 msgr2=0x7f934419dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.672+0000 7f934c600700 1 --2- 172.21.15.28:0/1416235033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f934419dfb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9338011b60 tx=0x7f9338011c40 comp rx=0 tx=0).stop 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.672+0000 7f934c600700 1 -- 172.21.15.28:0/1416235033 shutdown_connections 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.672+0000 7f934c600700 1 --2- 172.21.15.28:0/1416235033 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f932c0390a0 0x7f932c03b560 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.672+0000 7f934c600700 1 --2- 172.21.15.28:0/1416235033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9344107eb0 0x7f934419dfb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.673+0000 7f934c600700 1 -- 172.21.15.28:0/1416235033 >> 172.21.15.28:0/1416235033 conn(0x7f93441034d0 msgr2=0x7f9344103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.674+0000 7f934c600700 1 -- 172.21.15.28:0/1416235033 shutdown_connections 2024-06-06T08:31:32.322 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:30.674+0000 7f934c600700 1 -- 172.21.15.28:0/1416235033 wait complete. 2024-06-06T08:31:33.499 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:33 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1840842499' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-06T08:31:33.790 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:33 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:33.592+0000 7ff52938f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T08:31:33.839 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-06-06T08:31:33.839 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-06-06T08:31:33.839 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-06T08:31:33.839 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-06T08:31:33.839 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-06T08:31:33.839 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-06-06T08:31:33.839 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.856+0000 7f046a800700 1 Processor -- start 2024-06-06T08:31:33.839 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.857+0000 7f046a800700 1 -- start start 2024-06-06T08:31:33.839 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.857+0000 7f046a800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f04641082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:33.839 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.857+0000 7f046a800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0464108810 con 0x7f0464107eb0 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.858+0000 7f0463400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f04641082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.858+0000 7f0463400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f04641082d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60136/0 (socket says 172.21.15.28:60136) 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.858+0000 7f0463400700 1 -- 172.21.15.28:0/328530470 learned_addr learned my addr 172.21.15.28:0/328530470 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.858+0000 7f0463400700 1 -- 172.21.15.28:0/328530470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0464108fc0 con 0x7f0464107eb0 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.858+0000 7f0463400700 1 --2- 172.21.15.28:0/328530470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f04641082d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f04540098a0 tx=0x7f0454009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e76355dcbb352c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.859+0000 7f0462a00700 1 -- 172.21.15.28:0/328530470 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0454004160 con 0x7f0464107eb0 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.859+0000 7f0462a00700 1 -- 172.21.15.28:0/328530470 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0454004300 con 0x7f0464107eb0 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.859+0000 7f0462a00700 1 -- 172.21.15.28:0/328530470 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0454011b20 con 0x7f0464107eb0 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.860+0000 7f046a800700 1 -- 172.21.15.28:0/328530470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 msgr2=0x7f04641082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.860+0000 7f046a800700 1 --2- 172.21.15.28:0/328530470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f04641082d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f04540098a0 tx=0x7f0454009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.860+0000 7f046a800700 1 -- 172.21.15.28:0/328530470 shutdown_connections 2024-06-06T08:31:33.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.860+0000 7f046a800700 1 --2- 172.21.15.28:0/328530470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f04641082d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.860+0000 7f046a800700 1 -- 172.21.15.28:0/328530470 >> 172.21.15.28:0/328530470 conn(0x7f04641034d0 msgr2=0x7f04641058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.860+0000 7f046a800700 1 -- 172.21.15.28:0/328530470 shutdown_connections 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.860+0000 7f046a800700 1 -- 172.21.15.28:0/328530470 wait complete. 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.862+0000 7f046a800700 1 Processor -- start 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.862+0000 7f046a800700 1 -- start start 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.862+0000 7f046a800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f046407e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.862+0000 7f046a800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f046410c400 con 0x7f0464107eb0 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.862+0000 7f0463400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f046407e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.862+0000 7f0463400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f046407e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60146/0 (socket says 172.21.15.28:60146) 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.863+0000 7f0463400700 1 -- 172.21.15.28:0/1840842499 learned_addr learned my addr 172.21.15.28:0/1840842499 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.863+0000 7f0463400700 1 -- 172.21.15.28:0/1840842499 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046407e950 con 0x7f0464107eb0 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.863+0000 7f0463400700 1 --2- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f046407e410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0454011b60 tx=0x7f0454011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:33.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.863+0000 7f0460c00700 1 -- 172.21.15.28:0/1840842499 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0454003b60 con 0x7f0464107eb0 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.863+0000 7f0460c00700 1 -- 172.21.15.28:0/1840842499 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f045401a910 con 0x7f0464107eb0 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.863+0000 7f0460c00700 1 -- 172.21.15.28:0/1840842499 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0454024930 con 0x7f0464107eb0 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.863+0000 7f046a800700 1 -- 172.21.15.28:0/1840842499 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046407cb40 con 0x7f0464107eb0 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.864+0000 7f046a800700 1 -- 172.21.15.28:0/1840842499 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f046407d000 con 0x7f0464107eb0 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.865+0000 7f046a800700 1 -- 172.21.15.28:0/1840842499 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046410c580 con 0x7f0464107eb0 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.865+0000 7f0460c00700 1 -- 172.21.15.28:0/1840842499 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f0454022020 con 0x7f0464107eb0 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.866+0000 7f0460c00700 1 --2- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f0448039100 0x7f044803b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.866+0000 7f0460c00700 1 -- 172.21.15.28:0/1840842499 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f045404d310 con 0x7f0464107eb0 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.866+0000 7f045aa00700 1 -- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f0448039100 msgr2=0x7f044803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/2022015677 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.866+0000 7f045aa00700 1 --2- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f0448039100 0x7f044803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:32.870+0000 7f0460c00700 1 -- 172.21.15.28:0/1840842499 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f045400b3e0 con 0x7f0464107eb0 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.067+0000 7f045aa00700 1 -- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f0448039100 msgr2=0x7f044803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/2022015677 2024-06-06T08:31:33.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.067+0000 7f045aa00700 1 --2- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f0448039100 0x7f044803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.149+0000 7f046a800700 1 -- 172.21.15.28:0/1840842499 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f046407d760 con 0x7f0464107eb0 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.151+0000 7f0460c00700 1 -- 172.21.15.28:0/1840842499 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f045404cc60 con 0x7f0464107eb0 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.154+0000 7f046a800700 1 -- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f0448039100 msgr2=0x7f044803b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.154+0000 7f046a800700 1 --2- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f0448039100 0x7f044803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.154+0000 7f046a800700 1 -- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 msgr2=0x7f046407e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.154+0000 7f046a800700 1 --2- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f046407e410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0454011b60 tx=0x7f0454011c40 comp rx=0 tx=0).stop 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.154+0000 7f046a800700 1 -- 172.21.15.28:0/1840842499 shutdown_connections 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.154+0000 7f046a800700 1 --2- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f0448039100 0x7f044803b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.154+0000 7f046a800700 1 --2- 172.21.15.28:0/1840842499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0464107eb0 0x7f046407e410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.154+0000 7f046a800700 1 -- 172.21.15.28:0/1840842499 >> 172.21.15.28:0/1840842499 conn(0x7f04641034d0 msgr2=0x7f0464103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.154+0000 7f046a800700 1 -- 172.21.15.28:0/1840842499 shutdown_connections 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:33.154+0000 7f046a800700 1 -- 172.21.15.28:0/1840842499 wait complete. 2024-06-06T08:31:33.843 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for the mgr to restart... 2024-06-06T08:31:33.844 INFO:teuthology.orchestra.run.smithi028.stdout:Waiting for mgr epoch 9... 2024-06-06T08:31:34.152 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:33 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:33.829+0000 7ff52938f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T08:31:34.152 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:34 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:34.053+0000 7ff52938f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T08:31:34.790 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:34 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:34.459+0000 7ff52938f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T08:31:34.791 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:34 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:34.585+0000 7ff52938f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T08:31:35.110 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:34 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:34.846+0000 7ff52938f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T08:31:35.540 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:35 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:35.111+0000 7ff52938f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T08:31:36.290 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:35 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:35.933+0000 7ff52938f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T08:31:36.790 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:36 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:36.505+0000 7ff52938f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T08:31:36.791 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:36 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:36.638+0000 7ff52938f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T08:31:37.290 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:36 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:36.915+0000 7ff52938f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T08:31:37.718 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:37 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:37.590+0000 7ff52938f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T08:31:37.719 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:37 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:37.719+0000 7ff52938f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T08:31:38.375 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:38 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:38.056+0000 7ff52938f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T08:31:38.375 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:38 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:38.243+0000 7ff52938f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T08:31:38.750 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:38 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:38.375+0000 7ff52938f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T08:31:38.750 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:38 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:38.540+0000 7ff52938f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T08:31:39.040 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:38 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:38.922+0000 7ff52938f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T08:31:40.002 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:39 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:39.729+0000 7ff52938f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T08:31:40.290 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:31:40 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:31:40.061+0000 7ff52938f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T08:31:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:40 smithi028 ceph-mon[31564]: Active manager daemon x restarted 2024-06-06T08:31:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:40 smithi028 ceph-mon[31564]: Activating manager daemon x 2024-06-06T08:31:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:40 smithi028 ceph-mon[31564]: osdmap e3: 0 total, 0 up, 0 in 2024-06-06T08:31:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:40 smithi028 ceph-mon[31564]: mgrmap e10: x(active, starting, since 0.00499575s) 2024-06-06T08:31:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:31:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-06T08:31:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-06T08:31:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-06T08:31:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-06T08:31:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:40 smithi028 ceph-mon[31564]: Manager daemon x is now available 2024-06-06T08:31:41.466 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:31:41.466 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-06T08:31:41.466 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-06T08:31:41.466 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:41 smithi028 ceph-mon[31564]: mgrmap e11: x(active, since 1.01194s) 2024-06-06T08:31:41.912 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout { 2024-06-06T08:31:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-06-06T08:31:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-06T08:31:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout } 2024-06-06T08:31:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.444+0000 7f3b71c00700 1 Processor -- start 2024-06-06T08:31:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.444+0000 7f3b71c00700 1 -- start start 2024-06-06T08:31:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.445+0000 7f3b71c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.445+0000 7f3b71c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c07c8c0 con 0x7f3b6c07de90 2024-06-06T08:31:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.445+0000 7f3b6aa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.446+0000 7f3b6aa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c07c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60162/0 (socket says 172.21.15.28:60162) 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.446+0000 7f3b6aa00700 1 -- 172.21.15.28:0/2581870720 learned_addr learned my addr 172.21.15.28:0/2581870720 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.446+0000 7f3b6aa00700 1 -- 172.21.15.28:0/2581870720 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6c07ca40 con 0x7f3b6c07de90 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.446+0000 7f3b6aa00700 1 --2- 172.21.15.28:0/2581870720 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c07c2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0098a0 tx=0x7f3b5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec68240c20905419 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.447+0000 7f3b69600700 1 -- 172.21.15.28:0/2581870720 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b5c004160 con 0x7f3b6c07de90 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.447+0000 7f3b69600700 1 -- 172.21.15.28:0/2581870720 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b5c004300 con 0x7f3b6c07de90 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.447+0000 7f3b69600700 1 -- 172.21.15.28:0/2581870720 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b5c011b20 con 0x7f3b6c07de90 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.448+0000 7f3b71c00700 1 -- 172.21.15.28:0/2581870720 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 msgr2=0x7f3b6c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.448+0000 7f3b71c00700 1 --2- 172.21.15.28:0/2581870720 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c07c2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0098a0 tx=0x7f3b5c009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.448+0000 7f3b71c00700 1 -- 172.21.15.28:0/2581870720 shutdown_connections 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.448+0000 7f3b71c00700 1 --2- 172.21.15.28:0/2581870720 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c07c2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.448+0000 7f3b71c00700 1 -- 172.21.15.28:0/2581870720 >> 172.21.15.28:0/2581870720 conn(0x7f3b6c103420 msgr2=0x7f3b6c105860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:41.914 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.448+0000 7f3b71c00700 1 -- 172.21.15.28:0/2581870720 shutdown_connections 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.448+0000 7f3b71c00700 1 -- 172.21.15.28:0/2581870720 wait complete. 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.449+0000 7f3b71c00700 1 Processor -- start 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.450+0000 7f3b71c00700 1 -- start start 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.450+0000 7f3b71c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c19df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.450+0000 7f3b71c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c10e500 con 0x7f3b6c07de90 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.450+0000 7f3b6aa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c19df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.450+0000 7f3b6aa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c19df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60166/0 (socket says 172.21.15.28:60166) 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.450+0000 7f3b6aa00700 1 -- 172.21.15.28:0/4262124657 learned_addr learned my addr 172.21.15.28:0/4262124657 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.451+0000 7f3b6aa00700 1 -- 172.21.15.28:0/4262124657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6c19e470 con 0x7f3b6c07de90 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.451+0000 7f3b6aa00700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c19df30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0117e0 tx=0x7f3b5c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.451+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b5c003ba0 con 0x7f3b6c07de90 2024-06-06T08:31:41.915 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.451+0000 7f3b71c00700 1 -- 172.21.15.28:0/4262124657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6c19e700 con 0x7f3b6c07de90 2024-06-06T08:31:41.916 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.451+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b5c01a910 con 0x7f3b6c07de90 2024-06-06T08:31:41.916 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.451+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b5c0248f0 con 0x7f3b6c07de90 2024-06-06T08:31:41.916 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.452+0000 7f3b71c00700 1 -- 172.21.15.28:0/4262124657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6c19eb60 con 0x7f3b6c07de90 2024-06-06T08:31:41.916 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.453+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f3b5c022020 con 0x7f3b6c07de90 2024-06-06T08:31:41.916 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.453+0000 7f3b63400700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 0x7f3b5003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:41.916 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.453+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 --> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3b5003bc70 con 0x7f3b500390a0 2024-06-06T08:31:41.916 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.453+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3b5c04d930 con 0x7f3b6c07de90 2024-06-06T08:31:41.916 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.453+0000 7f3b6a000700 1 -- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 msgr2=0x7f3b5003b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/2022015677 2024-06-06T08:31:41.916 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.454+0000 7f3b6a000700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 0x7f3b5003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T08:31:41.916 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.655+0000 7f3b6a000700 1 -- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 msgr2=0x7f3b5003b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/2022015677 2024-06-06T08:31:41.916 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:34.655+0000 7f3b6a000700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 0x7f3b5003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:35.056+0000 7f3b6a000700 1 -- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 msgr2=0x7f3b5003b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/2022015677 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:35.056+0000 7f3b6a000700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 0x7f3b5003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:35.857+0000 7f3b6a000700 1 -- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 msgr2=0x7f3b5003b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/2022015677 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:35.857+0000 7f3b6a000700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 0x7f3b5003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:37.459+0000 7f3b6a000700 1 -- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 msgr2=0x7f3b5003b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:6800/2022015677 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:37.459+0000 7f3b6a000700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 0x7f3b5003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:40.069+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f3b5c02d3f0 con 0x7f3b6c07de90 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:40.069+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 msgr2=0x7f3b5003b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:40.069+0000 7f3b63400700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 0x7f3b5003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.073+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f3b5c04fb50 con 0x7f3b6c07de90 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.074+0000 7f3b63400700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3b5003cb60 0x7f3b5003ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.074+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3b5c008ea0 con 0x7f3b5003cb60 2024-06-06T08:31:41.917 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.075+0000 7f3b6a000700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3b5003cb60 0x7f3b5003ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:41.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.079+0000 7f3b6a000700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3b5003cb60 0x7f3b5003ef50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3b58003a10 tx=0x7f3b580092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:41.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.080+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f3b5c008ea0 con 0x7f3b5003cb60 2024-06-06T08:31:41.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.087+0000 7f3b71c00700 1 -- 172.21.15.28:0/4262124657 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f3b6c063af0 con 0x7f3b5003cb60 2024-06-06T08:31:41.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.088+0000 7f3b63400700 1 -- 172.21.15.28:0/4262124657 <== mgr.14152 v2:172.21.15.28:6800/2061522436 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f3b6c063af0 con 0x7f3b5003cb60 2024-06-06T08:31:41.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.088+0000 7f3b71c00700 1 -- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3b5003cb60 msgr2=0x7f3b5003ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:41.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.088+0000 7f3b71c00700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3b5003cb60 0x7f3b5003ef50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3b58003a10 tx=0x7f3b580092b0 comp rx=0 tx=0).stop 2024-06-06T08:31:41.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.088+0000 7f3b71c00700 1 -- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 msgr2=0x7f3b6c19df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:41.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.088+0000 7f3b71c00700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c19df30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0117e0 tx=0x7f3b5c011ba0 comp rx=0 tx=0).stop 2024-06-06T08:31:41.918 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.089+0000 7f3b71c00700 1 -- 172.21.15.28:0/4262124657 shutdown_connections 2024-06-06T08:31:41.919 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.089+0000 7f3b71c00700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3b5003cb60 0x7f3b5003ef50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:41.919 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.089+0000 7f3b71c00700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b6c07de90 0x7f3b6c19df30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:41.919 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.089+0000 7f3b71c00700 1 --2- 172.21.15.28:0/4262124657 >> [v2:172.21.15.28:6800/2022015677,v1:172.21.15.28:6801/2022015677] conn(0x7f3b500390a0 0x7f3b5003b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:41.919 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.089+0000 7f3b71c00700 1 -- 172.21.15.28:0/4262124657 >> 172.21.15.28:0/4262124657 conn(0x7f3b6c103420 msgr2=0x7f3b6c103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:41.919 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.089+0000 7f3b71c00700 1 -- 172.21.15.28:0/4262124657 shutdown_connections 2024-06-06T08:31:41.919 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:41.089+0000 7f3b71c00700 1 -- 172.21.15.28:0/4262124657 wait complete. 2024-06-06T08:31:41.919 INFO:teuthology.orchestra.run.smithi028.stdout:mgr epoch 9 is available 2024-06-06T08:31:41.919 INFO:teuthology.orchestra.run.smithi028.stdout:Generating a dashboard self-signed certificate... 2024-06-06T08:31:42.364 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:42 smithi028 ceph-mon[31564]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-06T08:31:42.364 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:42 smithi028 ceph-mon[31564]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-06T08:31:43.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:43 smithi028 ceph-mon[31564]: [06/Jun/2024:08:31:42] ENGINE Bus STARTING 2024-06-06T08:31:43.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:43 smithi028 ceph-mon[31564]: [06/Jun/2024:08:31:42] ENGINE Serving on https://172.21.15.28:7150 2024-06-06T08:31:43.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:43 smithi028 ceph-mon[31564]: mgrmap e12: x(active, since 2s) 2024-06-06T08:31:43.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:43 smithi028 ceph-mon[31564]: [06/Jun/2024:08:31:42] ENGINE Serving on http://172.21.15.28:8765 2024-06-06T08:31:43.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:43 smithi028 ceph-mon[31564]: [06/Jun/2024:08:31:42] ENGINE Bus STARTED 2024-06-06T08:31:43.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:31:43.949 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-06-06T08:31:43.949 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.864+0000 7f1ad0a00700 1 Processor -- start 2024-06-06T08:31:43.949 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.865+0000 7f1ad0a00700 1 -- start start 2024-06-06T08:31:43.950 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.865+0000 7f1ad0a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc10a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:43.950 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.865+0000 7f1ad0a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc10aaf0 con 0x7f1acc10a100 2024-06-06T08:31:43.950 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.865+0000 7f1ac9e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc10a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:43.951 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.866+0000 7f1ac9e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc10a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33134/0 (socket says 172.21.15.28:33134) 2024-06-06T08:31:43.951 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.866+0000 7f1ac9e00700 1 -- 172.21.15.28:0/336281898 learned_addr learned my addr 172.21.15.28:0/336281898 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:43.951 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.866+0000 7f1ac9e00700 1 -- 172.21.15.28:0/336281898 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc10b2b0 con 0x7f1acc10a100 2024-06-06T08:31:43.951 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.866+0000 7f1ac9e00700 1 --2- 172.21.15.28:0/336281898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc10a520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0098a0 tx=0x7f1abc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347b3ea6bcb04a68 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:43.951 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.867+0000 7f1ac8a00700 1 -- 172.21.15.28:0/336281898 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1abc004160 con 0x7f1acc10a100 2024-06-06T08:31:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.867+0000 7f1ac8a00700 1 -- 172.21.15.28:0/336281898 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1abc004300 con 0x7f1acc10a100 2024-06-06T08:31:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.867+0000 7f1ac8a00700 1 -- 172.21.15.28:0/336281898 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1abc011b20 con 0x7f1acc10a100 2024-06-06T08:31:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.868+0000 7f1ad0a00700 1 -- 172.21.15.28:0/336281898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 msgr2=0x7f1acc10a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.868+0000 7f1ad0a00700 1 --2- 172.21.15.28:0/336281898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc10a520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0098a0 tx=0x7f1abc009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:43.953 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.868+0000 7f1ad0a00700 1 -- 172.21.15.28:0/336281898 shutdown_connections 2024-06-06T08:31:43.953 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.868+0000 7f1ad0a00700 1 --2- 172.21.15.28:0/336281898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc10a520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:43.953 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.868+0000 7f1ad0a00700 1 -- 172.21.15.28:0/336281898 >> 172.21.15.28:0/336281898 conn(0x7f1acc07d6d0 msgr2=0x7f1acc07dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:43.954 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.868+0000 7f1ad0a00700 1 -- 172.21.15.28:0/336281898 shutdown_connections 2024-06-06T08:31:43.954 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.868+0000 7f1ad0a00700 1 -- 172.21.15.28:0/336281898 wait complete. 2024-06-06T08:31:43.954 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.870+0000 7f1ad0a00700 1 Processor -- start 2024-06-06T08:31:43.955 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.870+0000 7f1ad0a00700 1 -- start start 2024-06-06T08:31:43.955 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.870+0000 7f1ad0a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc19dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:43.955 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.870+0000 7f1ad0a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc10e660 con 0x7f1acc10a100 2024-06-06T08:31:43.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.871+0000 7f1ac9e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc19dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:43.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.871+0000 7f1ac9e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc19dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33146/0 (socket says 172.21.15.28:33146) 2024-06-06T08:31:43.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.871+0000 7f1ac9e00700 1 -- 172.21.15.28:0/709945389 learned_addr learned my addr 172.21.15.28:0/709945389 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:43.956 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.871+0000 7f1ac9e00700 1 -- 172.21.15.28:0/709945389 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc19e4f0 con 0x7f1acc10a100 2024-06-06T08:31:43.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.871+0000 7f1ac9e00700 1 --2- 172.21.15.28:0/709945389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc19dfb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0116a0 tx=0x7f1abc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:43.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.872+0000 7f1ac2a00700 1 -- 172.21.15.28:0/709945389 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1abc003a40 con 0x7f1acc10a100 2024-06-06T08:31:43.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.872+0000 7f1ac2a00700 1 -- 172.21.15.28:0/709945389 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1abc003be0 con 0x7f1acc10a100 2024-06-06T08:31:43.957 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.872+0000 7f1ad0a00700 1 -- 172.21.15.28:0/709945389 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1acc19e780 con 0x7f1acc10a100 2024-06-06T08:31:43.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.872+0000 7f1ac2a00700 1 -- 172.21.15.28:0/709945389 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1abc01a720 con 0x7f1acc10a100 2024-06-06T08:31:43.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.872+0000 7f1ad0a00700 1 -- 172.21.15.28:0/709945389 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1acc19ebe0 con 0x7f1acc10a100 2024-06-06T08:31:43.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.873+0000 7f1ac2a00700 1 -- 172.21.15.28:0/709945389 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f1abc024aa0 con 0x7f1acc10a100 2024-06-06T08:31:43.958 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.873+0000 7f1ad0a00700 1 -- 172.21.15.28:0/709945389 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1acc063af0 con 0x7f1acc10a100 2024-06-06T08:31:43.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.874+0000 7f1ac2a00700 1 --2- 172.21.15.28:0/709945389 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1ab0039100 0x7f1ab003b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:43.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.874+0000 7f1ac2a00700 1 -- 172.21.15.28:0/709945389 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1abc04d790 con 0x7f1acc10a100 2024-06-06T08:31:43.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.874+0000 7f1ac9400700 1 --2- 172.21.15.28:0/709945389 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1ab0039100 0x7f1ab003b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:43.959 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.875+0000 7f1ac9400700 1 --2- 172.21.15.28:0/709945389 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1ab0039100 0x7f1ab003b5c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8006fd0 tx=0x7f1ab8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:43.960 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:42.880+0000 7f1ac2a00700 1 -- 172.21.15.28:0/709945389 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1abc011e20 con 0x7f1acc10a100 2024-06-06T08:31:43.960 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.132+0000 7f1ad0a00700 1 -- 172.21.15.28:0/709945389 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f1acc107b20 con 0x7f1ab0039100 2024-06-06T08:31:43.960 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.235+0000 7f1ac2a00700 1 -- 172.21.15.28:0/709945389 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f1acc107b20 con 0x7f1ab0039100 2024-06-06T08:31:43.960 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.240+0000 7f1ad0a00700 1 -- 172.21.15.28:0/709945389 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1ab0039100 msgr2=0x7f1ab003b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:43.961 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.240+0000 7f1ad0a00700 1 --2- 172.21.15.28:0/709945389 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1ab0039100 0x7f1ab003b5c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8006fd0 tx=0x7f1ab8006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:43.961 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.240+0000 7f1ad0a00700 1 -- 172.21.15.28:0/709945389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 msgr2=0x7f1acc19dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:43.961 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.240+0000 7f1ad0a00700 1 --2- 172.21.15.28:0/709945389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc19dfb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0116a0 tx=0x7f1abc011ba0 comp rx=0 tx=0).stop 2024-06-06T08:31:43.961 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.240+0000 7f1ad0a00700 1 -- 172.21.15.28:0/709945389 shutdown_connections 2024-06-06T08:31:43.961 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.240+0000 7f1ad0a00700 1 --2- 172.21.15.28:0/709945389 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1ab0039100 0x7f1ab003b5c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:43.962 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.240+0000 7f1ad0a00700 1 --2- 172.21.15.28:0/709945389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1acc10a100 0x7f1acc19dfb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:43.962 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.240+0000 7f1ad0a00700 1 -- 172.21.15.28:0/709945389 >> 172.21.15.28:0/709945389 conn(0x7f1acc07d6d0 msgr2=0x7f1acc107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:43.962 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.240+0000 7f1ad0a00700 1 -- 172.21.15.28:0/709945389 shutdown_connections 2024-06-06T08:31:43.962 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:43.240+0000 7f1ad0a00700 1 -- 172.21.15.28:0/709945389 wait complete. 2024-06-06T08:31:43.962 INFO:teuthology.orchestra.run.smithi028.stdout:Creating initial admin user... 2024-06-06T08:31:44.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:44 smithi028 ceph-mon[31564]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:31:44.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:44 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:31:44.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:44 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:31:45.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$VWwNTVWgBCuI3cL1jAe/LOkhkB0c8EkQgww.5oK5PEIFFoywGtXL6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1717662705, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-06-06T08:31:45.840 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.601+0000 7f7da4e00700 1 Processor -- start 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.602+0000 7f7da4e00700 1 -- start start 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.602+0000 7f7da4e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da010ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.602+0000 7f7da4e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7da007bec0 con 0x7f7da0108930 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.602+0000 7f7d9de00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da010ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.603+0000 7f7d9de00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da010ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33154/0 (socket says 172.21.15.28:33154) 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.603+0000 7f7d9de00700 1 -- 172.21.15.28:0/1408195551 learned_addr learned my addr 172.21.15.28:0/1408195551 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.603+0000 7f7d9de00700 1 -- 172.21.15.28:0/1408195551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da010b260 con 0x7f7da0108930 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.603+0000 7f7d9de00700 1 --2- 172.21.15.28:0/1408195551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da010ad20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d900098a0 tx=0x7f7d90009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d6ffeef71ea3a8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.604+0000 7f7d9ca00700 1 -- 172.21.15.28:0/1408195551 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d90004160 con 0x7f7da0108930 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.604+0000 7f7d9ca00700 1 -- 172.21.15.28:0/1408195551 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d90004300 con 0x7f7da0108930 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.604+0000 7f7d9ca00700 1 -- 172.21.15.28:0/1408195551 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d90011b20 con 0x7f7da0108930 2024-06-06T08:31:45.841 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.605+0000 7f7da4e00700 1 -- 172.21.15.28:0/1408195551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 msgr2=0x7f7da010ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:45.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.605+0000 7f7da4e00700 1 --2- 172.21.15.28:0/1408195551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da010ad20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d900098a0 tx=0x7f7d90009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:45.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.605+0000 7f7da4e00700 1 -- 172.21.15.28:0/1408195551 shutdown_connections 2024-06-06T08:31:45.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.605+0000 7f7da4e00700 1 --2- 172.21.15.28:0/1408195551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da010ad20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:45.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.605+0000 7f7da4e00700 1 -- 172.21.15.28:0/1408195551 >> 172.21.15.28:0/1408195551 conn(0x7f7da0102340 msgr2=0x7f7da01047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:45.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.605+0000 7f7da4e00700 1 -- 172.21.15.28:0/1408195551 shutdown_connections 2024-06-06T08:31:45.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.605+0000 7f7da4e00700 1 -- 172.21.15.28:0/1408195551 wait complete. 2024-06-06T08:31:45.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.606+0000 7f7da4e00700 1 Processor -- start 2024-06-06T08:31:45.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.606+0000 7f7da4e00700 1 -- start start 2024-06-06T08:31:45.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.606+0000 7f7da4e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da019df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:45.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.606+0000 7f7da4e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7da010c2d0 con 0x7f7da0108930 2024-06-06T08:31:45.842 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.607+0000 7f7d9de00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da019df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.607+0000 7f7d9de00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da019df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33162/0 (socket says 172.21.15.28:33162) 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.607+0000 7f7d9de00700 1 -- 172.21.15.28:0/3255062738 learned_addr learned my addr 172.21.15.28:0/3255062738 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.607+0000 7f7d9de00700 1 -- 172.21.15.28:0/3255062738 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da019e460 con 0x7f7da0108930 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.608+0000 7f7d9de00700 1 --2- 172.21.15.28:0/3255062738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da019df20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d900117e0 tx=0x7f7d90011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.608+0000 7f7d96a00700 1 -- 172.21.15.28:0/3255062738 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d90003ba0 con 0x7f7da0108930 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.608+0000 7f7d96a00700 1 -- 172.21.15.28:0/3255062738 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d9001a910 con 0x7f7da0108930 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.608+0000 7f7da4e00700 1 -- 172.21.15.28:0/3255062738 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da019e6f0 con 0x7f7da0108930 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.608+0000 7f7d96a00700 1 -- 172.21.15.28:0/3255062738 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d900248f0 con 0x7f7da0108930 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.608+0000 7f7da4e00700 1 -- 172.21.15.28:0/3255062738 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da019eb50 con 0x7f7da0108930 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.609+0000 7f7da4e00700 1 -- 172.21.15.28:0/3255062738 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da0063af0 con 0x7f7da0108930 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.610+0000 7f7d96a00700 1 -- 172.21.15.28:0/3255062738 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f7d90022020 con 0x7f7da0108930 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.610+0000 7f7d96a00700 1 --2- 172.21.15.28:0/3255062738 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d84039100 0x7f7d8403b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:45.843 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.610+0000 7f7d96a00700 1 -- 172.21.15.28:0/3255062738 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7d9004d5b0 con 0x7f7da0108930 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.611+0000 7f7d9d400700 1 --2- 172.21.15.28:0/3255062738 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d84039100 0x7f7d8403b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.612+0000 7f7d9d400700 1 --2- 172.21.15.28:0/3255062738 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d84039100 0x7f7d8403b5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c006fd0 tx=0x7f7d8c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.616+0000 7f7d96a00700 1 -- 172.21.15.28:0/3255062738 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7d9001ab70 con 0x7f7da0108930 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:44.867+0000 7f7da4e00700 1 -- 172.21.15.28:0/3255062738 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f7da01a1560 con 0x7f7d84039100 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:45.151+0000 7f7d96a00700 1 -- 172.21.15.28:0/3255062738 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f7da01a1560 con 0x7f7d84039100 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:45.154+0000 7f7da4e00700 1 -- 172.21.15.28:0/3255062738 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d84039100 msgr2=0x7f7d8403b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:45.154+0000 7f7da4e00700 1 --2- 172.21.15.28:0/3255062738 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d84039100 0x7f7d8403b5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c006fd0 tx=0x7f7d8c006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:45.154+0000 7f7da4e00700 1 -- 172.21.15.28:0/3255062738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 msgr2=0x7f7da019df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:45.154+0000 7f7da4e00700 1 --2- 172.21.15.28:0/3255062738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da019df20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d900117e0 tx=0x7f7d90011ba0 comp rx=0 tx=0).stop 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:45.154+0000 7f7da4e00700 1 -- 172.21.15.28:0/3255062738 shutdown_connections 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:45.154+0000 7f7da4e00700 1 --2- 172.21.15.28:0/3255062738 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d84039100 0x7f7d8403b5c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:45.154+0000 7f7da4e00700 1 --2- 172.21.15.28:0/3255062738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7da0108930 0x7f7da019df20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:45.844 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:45.154+0000 7f7da4e00700 1 -- 172.21.15.28:0/3255062738 >> 172.21.15.28:0/3255062738 conn(0x7f7da0102340 msgr2=0x7f7da0102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:45.845 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:45.155+0000 7f7da4e00700 1 -- 172.21.15.28:0/3255062738 shutdown_connections 2024-06-06T08:31:45.845 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:45.155+0000 7f7da4e00700 1 -- 172.21.15.28:0/3255062738 wait complete. 2024-06-06T08:31:45.845 INFO:teuthology.orchestra.run.smithi028.stdout:Fetching dashboard port number... 2024-06-06T08:31:46.142 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:45 smithi028 ceph-mon[31564]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:31:46.143 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:31:46.143 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:31:47.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:47 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2095538669' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-06-06T08:31:48.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:48 smithi028 ceph-mon[31564]: mgrmap e13: x(active, since 6s) 2024-06-06T08:31:48.309 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stdout 8443 2024-06-06T08:31:48.310 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.469+0000 7f96a2c00700 1 Processor -- start 2024-06-06T08:31:48.311 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.469+0000 7f96a2c00700 1 -- start start 2024-06-06T08:31:48.311 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.470+0000 7f96a2c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c106b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:48.311 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.470+0000 7f96a2c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f969c07bec0 con 0x7f969c106720 2024-06-06T08:31:48.311 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.470+0000 7f969be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c106b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:48.311 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.470+0000 7f969be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c106b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60046/0 (socket says 172.21.15.28:60046) 2024-06-06T08:31:48.315 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.470+0000 7f969be00700 1 -- 172.21.15.28:0/728671050 learned_addr learned my addr 172.21.15.28:0/728671050 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:48.315 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.471+0000 7f969be00700 1 -- 172.21.15.28:0/728671050 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c107080 con 0x7f969c106720 2024-06-06T08:31:48.315 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.471+0000 7f969be00700 1 --2- 172.21.15.28:0/728671050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c106b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f968c0098a0 tx=0x7f968c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da699662aa7d9225 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:48.315 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.471+0000 7f969aa00700 1 -- 172.21.15.28:0/728671050 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f968c004160 con 0x7f969c106720 2024-06-06T08:31:48.315 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.472+0000 7f969aa00700 1 -- 172.21.15.28:0/728671050 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f968c004300 con 0x7f969c106720 2024-06-06T08:31:48.315 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.472+0000 7f969aa00700 1 -- 172.21.15.28:0/728671050 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f968c011b20 con 0x7f969c106720 2024-06-06T08:31:48.315 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.472+0000 7f96a2c00700 1 -- 172.21.15.28:0/728671050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 msgr2=0x7f969c106b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:48.315 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.472+0000 7f96a2c00700 1 --2- 172.21.15.28:0/728671050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c106b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f968c0098a0 tx=0x7f968c009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.472+0000 7f96a2c00700 1 -- 172.21.15.28:0/728671050 shutdown_connections 2024-06-06T08:31:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.472+0000 7f96a2c00700 1 --2- 172.21.15.28:0/728671050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c106b40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.472+0000 7f96a2c00700 1 -- 172.21.15.28:0/728671050 >> 172.21.15.28:0/728671050 conn(0x7f969c102340 msgr2=0x7f969c1047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.473+0000 7f96a2c00700 1 -- 172.21.15.28:0/728671050 shutdown_connections 2024-06-06T08:31:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.473+0000 7f96a2c00700 1 -- 172.21.15.28:0/728671050 wait complete. 2024-06-06T08:31:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.474+0000 7f96a2c00700 1 Processor -- start 2024-06-06T08:31:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.474+0000 7f96a2c00700 1 -- start start 2024-06-06T08:31:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.474+0000 7f96a2c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c19df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.474+0000 7f96a2c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f969c108150 con 0x7f969c106720 2024-06-06T08:31:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.474+0000 7f969be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c19df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:48.317 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.474+0000 7f969be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c19df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60054/0 (socket says 172.21.15.28:60054) 2024-06-06T08:31:48.317 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.474+0000 7f969be00700 1 -- 172.21.15.28:0/2095538669 learned_addr learned my addr 172.21.15.28:0/2095538669 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:48.317 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.475+0000 7f969be00700 1 -- 172.21.15.28:0/2095538669 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c19e4b0 con 0x7f969c106720 2024-06-06T08:31:48.317 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.475+0000 7f969be00700 1 --2- 172.21.15.28:0/2095538669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c19df70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f968c0117e0 tx=0x7f968c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:48.317 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.475+0000 7f9698c00700 1 -- 172.21.15.28:0/2095538669 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f968c003ba0 con 0x7f969c106720 2024-06-06T08:31:48.317 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.475+0000 7f9698c00700 1 -- 172.21.15.28:0/2095538669 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f968c01a910 con 0x7f969c106720 2024-06-06T08:31:48.317 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.475+0000 7f9698c00700 1 -- 172.21.15.28:0/2095538669 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f968c0248f0 con 0x7f969c106720 2024-06-06T08:31:48.317 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.475+0000 7f96a2c00700 1 -- 172.21.15.28:0/2095538669 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969c19e740 con 0x7f969c106720 2024-06-06T08:31:48.317 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.476+0000 7f96a2c00700 1 -- 172.21.15.28:0/2095538669 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969c19eba0 con 0x7f969c106720 2024-06-06T08:31:48.317 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.477+0000 7f9698c00700 1 -- 172.21.15.28:0/2095538669 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f968c022020 con 0x7f969c106720 2024-06-06T08:31:48.318 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.477+0000 7f96a2c00700 1 -- 172.21.15.28:0/2095538669 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f969c063af0 con 0x7f969c106720 2024-06-06T08:31:48.318 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.477+0000 7f9698c00700 1 --2- 172.21.15.28:0/2095538669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f96800390a0 0x7f968003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.477+0000 7f9698c00700 1 -- 172.21.15.28:0/2095538669 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f968c04dac0 con 0x7f969c106720 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.478+0000 7f969b400700 1 --2- 172.21.15.28:0/2095538669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f96800390a0 0x7f968003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.478+0000 7f969b400700 1 --2- 172.21.15.28:0/2095538669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f96800390a0 0x7f968003b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9688006fd0 tx=0x7f9688006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.484+0000 7f9698c00700 1 -- 172.21.15.28:0/2095538669 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f968c00f2e0 con 0x7f969c106720 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.736+0000 7f96a2c00700 1 -- 172.21.15.28:0/2095538669 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f969c0630a0 con 0x7f969c106720 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.737+0000 7f9698c00700 1 -- 172.21.15.28:0/2095538669 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f968c02d3f0 con 0x7f969c106720 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.740+0000 7f96a2c00700 1 -- 172.21.15.28:0/2095538669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f96800390a0 msgr2=0x7f968003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.740+0000 7f96a2c00700 1 --2- 172.21.15.28:0/2095538669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f96800390a0 0x7f968003b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9688006fd0 tx=0x7f9688006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.740+0000 7f96a2c00700 1 -- 172.21.15.28:0/2095538669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 msgr2=0x7f969c19df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.740+0000 7f96a2c00700 1 --2- 172.21.15.28:0/2095538669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c19df70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f968c0117e0 tx=0x7f968c011ba0 comp rx=0 tx=0).stop 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.740+0000 7f96a2c00700 1 -- 172.21.15.28:0/2095538669 shutdown_connections 2024-06-06T08:31:48.320 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.740+0000 7f96a2c00700 1 --2- 172.21.15.28:0/2095538669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f96800390a0 0x7f968003b560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:48.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.740+0000 7f96a2c00700 1 --2- 172.21.15.28:0/2095538669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f969c106720 0x7f969c19df70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:48.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.740+0000 7f96a2c00700 1 -- 172.21.15.28:0/2095538669 >> 172.21.15.28:0/2095538669 conn(0x7f969c102340 msgr2=0x7f969c194b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:48.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.741+0000 7f96a2c00700 1 -- 172.21.15.28:0/2095538669 shutdown_connections 2024-06-06T08:31:48.321 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:46.741+0000 7f96a2c00700 1 -- 172.21.15.28:0/2095538669 wait complete. 2024-06-06T08:31:48.347 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T08:31:48.347 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout disabled 2024-06-06T08:31:48.374 INFO:teuthology.orchestra.run.smithi028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T08:31:48.378 INFO:teuthology.orchestra.run.smithi028.stdout:systemctl: stdout inactive 2024-06-06T08:31:48.378 INFO:teuthology.orchestra.run.smithi028.stdout:firewalld.service is not enabled 2024-06-06T08:31:48.378 INFO:teuthology.orchestra.run.smithi028.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-06-06T08:31:48.382 INFO:teuthology.orchestra.run.smithi028.stdout:Ceph Dashboard is now available at: 2024-06-06T08:31:48.382 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:31:48.382 INFO:teuthology.orchestra.run.smithi028.stdout: URL: https://smithi028.front.sepia.ceph.com:8443/ 2024-06-06T08:31:48.382 INFO:teuthology.orchestra.run.smithi028.stdout: User: admin 2024-06-06T08:31:48.382 INFO:teuthology.orchestra.run.smithi028.stdout: Password: bx33pqfx72 2024-06-06T08:31:48.382 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:31:48.383 INFO:teuthology.orchestra.run.smithi028.stdout:Saving cluster configuration to /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config directory 2024-06-06T08:31:48.385 INFO:teuthology.orchestra.run.smithi028.stdout:Enabling autotune for osd_memory_target 2024-06-06T08:31:50.026 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.012+0000 7f0801c00700 1 Processor -- start 2024-06-06T08:31:50.026 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.012+0000 7f0801c00700 1 -- start start 2024-06-06T08:31:50.026 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.013+0000 7f0801c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc108290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:50.026 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.013+0000 7f0801c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc1087d0 con 0x7f07fc107e70 2024-06-06T08:31:50.026 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.013+0000 7f07faa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc108290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:50.026 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.013+0000 7f07faa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc108290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60066/0 (socket says 172.21.15.28:60066) 2024-06-06T08:31:50.026 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.013+0000 7f07faa00700 1 -- 172.21.15.28:0/2453496831 learned_addr learned my addr 172.21.15.28:0/2453496831 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:50.026 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.014+0000 7f07faa00700 1 -- 172.21.15.28:0/2453496831 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc109060 con 0x7f07fc107e70 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.014+0000 7f07faa00700 1 --2- 172.21.15.28:0/2453496831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc108290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0098a0 tx=0x7f07ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c617f8978966f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.014+0000 7f07fa000700 1 -- 172.21.15.28:0/2453496831 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec004160 con 0x7f07fc107e70 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.015+0000 7f07fa000700 1 -- 172.21.15.28:0/2453496831 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07ec004300 con 0x7f07fc107e70 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.015+0000 7f07fa000700 1 -- 172.21.15.28:0/2453496831 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec011b20 con 0x7f07fc107e70 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.015+0000 7f0801c00700 1 -- 172.21.15.28:0/2453496831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 msgr2=0x7f07fc108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.015+0000 7f0801c00700 1 --2- 172.21.15.28:0/2453496831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc108290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0098a0 tx=0x7f07ec009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.015+0000 7f0801c00700 1 -- 172.21.15.28:0/2453496831 shutdown_connections 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.015+0000 7f0801c00700 1 --2- 172.21.15.28:0/2453496831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc108290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.015+0000 7f0801c00700 1 -- 172.21.15.28:0/2453496831 >> 172.21.15.28:0/2453496831 conn(0x7f07fc103480 msgr2=0x7f07fc1058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.015+0000 7f0801c00700 1 -- 172.21.15.28:0/2453496831 shutdown_connections 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.015+0000 7f0801c00700 1 -- 172.21.15.28:0/2453496831 wait complete. 2024-06-06T08:31:50.027 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.016+0000 7f0801c00700 1 Processor -- start 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.017+0000 7f0801c00700 1 -- start start 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.017+0000 7f0801c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc07db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.017+0000 7f0801c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc10c320 con 0x7f07fc107e70 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.017+0000 7f07faa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc07db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.017+0000 7f07faa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc07db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60076/0 (socket says 172.21.15.28:60076) 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.017+0000 7f07faa00700 1 -- 172.21.15.28:0/4206095953 learned_addr learned my addr 172.21.15.28:0/4206095953 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.018+0000 7f07faa00700 1 -- 172.21.15.28:0/4206095953 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc07e0c0 con 0x7f07fc107e70 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.018+0000 7f07faa00700 1 --2- 172.21.15.28:0/4206095953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc07db80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0117e0 tx=0x7f07ec011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.018+0000 7f07f3e00700 1 -- 172.21.15.28:0/4206095953 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec003bf0 con 0x7f07fc107e70 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.018+0000 7f07f3e00700 1 -- 172.21.15.28:0/4206095953 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07ec01a910 con 0x7f07fc107e70 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.018+0000 7f07f3e00700 1 -- 172.21.15.28:0/4206095953 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec024970 con 0x7f07fc107e70 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.018+0000 7f0801c00700 1 -- 172.21.15.28:0/4206095953 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc07c2b0 con 0x7f07fc107e70 2024-06-06T08:31:50.028 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.018+0000 7f0801c00700 1 -- 172.21.15.28:0/4206095953 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc07c770 con 0x7f07fc107e70 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.019+0000 7f0801c00700 1 -- 172.21.15.28:0/4206095953 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07fc063af0 con 0x7f07fc107e70 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.020+0000 7f07f3e00700 1 -- 172.21.15.28:0/4206095953 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f07ec022020 con 0x7f07fc107e70 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.020+0000 7f07f3e00700 1 --2- 172.21.15.28:0/4206095953 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f07e00391a0 0x7f07e003b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.020+0000 7f07f3e00700 1 -- 172.21.15.28:0/4206095953 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f07ec04d5d0 con 0x7f07fc107e70 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.020+0000 7f07f2000700 1 --2- 172.21.15.28:0/4206095953 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f07e00391a0 0x7f07e003b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.021+0000 7f07f2000700 1 --2- 172.21.15.28:0/4206095953 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f07e00391a0 0x7f07e003b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f07e400ad30 tx=0x7f07e40093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.026+0000 7f07f3e00700 1 -- 172.21.15.28:0/4206095953 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f07ec010380 con 0x7f07fc107e70 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.252+0000 7f0801c00700 1 -- 172.21.15.28:0/4206095953 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f07fc07cf80 con 0x7f07fc107e70 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.253+0000 7f07f3e00700 1 -- 172.21.15.28:0/4206095953 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f07ec0212c0 con 0x7f07fc107e70 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.256+0000 7f0801c00700 1 -- 172.21.15.28:0/4206095953 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f07e00391a0 msgr2=0x7f07e003b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.256+0000 7f0801c00700 1 --2- 172.21.15.28:0/4206095953 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f07e00391a0 0x7f07e003b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f07e400ad30 tx=0x7f07e40093f0 comp rx=0 tx=0).stop 2024-06-06T08:31:50.029 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.256+0000 7f0801c00700 1 -- 172.21.15.28:0/4206095953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 msgr2=0x7f07fc07db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:50.030 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.256+0000 7f0801c00700 1 --2- 172.21.15.28:0/4206095953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc07db80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0117e0 tx=0x7f07ec011ba0 comp rx=0 tx=0).stop 2024-06-06T08:31:50.030 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.257+0000 7f0801c00700 1 -- 172.21.15.28:0/4206095953 shutdown_connections 2024-06-06T08:31:50.030 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.257+0000 7f0801c00700 1 --2- 172.21.15.28:0/4206095953 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f07e00391a0 0x7f07e003b660 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:50.030 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.257+0000 7f0801c00700 1 --2- 172.21.15.28:0/4206095953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07fc107e70 0x7f07fc07db80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:50.030 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.257+0000 7f0801c00700 1 -- 172.21.15.28:0/4206095953 >> 172.21.15.28:0/4206095953 conn(0x7f07fc103480 msgr2=0x7f07fc103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:50.030 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.257+0000 7f0801c00700 1 -- 172.21.15.28:0/4206095953 shutdown_connections 2024-06-06T08:31:50.030 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:49.257+0000 7f0801c00700 1 -- 172.21.15.28:0/4206095953 wait complete. 2024-06-06T08:31:51.795 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.671+0000 7ff297200700 1 Processor -- start 2024-06-06T08:31:51.795 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.671+0000 7ff297200700 1 -- start start 2024-06-06T08:31:51.796 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.672+0000 7ff297200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29810a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:51.796 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.672+0000 7ff297200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff29810aab0 con 0x7ff29810a0c0 2024-06-06T08:31:51.804 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.672+0000 7ff295e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29810a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:51.804 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.672+0000 7ff295e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29810a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60090/0 (socket says 172.21.15.28:60090) 2024-06-06T08:31:51.804 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.672+0000 7ff295e00700 1 -- 172.21.15.28:0/3905201125 learned_addr learned my addr 172.21.15.28:0/3905201125 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:51.804 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.673+0000 7ff295e00700 1 -- 172.21.15.28:0/3905201125 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29810ac30 con 0x7ff29810a0c0 2024-06-06T08:31:51.804 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.673+0000 7ff295e00700 1 --2- 172.21.15.28:0/3905201125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29810a4e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2880098a0 tx=0x7ff288009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22628fa5dfffdce8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:51.805 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.674+0000 7ff294a00700 1 -- 172.21.15.28:0/3905201125 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff288004160 con 0x7ff29810a0c0 2024-06-06T08:31:51.805 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.674+0000 7ff294a00700 1 -- 172.21.15.28:0/3905201125 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff288004300 con 0x7ff29810a0c0 2024-06-06T08:31:51.805 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.674+0000 7ff294a00700 1 -- 172.21.15.28:0/3905201125 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff288011b20 con 0x7ff29810a0c0 2024-06-06T08:31:51.805 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.674+0000 7ff297200700 1 -- 172.21.15.28:0/3905201125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 msgr2=0x7ff29810a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:51.805 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.674+0000 7ff297200700 1 --2- 172.21.15.28:0/3905201125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29810a4e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2880098a0 tx=0x7ff288009bb0 comp rx=0 tx=0).stop 2024-06-06T08:31:51.805 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.675+0000 7ff297200700 1 -- 172.21.15.28:0/3905201125 shutdown_connections 2024-06-06T08:31:51.805 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.675+0000 7ff297200700 1 --2- 172.21.15.28:0/3905201125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29810a4e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:51.805 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.675+0000 7ff297200700 1 -- 172.21.15.28:0/3905201125 >> 172.21.15.28:0/3905201125 conn(0x7ff29807d2f0 msgr2=0x7ff29807d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:51.806 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.675+0000 7ff297200700 1 -- 172.21.15.28:0/3905201125 shutdown_connections 2024-06-06T08:31:51.806 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.675+0000 7ff297200700 1 -- 172.21.15.28:0/3905201125 wait complete. 2024-06-06T08:31:51.806 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.676+0000 7ff297200700 1 Processor -- start 2024-06-06T08:31:51.806 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.676+0000 7ff297200700 1 -- start start 2024-06-06T08:31:51.806 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.676+0000 7ff297200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29819ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:51.806 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.676+0000 7ff297200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff29810e340 con 0x7ff29810a0c0 2024-06-06T08:31:51.806 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.677+0000 7ff295e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29819ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:51.806 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.677+0000 7ff295e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29819ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60094/0 (socket says 172.21.15.28:60094) 2024-06-06T08:31:51.807 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.677+0000 7ff295e00700 1 -- 172.21.15.28:0/530833587 learned_addr learned my addr 172.21.15.28:0/530833587 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:51.807 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.677+0000 7ff295e00700 1 -- 172.21.15.28:0/530833587 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29819e2f0 con 0x7ff29810a0c0 2024-06-06T08:31:51.807 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.677+0000 7ff295e00700 1 --2- 172.21.15.28:0/530833587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29819ddb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff2880117e0 tx=0x7ff288011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:51.807 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.678+0000 7ff28ea00700 1 -- 172.21.15.28:0/530833587 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff288003ba0 con 0x7ff29810a0c0 2024-06-06T08:31:51.807 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.678+0000 7ff28ea00700 1 -- 172.21.15.28:0/530833587 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff28801a910 con 0x7ff29810a0c0 2024-06-06T08:31:51.807 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.678+0000 7ff297200700 1 -- 172.21.15.28:0/530833587 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29819e580 con 0x7ff29810a0c0 2024-06-06T08:31:51.807 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.678+0000 7ff28ea00700 1 -- 172.21.15.28:0/530833587 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2880248f0 con 0x7ff29810a0c0 2024-06-06T08:31:51.807 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.678+0000 7ff297200700 1 -- 172.21.15.28:0/530833587 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff29819e9e0 con 0x7ff29810a0c0 2024-06-06T08:31:51.808 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.679+0000 7ff297200700 1 -- 172.21.15.28:0/530833587 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff298063af0 con 0x7ff29810a0c0 2024-06-06T08:31:51.808 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.679+0000 7ff28ea00700 1 -- 172.21.15.28:0/530833587 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff288022020 con 0x7ff29810a0c0 2024-06-06T08:31:51.808 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.680+0000 7ff28ea00700 1 --2- 172.21.15.28:0/530833587 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff27c039140 0x7ff27c03b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:51.808 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.680+0000 7ff28ea00700 1 -- 172.21.15.28:0/530833587 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff28804dbb0 con 0x7ff29810a0c0 2024-06-06T08:31:51.808 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.680+0000 7ff295400700 1 --2- 172.21.15.28:0/530833587 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff27c039140 0x7ff27c03b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:51.808 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.681+0000 7ff295400700 1 --2- 172.21.15.28:0/530833587 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff27c039140 0x7ff27c03b600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff284006fd0 tx=0x7ff284006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:51.808 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:50.685+0000 7ff28ea00700 1 -- 172.21.15.28:0/530833587 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff288010380 con 0x7ff29810a0c0 2024-06-06T08:31:51.808 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.034+0000 7ff297200700 1 -- 172.21.15.28:0/530833587 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7ff2981a1220 con 0x7ff29810a0c0 2024-06-06T08:31:51.808 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.037+0000 7ff28ea00700 1 -- 172.21.15.28:0/530833587 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7ff2880212c0 con 0x7ff29810a0c0 2024-06-06T08:31:51.809 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.040+0000 7ff297200700 1 -- 172.21.15.28:0/530833587 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff27c039140 msgr2=0x7ff27c03b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:51.809 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.040+0000 7ff297200700 1 --2- 172.21.15.28:0/530833587 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff27c039140 0x7ff27c03b600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff284006fd0 tx=0x7ff284006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:51.809 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.040+0000 7ff297200700 1 -- 172.21.15.28:0/530833587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 msgr2=0x7ff29819ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:51.809 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.040+0000 7ff297200700 1 --2- 172.21.15.28:0/530833587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29819ddb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff2880117e0 tx=0x7ff288011ba0 comp rx=0 tx=0).stop 2024-06-06T08:31:51.809 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.041+0000 7ff297200700 1 -- 172.21.15.28:0/530833587 shutdown_connections 2024-06-06T08:31:51.809 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.041+0000 7ff297200700 1 --2- 172.21.15.28:0/530833587 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff27c039140 0x7ff27c03b600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:51.809 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.041+0000 7ff297200700 1 --2- 172.21.15.28:0/530833587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff29810a0c0 0x7ff29819ddb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:51.809 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.041+0000 7ff297200700 1 -- 172.21.15.28:0/530833587 >> 172.21.15.28:0/530833587 conn(0x7ff29807d2f0 msgr2=0x7ff298107c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:51.810 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.041+0000 7ff297200700 1 -- 172.21.15.28:0/530833587 shutdown_connections 2024-06-06T08:31:51.810 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr 2024-06-06T08:31:51.041+0000 7ff297200700 1 -- 172.21.15.28:0/530833587 wait complete. 2024-06-06T08:31:51.810 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-06-06T08:31:51.810 INFO:teuthology.orchestra.run.smithi028.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-06-06T08:31:51.810 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:31:51.810 INFO:teuthology.orchestra.run.smithi028.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-06-06T08:31:51.810 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:31:51.810 INFO:teuthology.orchestra.run.smithi028.stdout:Or, if you are only running a single cluster on this host: 2024-06-06T08:31:51.810 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:31:51.810 INFO:teuthology.orchestra.run.smithi028.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-06-06T08:31:51.811 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:31:51.811 INFO:teuthology.orchestra.run.smithi028.stdout:Please consider enabling telemetry to help improve Ceph: 2024-06-06T08:31:51.811 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:31:51.811 INFO:teuthology.orchestra.run.smithi028.stdout: ceph telemetry on 2024-06-06T08:31:51.811 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:31:51.811 INFO:teuthology.orchestra.run.smithi028.stdout:For more information see: 2024-06-06T08:31:51.811 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:31:51.811 INFO:teuthology.orchestra.run.smithi028.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-06-06T08:31:51.811 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:31:51.811 INFO:teuthology.orchestra.run.smithi028.stdout:Bootstrap complete. 2024-06-06T08:31:51.885 INFO:tasks.cephadm:Fetching config... 2024-06-06T08:31:51.885 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:31:51.886 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-06-06T08:31:51.939 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-06-06T08:31:51.939 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:31:51.939 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-06-06T08:31:51.981 INFO:tasks.cephadm:Fetching mon keyring... 2024-06-06T08:31:51.981 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:31:51.981 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/keyring of=/dev/stdout 2024-06-06T08:31:52.104 INFO:tasks.cephadm:Fetching pub ssh key... 2024-06-06T08:31:52.105 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:31:52.105 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-06-06T08:31:52.159 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-06-06T08:31:52.160 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU4eikog6Ahx7rqmhxCoHCZWGPm6g1dgL8NUdJ6Ka0NsQrZuOK4pzuMWvS3FGT+EdqYDzFWiBZRDv/dZARtQfEZaYhlYmU1RDEb4xpw0wEPUFWeKCWXBFI8NbToxiinIaxbPqbfw31KDIMPuMk+RQay7DwBAWG8S4WXYRIzGdWmPF5kNabTe0qyx4vBZtjlEv7nr4/T48/xvl7109HYLF6udlcJWmI+vlNLR4O//Q/RHVfwkIZIwccj5beFxRimjoy0N4pzZI3SZDxQCFbr5FllDhm3azYy4vk9+aaGm7hKQuPA62MgkoEgQg91a+meC+ANwF+NMoitBFU/xHjiBao1ciSwoIrstXYkOPDGzAmSzBq00NGPfnh5c8C1+88nbK1Vi6Fe9Ra2dE+TtxqLaBmQDDPqgafyYndtQPnH058cGeeze5mFGrt5aMGYldPCWFzonhegMwRLDkY4kAm0/Obywk6k78ojVxeFPz+f/POH4BI/1J7RkOqPm4rMPT+BlM= ceph-e34a6934-23de-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-06T08:31:52.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:52 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/530833587' entity='client.admin' 2024-06-06T08:31:52.296 INFO:teuthology.orchestra.run.smithi028.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU4eikog6Ahx7rqmhxCoHCZWGPm6g1dgL8NUdJ6Ka0NsQrZuOK4pzuMWvS3FGT+EdqYDzFWiBZRDv/dZARtQfEZaYhlYmU1RDEb4xpw0wEPUFWeKCWXBFI8NbToxiinIaxbPqbfw31KDIMPuMk+RQay7DwBAWG8S4WXYRIzGdWmPF5kNabTe0qyx4vBZtjlEv7nr4/T48/xvl7109HYLF6udlcJWmI+vlNLR4O//Q/RHVfwkIZIwccj5beFxRimjoy0N4pzZI3SZDxQCFbr5FllDhm3azYy4vk9+aaGm7hKQuPA62MgkoEgQg91a+meC+ANwF+NMoitBFU/xHjiBao1ciSwoIrstXYkOPDGzAmSzBq00NGPfnh5c8C1+88nbK1Vi6Fe9Ra2dE+TtxqLaBmQDDPqgafyYndtQPnH058cGeeze5mFGrt5aMGYldPCWFzonhegMwRLDkY4kAm0/Obywk6k78ojVxeFPz+f/POH4BI/1J7RkOqPm4rMPT+BlM= ceph-e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:31:52.337 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU4eikog6Ahx7rqmhxCoHCZWGPm6g1dgL8NUdJ6Ka0NsQrZuOK4pzuMWvS3FGT+EdqYDzFWiBZRDv/dZARtQfEZaYhlYmU1RDEb4xpw0wEPUFWeKCWXBFI8NbToxiinIaxbPqbfw31KDIMPuMk+RQay7DwBAWG8S4WXYRIzGdWmPF5kNabTe0qyx4vBZtjlEv7nr4/T48/xvl7109HYLF6udlcJWmI+vlNLR4O//Q/RHVfwkIZIwccj5beFxRimjoy0N4pzZI3SZDxQCFbr5FllDhm3azYy4vk9+aaGm7hKQuPA62MgkoEgQg91a+meC+ANwF+NMoitBFU/xHjiBao1ciSwoIrstXYkOPDGzAmSzBq00NGPfnh5c8C1+88nbK1Vi6Fe9Ra2dE+TtxqLaBmQDDPqgafyYndtQPnH058cGeeze5mFGrt5aMGYldPCWFzonhegMwRLDkY4kAm0/Obywk6k78ojVxeFPz+f/POH4BI/1J7RkOqPm4rMPT+BlM= ceph-e34a6934-23de-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-06T08:31:52.378 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU4eikog6Ahx7rqmhxCoHCZWGPm6g1dgL8NUdJ6Ka0NsQrZuOK4pzuMWvS3FGT+EdqYDzFWiBZRDv/dZARtQfEZaYhlYmU1RDEb4xpw0wEPUFWeKCWXBFI8NbToxiinIaxbPqbfw31KDIMPuMk+RQay7DwBAWG8S4WXYRIzGdWmPF5kNabTe0qyx4vBZtjlEv7nr4/T48/xvl7109HYLF6udlcJWmI+vlNLR4O//Q/RHVfwkIZIwccj5beFxRimjoy0N4pzZI3SZDxQCFbr5FllDhm3azYy4vk9+aaGm7hKQuPA62MgkoEgQg91a+meC+ANwF+NMoitBFU/xHjiBao1ciSwoIrstXYkOPDGzAmSzBq00NGPfnh5c8C1+88nbK1Vi6Fe9Ra2dE+TtxqLaBmQDDPqgafyYndtQPnH058cGeeze5mFGrt5aMGYldPCWFzonhegMwRLDkY4kAm0/Obywk6k78ojVxeFPz+f/POH4BI/1J7RkOqPm4rMPT+BlM= ceph-e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:31:52.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU4eikog6Ahx7rqmhxCoHCZWGPm6g1dgL8NUdJ6Ka0NsQrZuOK4pzuMWvS3FGT+EdqYDzFWiBZRDv/dZARtQfEZaYhlYmU1RDEb4xpw0wEPUFWeKCWXBFI8NbToxiinIaxbPqbfw31KDIMPuMk+RQay7DwBAWG8S4WXYRIzGdWmPF5kNabTe0qyx4vBZtjlEv7nr4/T48/xvl7109HYLF6udlcJWmI+vlNLR4O//Q/RHVfwkIZIwccj5beFxRimjoy0N4pzZI3SZDxQCFbr5FllDhm3azYy4vk9+aaGm7hKQuPA62MgkoEgQg91a+meC+ANwF+NMoitBFU/xHjiBao1ciSwoIrstXYkOPDGzAmSzBq00NGPfnh5c8C1+88nbK1Vi6Fe9Ra2dE+TtxqLaBmQDDPqgafyYndtQPnH058cGeeze5mFGrt5aMGYldPCWFzonhegMwRLDkY4kAm0/Obywk6k78ojVxeFPz+f/POH4BI/1J7RkOqPm4rMPT+BlM= ceph-e34a6934-23de-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-06T08:31:52.432 INFO:teuthology.orchestra.run.smithi059.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU4eikog6Ahx7rqmhxCoHCZWGPm6g1dgL8NUdJ6Ka0NsQrZuOK4pzuMWvS3FGT+EdqYDzFWiBZRDv/dZARtQfEZaYhlYmU1RDEb4xpw0wEPUFWeKCWXBFI8NbToxiinIaxbPqbfw31KDIMPuMk+RQay7DwBAWG8S4WXYRIzGdWmPF5kNabTe0qyx4vBZtjlEv7nr4/T48/xvl7109HYLF6udlcJWmI+vlNLR4O//Q/RHVfwkIZIwccj5beFxRimjoy0N4pzZI3SZDxQCFbr5FllDhm3azYy4vk9+aaGm7hKQuPA62MgkoEgQg91a+meC+ANwF+NMoitBFU/xHjiBao1ciSwoIrstXYkOPDGzAmSzBq00NGPfnh5c8C1+88nbK1Vi6Fe9Ra2dE+TtxqLaBmQDDPqgafyYndtQPnH058cGeeze5mFGrt5aMGYldPCWFzonhegMwRLDkY4kAm0/Obywk6k78ojVxeFPz+f/POH4BI/1J7RkOqPm4rMPT+BlM= ceph-e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:31:52.444 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-06-06T08:31:52.881 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:31:56.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.059+0000 7fefd9e00700 1 -- 172.21.15.28:0/3868952949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefd40764c0 msgr2=0x7fefd4074920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:56.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.059+0000 7fefd9e00700 1 --2- 172.21.15.28:0/3868952949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefd40764c0 0x7fefd4074920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009910 tx=0x7fefc4009c20 comp rx=0 tx=0).stop 2024-06-06T08:31:56.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.060+0000 7fefd9e00700 1 -- 172.21.15.28:0/3868952949 shutdown_connections 2024-06-06T08:31:56.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.060+0000 7fefd9e00700 1 --2- 172.21.15.28:0/3868952949 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefd40764c0 0x7fefd4074920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:56.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.060+0000 7fefd9e00700 1 -- 172.21.15.28:0/3868952949 >> 172.21.15.28:0/3868952949 conn(0x7fefd40fd480 msgr2=0x7fefd40ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:56.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.060+0000 7fefd9e00700 1 -- 172.21.15.28:0/3868952949 shutdown_connections 2024-06-06T08:31:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.060+0000 7fefd9e00700 1 -- 172.21.15.28:0/3868952949 wait complete. 2024-06-06T08:31:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.061+0000 7fefd9e00700 1 Processor -- start 2024-06-06T08:31:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.061+0000 7fefd9e00700 1 -- start start 2024-06-06T08:31:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.061+0000 7fefd9e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefd40764c0 0x7fefd41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.061+0000 7fefd9e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fefd410a150 con 0x7fefd40764c0 2024-06-06T08:31:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.062+0000 7fefd2a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefd40764c0 0x7fefd41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.062+0000 7fefd2a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefd40764c0 0x7fefd41997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44496/0 (socket says 172.21.15.28:44496) 2024-06-06T08:31:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.062+0000 7fefd2a00700 1 -- 172.21.15.28:0/2785998630 learned_addr learned my addr 172.21.15.28:0/2785998630 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:31:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.062+0000 7fefd2a00700 1 -- 172.21.15.28:0/2785998630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd4199d10 con 0x7fefd40764c0 2024-06-06T08:31:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.062+0000 7fefd2a00700 1 --2- 172.21.15.28:0/2785998630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefd40764c0 0x7fefd41997d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fefc4005850 tx=0x7fefc4005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.063+0000 7fefd8a00700 1 -- 172.21.15.28:0/2785998630 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc4026070 con 0x7fefd40764c0 2024-06-06T08:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.063+0000 7fefd8a00700 1 -- 172.21.15.28:0/2785998630 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc40044a0 con 0x7fefd40764c0 2024-06-06T08:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.063+0000 7fefd8a00700 1 -- 172.21.15.28:0/2785998630 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc4003ab0 con 0x7fefd40764c0 2024-06-06T08:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.063+0000 7fefd9e00700 1 -- 172.21.15.28:0/2785998630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd4199fa0 con 0x7fefd40764c0 2024-06-06T08:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.063+0000 7fefd9e00700 1 -- 172.21.15.28:0/2785998630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd419cc90 con 0x7fefd40764c0 2024-06-06T08:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.064+0000 7fefd9e00700 1 -- 172.21.15.28:0/2785998630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd410a8d0 con 0x7fefd40764c0 2024-06-06T08:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.065+0000 7fefd8a00700 1 -- 172.21.15.28:0/2785998630 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fefc4029070 con 0x7fefd40764c0 2024-06-06T08:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.065+0000 7fefd8a00700 1 --2- 172.21.15.28:0/2785998630 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fefb8039150 0x7fefb803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.065+0000 7fefd8a00700 1 -- 172.21.15.28:0/2785998630 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fefc401e070 con 0x7fefd40764c0 2024-06-06T08:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.065+0000 7fefd2000700 1 --2- 172.21.15.28:0/2785998630 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fefb8039150 0x7fefb803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.066+0000 7fefd2000700 1 --2- 172.21.15.28:0/2785998630 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fefb8039150 0x7fefb803b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fefc0006fd0 tx=0x7fefc0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:31:56.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.076+0000 7fefd8a00700 1 -- 172.21.15.28:0/2785998630 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fefc4013070 con 0x7fefd40764c0 2024-06-06T08:31:56.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.305+0000 7fefd9e00700 1 -- 172.21.15.28:0/2785998630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fefd402ddb0 con 0x7fefd40764c0 2024-06-06T08:31:56.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.310+0000 7fefd8a00700 1 -- 172.21.15.28:0/2785998630 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fefc4030020 con 0x7fefd40764c0 2024-06-06T08:31:56.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.314+0000 7fefd9e00700 1 -- 172.21.15.28:0/2785998630 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fefb8039150 msgr2=0x7fefb803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:56.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.314+0000 7fefd9e00700 1 --2- 172.21.15.28:0/2785998630 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fefb8039150 0x7fefb803b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fefc0006fd0 tx=0x7fefc0006e40 comp rx=0 tx=0).stop 2024-06-06T08:31:56.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.314+0000 7fefd9e00700 1 -- 172.21.15.28:0/2785998630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefd40764c0 msgr2=0x7fefd41997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:31:56.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.314+0000 7fefd9e00700 1 --2- 172.21.15.28:0/2785998630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefd40764c0 0x7fefd41997d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fefc4005850 tx=0x7fefc4005030 comp rx=0 tx=0).stop 2024-06-06T08:31:56.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.314+0000 7fefd9e00700 1 -- 172.21.15.28:0/2785998630 shutdown_connections 2024-06-06T08:31:56.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.314+0000 7fefd9e00700 1 --2- 172.21.15.28:0/2785998630 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fefb8039150 0x7fefb803b610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:56.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.314+0000 7fefd9e00700 1 --2- 172.21.15.28:0/2785998630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefd40764c0 0x7fefd41997d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:31:56.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.314+0000 7fefd9e00700 1 -- 172.21.15.28:0/2785998630 >> 172.21.15.28:0/2785998630 conn(0x7fefd40fd480 msgr2=0x7fefd40fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:31:56.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.315+0000 7fefd9e00700 1 -- 172.21.15.28:0/2785998630 shutdown_connections 2024-06-06T08:31:56.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:31:56.315+0000 7fefd9e00700 1 -- 172.21.15.28:0/2785998630 wait complete. 2024-06-06T08:31:57.128 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-06-06T08:31:57.128 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-06-06T08:31:57.513 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:57 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2785998630' entity='client.admin' 2024-06-06T08:31:57.545 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:31:59.500 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:31:59.501 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:31:59.501 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi028", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:31:59.501 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:31:59.501 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:31:59.501 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:31:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:00.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.293+0000 7fce62400700 1 -- 172.21.15.28:0/63450521 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce5c102990 msgr2=0x7fce5c104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:00.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.293+0000 7fce62400700 1 --2- 172.21.15.28:0/63450521 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce5c102990 0x7fce5c104d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009910 tx=0x7fce4c009c20 comp rx=0 tx=0).stop 2024-06-06T08:32:00.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.293+0000 7fce62400700 1 -- 172.21.15.28:0/63450521 shutdown_connections 2024-06-06T08:32:00.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.293+0000 7fce62400700 1 --2- 172.21.15.28:0/63450521 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce5c102990 0x7fce5c104d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:00.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.293+0000 7fce62400700 1 -- 172.21.15.28:0/63450521 >> 172.21.15.28:0/63450521 conn(0x7fce5c0fc3a0 msgr2=0x7fce5c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:00.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.293+0000 7fce62400700 1 -- 172.21.15.28:0/63450521 shutdown_connections 2024-06-06T08:32:00.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.293+0000 7fce62400700 1 -- 172.21.15.28:0/63450521 wait complete. 2024-06-06T08:32:00.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.295+0000 7fce62400700 1 Processor -- start 2024-06-06T08:32:00.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.295+0000 7fce62400700 1 -- start start 2024-06-06T08:32:00.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.295+0000 7fce62400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce5c102990 0x7fce5c102210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:00.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.295+0000 7fce62400700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c107f30 con 0x7fce5c102990 2024-06-06T08:32:00.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.295+0000 7fce5b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce5c102990 0x7fce5c102210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:00.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.296+0000 7fce5b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce5c102990 0x7fce5c102210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44508/0 (socket says 172.21.15.28:44508) 2024-06-06T08:32:00.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.296+0000 7fce5b400700 1 -- 172.21.15.28:0/1830594686 learned_addr learned my addr 172.21.15.28:0/1830594686 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:32:00.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.296+0000 7fce5b400700 1 -- 172.21.15.28:0/1830594686 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c102750 con 0x7fce5c102990 2024-06-06T08:32:00.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.296+0000 7fce5b400700 1 --2- 172.21.15.28:0/1830594686 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce5c102990 0x7fce5c102210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce4c005950 tx=0x7fce4c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:00.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.297+0000 7fce53e00700 1 -- 172.21.15.28:0/1830594686 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c026070 con 0x7fce5c102990 2024-06-06T08:32:00.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.297+0000 7fce53e00700 1 -- 172.21.15.28:0/1830594686 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce4c00bc30 con 0x7fce5c102990 2024-06-06T08:32:00.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.297+0000 7fce62400700 1 -- 172.21.15.28:0/1830594686 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5c100940 con 0x7fce5c102990 2024-06-06T08:32:00.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.297+0000 7fce53e00700 1 -- 172.21.15.28:0/1830594686 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c003b30 con 0x7fce5c102990 2024-06-06T08:32:00.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.297+0000 7fce62400700 1 -- 172.21.15.28:0/1830594686 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5c100e80 con 0x7fce5c102990 2024-06-06T08:32:00.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.298+0000 7fce62400700 1 -- 172.21.15.28:0/1830594686 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce5c1086b0 con 0x7fce5c102990 2024-06-06T08:32:00.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.298+0000 7fce53e00700 1 -- 172.21.15.28:0/1830594686 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fce4c029070 con 0x7fce5c102990 2024-06-06T08:32:00.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.299+0000 7fce53e00700 1 --2- 172.21.15.28:0/1830594686 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fce400390f0 0x7fce4003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:00.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.299+0000 7fce53e00700 1 -- 172.21.15.28:0/1830594686 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fce4c01e070 con 0x7fce5c102990 2024-06-06T08:32:00.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.299+0000 7fce5aa00700 1 --2- 172.21.15.28:0/1830594686 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fce400390f0 0x7fce4003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:00.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.300+0000 7fce5aa00700 1 --2- 172.21.15.28:0/1830594686 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fce400390f0 0x7fce4003b5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce48006fd0 tx=0x7fce48006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:00.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.304+0000 7fce53e00700 1 -- 172.21.15.28:0/1830594686 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fce4c013070 con 0x7fce5c102990 2024-06-06T08:32:00.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.537+0000 7fce62400700 1 -- 172.21.15.28:0/1830594686 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fce5c190ab0 con 0x7fce400390f0 2024-06-06T08:32:00.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.544+0000 7fce53e00700 1 -- 172.21.15.28:0/1830594686 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fce5c190ab0 con 0x7fce400390f0 2024-06-06T08:32:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.546+0000 7fce62400700 1 -- 172.21.15.28:0/1830594686 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fce400390f0 msgr2=0x7fce4003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.546+0000 7fce62400700 1 --2- 172.21.15.28:0/1830594686 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fce400390f0 0x7fce4003b5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce48006fd0 tx=0x7fce48006e40 comp rx=0 tx=0).stop 2024-06-06T08:32:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.546+0000 7fce62400700 1 -- 172.21.15.28:0/1830594686 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce5c102990 msgr2=0x7fce5c102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.546+0000 7fce62400700 1 --2- 172.21.15.28:0/1830594686 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce5c102990 0x7fce5c102210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce4c005950 tx=0x7fce4c005030 comp rx=0 tx=0).stop 2024-06-06T08:32:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.547+0000 7fce62400700 1 -- 172.21.15.28:0/1830594686 shutdown_connections 2024-06-06T08:32:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.547+0000 7fce62400700 1 --2- 172.21.15.28:0/1830594686 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fce400390f0 0x7fce4003b5b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.547+0000 7fce62400700 1 --2- 172.21.15.28:0/1830594686 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce5c102990 0x7fce5c102210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.547+0000 7fce62400700 1 -- 172.21.15.28:0/1830594686 >> 172.21.15.28:0/1830594686 conn(0x7fce5c0fc3a0 msgr2=0x7fce5c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.547+0000 7fce62400700 1 -- 172.21.15.28:0/1830594686 shutdown_connections 2024-06-06T08:32:00.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:00.547+0000 7fce62400700 1 -- 172.21.15.28:0/1830594686 wait complete. 2024-06-06T08:32:01.264 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi037 2024-06-06T08:32:01.265 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-06-06T08:32:01.265 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/etc/ceph/ceph.conf 2024-06-06T08:32:01.285 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-06-06T08:32:01.286 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T08:32:01.345 INFO:tasks.cephadm:Adding host smithi037 to orchestrator... 2024-06-06T08:32:01.345 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch host add smithi037 2024-06-06T08:32:01.780 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:32:01.927 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:01 smithi028 ceph-mon[31564]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:01.927 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:01 smithi028 ceph-mon[31564]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:32:01.927 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:01.927 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:32:01.927 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:01.927 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:32:01.927 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:01 smithi028 ceph-mon[31564]: Updating smithi028:/etc/ceph/ceph.conf 2024-06-06T08:32:02.909 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:02 smithi028 ceph-mon[31564]: Updating smithi028:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:03.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.743+0000 7fa319400700 1 -- 172.21.15.28:0/1406541656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3140769c0 msgr2=0x7fa314076da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:03.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.743+0000 7fa319400700 1 --2- 172.21.15.28:0/1406541656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3140769c0 0x7fa314076da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa304009910 tx=0x7fa304009c20 comp rx=0 tx=0).stop 2024-06-06T08:32:03.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.743+0000 7fa319400700 1 -- 172.21.15.28:0/1406541656 shutdown_connections 2024-06-06T08:32:03.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.743+0000 7fa319400700 1 --2- 172.21.15.28:0/1406541656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3140769c0 0x7fa314076da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:03.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.743+0000 7fa319400700 1 -- 172.21.15.28:0/1406541656 >> 172.21.15.28:0/1406541656 conn(0x7fa3140ffba0 msgr2=0x7fa314101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:03.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.743+0000 7fa319400700 1 -- 172.21.15.28:0/1406541656 shutdown_connections 2024-06-06T08:32:03.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.743+0000 7fa319400700 1 -- 172.21.15.28:0/1406541656 wait complete. 2024-06-06T08:32:03.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.744+0000 7fa319400700 1 Processor -- start 2024-06-06T08:32:03.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.744+0000 7fa319400700 1 -- start start 2024-06-06T08:32:03.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.745+0000 7fa319400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3140769c0 0x7fa31419dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:03.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.745+0000 7fa319400700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa314112b20 con 0x7fa3140769c0 2024-06-06T08:32:03.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.745+0000 7fa312800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3140769c0 0x7fa31419dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:03.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.745+0000 7fa312800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3140769c0 0x7fa31419dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44522/0 (socket says 172.21.15.28:44522) 2024-06-06T08:32:03.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.745+0000 7fa312800700 1 -- 172.21.15.28:0/4023049343 learned_addr learned my addr 172.21.15.28:0/4023049343 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:32:03.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.746+0000 7fa312800700 1 -- 172.21.15.28:0/4023049343 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31419e4e0 con 0x7fa3140769c0 2024-06-06T08:32:03.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.746+0000 7fa312800700 1 --2- 172.21.15.28:0/4023049343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3140769c0 0x7fa31419dfa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa304005850 tx=0x7fa304005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:03.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.746+0000 7fa30b400700 1 -- 172.21.15.28:0/4023049343 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa304026070 con 0x7fa3140769c0 2024-06-06T08:32:03.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.746+0000 7fa30b400700 1 -- 172.21.15.28:0/4023049343 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa30400bc30 con 0x7fa3140769c0 2024-06-06T08:32:03.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.746+0000 7fa30b400700 1 -- 172.21.15.28:0/4023049343 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa304003a20 con 0x7fa3140769c0 2024-06-06T08:32:03.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.746+0000 7fa319400700 1 -- 172.21.15.28:0/4023049343 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31419e770 con 0x7fa3140769c0 2024-06-06T08:32:03.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.747+0000 7fa319400700 1 -- 172.21.15.28:0/4023049343 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31419ebd0 con 0x7fa3140769c0 2024-06-06T08:32:03.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.748+0000 7fa30b400700 1 -- 172.21.15.28:0/4023049343 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa304029070 con 0x7fa3140769c0 2024-06-06T08:32:03.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.748+0000 7fa319400700 1 -- 172.21.15.28:0/4023049343 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa314078100 con 0x7fa3140769c0 2024-06-06T08:32:03.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.748+0000 7fa30b400700 1 --2- 172.21.15.28:0/4023049343 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2f8039150 0x7fa2f803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:03.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.748+0000 7fa30b400700 1 -- 172.21.15.28:0/4023049343 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa30401e070 con 0x7fa3140769c0 2024-06-06T08:32:03.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.749+0000 7fa311e00700 1 --2- 172.21.15.28:0/4023049343 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2f8039150 0x7fa2f803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:03.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.750+0000 7fa311e00700 1 --2- 172.21.15.28:0/4023049343 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2f8039150 0x7fa2f803b610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa300006fd0 tx=0x7fa300006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:03.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.754+0000 7fa30b400700 1 -- 172.21.15.28:0/4023049343 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa304050030 con 0x7fa3140769c0 2024-06-06T08:32:03.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:03.990+0000 7fa319400700 1 -- 172.21.15.28:0/4023049343 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi037", "target": ["mon-mgr", ""]}) -- 0x7fa31419f300 con 0x7fa2f8039150 2024-06-06T08:32:03.990 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:03 smithi028 ceph-mon[31564]: Updating smithi028:/etc/ceph/ceph.client.admin.keyring 2024-06-06T08:32:03.990 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:03 smithi028 ceph-mon[31564]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:03.990 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:03 smithi028 ceph-mon[31564]: Updating smithi028:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T08:32:03.990 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:03.990 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:03.990 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:06.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:05 smithi028 ceph-mon[31564]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi037", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:32:06.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:05 smithi028 ceph-mon[31564]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:06.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:05 smithi028 ceph-mon[31564]: Deploying cephadm binary to smithi037 2024-06-06T08:32:08.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:07 smithi028 ceph-mon[31564]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:09.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:09.013+0000 7fa30b400700 1 -- 172.21.15.28:0/4023049343 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fa31419f300 con 0x7fa2f8039150 2024-06-06T08:32:09.014 INFO:teuthology.orchestra.run.smithi028.stdout:Added host 'smithi037' with addr '172.21.15.37' 2024-06-06T08:32:09.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:09.017+0000 7fa319400700 1 -- 172.21.15.28:0/4023049343 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2f8039150 msgr2=0x7fa2f803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:09.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:09.017+0000 7fa319400700 1 --2- 172.21.15.28:0/4023049343 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2f8039150 0x7fa2f803b610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa300006fd0 tx=0x7fa300006e40 comp rx=0 tx=0).stop 2024-06-06T08:32:09.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:09.017+0000 7fa319400700 1 -- 172.21.15.28:0/4023049343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3140769c0 msgr2=0x7fa31419dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:09.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:09.017+0000 7fa319400700 1 --2- 172.21.15.28:0/4023049343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3140769c0 0x7fa31419dfa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa304005850 tx=0x7fa304005030 comp rx=0 tx=0).stop 2024-06-06T08:32:09.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:09.017+0000 7fa319400700 1 -- 172.21.15.28:0/4023049343 shutdown_connections 2024-06-06T08:32:09.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:09.017+0000 7fa319400700 1 --2- 172.21.15.28:0/4023049343 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2f8039150 0x7fa2f803b610 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:09.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:09.017+0000 7fa319400700 1 --2- 172.21.15.28:0/4023049343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3140769c0 0x7fa31419dfa0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:09.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:09.017+0000 7fa319400700 1 -- 172.21.15.28:0/4023049343 >> 172.21.15.28:0/4023049343 conn(0x7fa3140ffba0 msgr2=0x7fa3140fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:09.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:09.018+0000 7fa319400700 1 -- 172.21.15.28:0/4023049343 shutdown_connections 2024-06-06T08:32:09.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:09.018+0000 7fa319400700 1 -- 172.21.15.28:0/4023049343 wait complete. 2024-06-06T08:32:09.719 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-06T08:32:10.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:09 smithi028 ceph-mon[31564]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:10.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:09 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:10.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:09 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:32:10.189 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:32:10.612 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:10 smithi028 ceph-mon[31564]: Added host smithi037 2024-06-06T08:32:10.612 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:10.612 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:11.844 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:11 smithi028 ceph-mon[31564]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:12.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.095+0000 7f23ca800700 1 -- 172.21.15.28:0/2764145694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23c4106dd0 msgr2=0x7f23c40698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:12.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.095+0000 7f23ca800700 1 --2- 172.21.15.28:0/2764145694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23c4106dd0 0x7f23c40698b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009910 tx=0x7f23b4009c20 comp rx=0 tx=0).stop 2024-06-06T08:32:12.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.095+0000 7f23ca800700 1 -- 172.21.15.28:0/2764145694 shutdown_connections 2024-06-06T08:32:12.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.095+0000 7f23ca800700 1 --2- 172.21.15.28:0/2764145694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23c4106dd0 0x7f23c40698b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:12.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.095+0000 7f23ca800700 1 -- 172.21.15.28:0/2764145694 >> 172.21.15.28:0/2764145694 conn(0x7f23c40768f0 msgr2=0x7f23c4076d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:12.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.095+0000 7f23ca800700 1 -- 172.21.15.28:0/2764145694 shutdown_connections 2024-06-06T08:32:12.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.095+0000 7f23ca800700 1 -- 172.21.15.28:0/2764145694 wait complete. 2024-06-06T08:32:12.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.096+0000 7f23ca800700 1 Processor -- start 2024-06-06T08:32:12.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.096+0000 7f23ca800700 1 -- start start 2024-06-06T08:32:12.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.097+0000 7f23ca800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23c4106dd0 0x7f23c419e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:12.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.097+0000 7f23ca800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f23c4112b50 con 0x7f23c4106dd0 2024-06-06T08:32:12.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.097+0000 7f23c3400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23c4106dd0 0x7f23c419e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:12.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.097+0000 7f23c3400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23c4106dd0 0x7f23c419e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56260/0 (socket says 172.21.15.28:56260) 2024-06-06T08:32:12.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.097+0000 7f23c3400700 1 -- 172.21.15.28:0/804885231 learned_addr learned my addr 172.21.15.28:0/804885231 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:32:12.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.098+0000 7f23c3400700 1 -- 172.21.15.28:0/804885231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c419e5b0 con 0x7f23c4106dd0 2024-06-06T08:32:12.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.098+0000 7f23c3400700 1 --2- 172.21.15.28:0/804885231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23c4106dd0 0x7f23c419e070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23b4006010 tx=0x7f23b4005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:12.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.098+0000 7f23bbe00700 1 -- 172.21.15.28:0/804885231 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b4026070 con 0x7f23c4106dd0 2024-06-06T08:32:12.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.098+0000 7f23bbe00700 1 -- 172.21.15.28:0/804885231 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23b400bc30 con 0x7f23c4106dd0 2024-06-06T08:32:12.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.098+0000 7f23ca800700 1 -- 172.21.15.28:0/804885231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c419e840 con 0x7f23c4106dd0 2024-06-06T08:32:12.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.098+0000 7f23bbe00700 1 -- 172.21.15.28:0/804885231 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b40039d0 con 0x7f23c4106dd0 2024-06-06T08:32:12.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.099+0000 7f23ca800700 1 -- 172.21.15.28:0/804885231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c419eca0 con 0x7f23c4106dd0 2024-06-06T08:32:12.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.100+0000 7f23ca800700 1 -- 172.21.15.28:0/804885231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c41013c0 con 0x7f23c4106dd0 2024-06-06T08:32:12.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.101+0000 7f23bbe00700 1 -- 172.21.15.28:0/804885231 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f23b4029070 con 0x7f23c4106dd0 2024-06-06T08:32:12.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.101+0000 7f23bbe00700 1 --2- 172.21.15.28:0/804885231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f23a8039150 0x7f23a803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:12.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.101+0000 7f23bbe00700 1 -- 172.21.15.28:0/804885231 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f23b401e070 con 0x7f23c4106dd0 2024-06-06T08:32:12.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.102+0000 7f23c2a00700 1 --2- 172.21.15.28:0/804885231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f23a8039150 0x7f23a803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:12.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.102+0000 7f23c2a00700 1 --2- 172.21.15.28:0/804885231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f23a8039150 0x7f23a803b610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23b0006fd0 tx=0x7f23b0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:12.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.107+0000 7f23bbe00700 1 -- 172.21.15.28:0/804885231 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f23b4013070 con 0x7f23c4106dd0 2024-06-06T08:32:12.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.346+0000 7f23ca800700 1 -- 172.21.15.28:0/804885231 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23c419f3d0 con 0x7f23a8039150 2024-06-06T08:32:12.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.347+0000 7f23bbe00700 1 -- 172.21.15.28:0/804885231 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f23c419f3d0 con 0x7f23a8039150 2024-06-06T08:32:12.346 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:32:12.346 INFO:teuthology.orchestra.run.smithi028.stdout:[{"addr": "172.21.15.28", "hostname": "smithi028", "labels": [], "status": ""}, {"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}] 2024-06-06T08:32:12.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.350+0000 7f23ca800700 1 -- 172.21.15.28:0/804885231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f23a8039150 msgr2=0x7f23a803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:12.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.350+0000 7f23ca800700 1 --2- 172.21.15.28:0/804885231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f23a8039150 0x7f23a803b610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23b0006fd0 tx=0x7f23b0006e40 comp rx=0 tx=0).stop 2024-06-06T08:32:12.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.350+0000 7f23ca800700 1 -- 172.21.15.28:0/804885231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23c4106dd0 msgr2=0x7f23c419e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:12.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.350+0000 7f23ca800700 1 --2- 172.21.15.28:0/804885231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23c4106dd0 0x7f23c419e070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23b4006010 tx=0x7f23b4005030 comp rx=0 tx=0).stop 2024-06-06T08:32:12.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.351+0000 7f23ca800700 1 -- 172.21.15.28:0/804885231 shutdown_connections 2024-06-06T08:32:12.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.351+0000 7f23ca800700 1 --2- 172.21.15.28:0/804885231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f23a8039150 0x7f23a803b610 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:12.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.351+0000 7f23ca800700 1 --2- 172.21.15.28:0/804885231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23c4106dd0 0x7f23c419e070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:12.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.351+0000 7f23ca800700 1 -- 172.21.15.28:0/804885231 >> 172.21.15.28:0/804885231 conn(0x7f23c40768f0 msgr2=0x7f23c40fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:12.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.351+0000 7f23ca800700 1 -- 172.21.15.28:0/804885231 shutdown_connections 2024-06-06T08:32:12.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:12.351+0000 7f23ca800700 1 -- 172.21.15.28:0/804885231 wait complete. 2024-06-06T08:32:13.013 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:12 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:13.086 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi059 2024-06-06T08:32:13.086 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-06-06T08:32:13.086 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/etc/ceph/ceph.conf 2024-06-06T08:32:13.106 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-06-06T08:32:13.106 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T08:32:13.165 INFO:tasks.cephadm:Adding host smithi059 to orchestrator... 2024-06-06T08:32:13.165 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch host add smithi059 2024-06-06T08:32:13.607 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:32:14.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:13 smithi028 ceph-mon[31564]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:14.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:13 smithi028 ceph-mon[31564]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:32:15.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.638+0000 7f75f2e00700 1 -- 172.21.15.28:0/491922028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f75ec074830 msgr2=0x7f75ec074c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.638+0000 7f75f2e00700 1 --2- 172.21.15.28:0/491922028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f75ec074830 0x7f75ec074c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00b0a0 tx=0x7f75dc00b3b0 comp rx=0 tx=0).stop 2024-06-06T08:32:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.638+0000 7f75f2e00700 1 -- 172.21.15.28:0/491922028 shutdown_connections 2024-06-06T08:32:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.638+0000 7f75f2e00700 1 --2- 172.21.15.28:0/491922028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f75ec074830 0x7f75ec074c10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.638+0000 7f75f2e00700 1 -- 172.21.15.28:0/491922028 >> 172.21.15.28:0/491922028 conn(0x7f75ec0fd9d0 msgr2=0x7f75ec0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.638+0000 7f75f2e00700 1 -- 172.21.15.28:0/491922028 shutdown_connections 2024-06-06T08:32:15.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.638+0000 7f75f2e00700 1 -- 172.21.15.28:0/491922028 wait complete. 2024-06-06T08:32:15.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.639+0000 7f75f2e00700 1 Processor -- start 2024-06-06T08:32:15.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.640+0000 7f75f2e00700 1 -- start start 2024-06-06T08:32:15.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.640+0000 7f75f2e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f75ec074830 0x7f75ec19df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:15.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.640+0000 7f75f2e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec112b40 con 0x7f75ec074830 2024-06-06T08:32:15.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.641+0000 7f75ebe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f75ec074830 0x7f75ec19df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:15.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.641+0000 7f75ebe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f75ec074830 0x7f75ec19df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56290/0 (socket says 172.21.15.28:56290) 2024-06-06T08:32:15.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.641+0000 7f75ebe00700 1 -- 172.21.15.28:0/745143579 learned_addr learned my addr 172.21.15.28:0/745143579 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:32:15.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.641+0000 7f75ebe00700 1 -- 172.21.15.28:0/745143579 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec19e4b0 con 0x7f75ec074830 2024-06-06T08:32:15.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.642+0000 7f75ebe00700 1 --2- 172.21.15.28:0/745143579 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f75ec074830 0x7f75ec19df70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f75dc000f80 tx=0x7f75dc00bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:15.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.642+0000 7f75e9600700 1 -- 172.21.15.28:0/745143579 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75dc020020 con 0x7f75ec074830 2024-06-06T08:32:15.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.642+0000 7f75e9600700 1 -- 172.21.15.28:0/745143579 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75dc018040 con 0x7f75ec074830 2024-06-06T08:32:15.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.642+0000 7f75e9600700 1 -- 172.21.15.28:0/745143579 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75dc017070 con 0x7f75ec074830 2024-06-06T08:32:15.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.642+0000 7f75f2e00700 1 -- 172.21.15.28:0/745143579 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec19e740 con 0x7f75ec074830 2024-06-06T08:32:15.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.642+0000 7f75f2e00700 1 -- 172.21.15.28:0/745143579 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec1a2840 con 0x7f75ec074830 2024-06-06T08:32:15.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.643+0000 7f75f2e00700 1 -- 172.21.15.28:0/745143579 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ec075f70 con 0x7f75ec074830 2024-06-06T08:32:15.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.643+0000 7f75e9600700 1 -- 172.21.15.28:0/745143579 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f75dc023020 con 0x7f75ec074830 2024-06-06T08:32:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.644+0000 7f75e9600700 1 --2- 172.21.15.28:0/745143579 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f75d0039190 0x7f75d003b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.644+0000 7f75e9600700 1 -- 172.21.15.28:0/745143579 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f75dc00f050 con 0x7f75ec074830 2024-06-06T08:32:15.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.644+0000 7f75e3400700 1 --2- 172.21.15.28:0/745143579 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f75d0039190 0x7f75d003b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:15.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.645+0000 7f75e3400700 1 --2- 172.21.15.28:0/745143579 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f75d0039190 0x7f75d003b650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f75d4006fd0 tx=0x7f75d4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:15.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.650+0000 7f75e9600700 1 -- 172.21.15.28:0/745143579 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f75dc02a020 con 0x7f75ec074830 2024-06-06T08:32:15.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:15.893+0000 7f75f2e00700 1 -- 172.21.15.28:0/745143579 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi059", "target": ["mon-mgr", ""]}) -- 0x7f75ec19f2d0 con 0x7f75d0039190 2024-06-06T08:32:16.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:15 smithi028 ceph-mon[31564]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:16.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:16.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:16.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:16.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:16.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:32:16.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:16.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:32:17.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:16 smithi028 ceph-mon[31564]: Updating smithi037:/etc/ceph/ceph.conf 2024-06-06T08:32:17.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:16 smithi028 ceph-mon[31564]: Updating smithi037:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:17.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:16 smithi028 ceph-mon[31564]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-06-06T08:32:17.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:16 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:17.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:16 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:17.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:16 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:18.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:17 smithi028 ceph-mon[31564]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi059", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:32:18.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:17 smithi028 ceph-mon[31564]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:18.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:17 smithi028 ceph-mon[31564]: Updating smithi037:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T08:32:18.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:17 smithi028 ceph-mon[31564]: Deploying cephadm binary to smithi059 2024-06-06T08:32:20.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:19 smithi028 ceph-mon[31564]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:20.860 INFO:teuthology.orchestra.run.smithi028.stdout:Added host 'smithi059' with addr '172.21.15.59' 2024-06-06T08:32:20.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:20.861+0000 7f75e9600700 1 -- 172.21.15.28:0/745143579 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f75ec19f2d0 con 0x7f75d0039190 2024-06-06T08:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:20.864+0000 7f75f2e00700 1 -- 172.21.15.28:0/745143579 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f75d0039190 msgr2=0x7f75d003b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:20.864+0000 7f75f2e00700 1 --2- 172.21.15.28:0/745143579 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f75d0039190 0x7f75d003b650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f75d4006fd0 tx=0x7f75d4006e40 comp rx=0 tx=0).stop 2024-06-06T08:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:20.864+0000 7f75f2e00700 1 -- 172.21.15.28:0/745143579 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f75ec074830 msgr2=0x7f75ec19df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:20.864+0000 7f75f2e00700 1 --2- 172.21.15.28:0/745143579 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f75ec074830 0x7f75ec19df70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f75dc000f80 tx=0x7f75dc00bd20 comp rx=0 tx=0).stop 2024-06-06T08:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:20.865+0000 7f75f2e00700 1 -- 172.21.15.28:0/745143579 shutdown_connections 2024-06-06T08:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:20.865+0000 7f75f2e00700 1 --2- 172.21.15.28:0/745143579 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f75d0039190 0x7f75d003b650 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:20.865+0000 7f75f2e00700 1 --2- 172.21.15.28:0/745143579 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f75ec074830 0x7f75ec19df70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:20.865+0000 7f75f2e00700 1 -- 172.21.15.28:0/745143579 >> 172.21.15.28:0/745143579 conn(0x7f75ec0fd9d0 msgr2=0x7f75ec0ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:20.865+0000 7f75f2e00700 1 -- 172.21.15.28:0/745143579 shutdown_connections 2024-06-06T08:32:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:20.865+0000 7f75f2e00700 1 -- 172.21.15.28:0/745143579 wait complete. 2024-06-06T08:32:21.615 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-06T08:32:22.084 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:32:22.231 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:21 smithi028 ceph-mon[31564]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:22.231 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:22.231 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:32:22.231 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:23.225 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:22 smithi028 ceph-mon[31564]: Added host smithi059 2024-06-06T08:32:23.225 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:24.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.100+0000 7f6b74200700 1 -- 172.21.15.28:0/581291335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b6c103060 msgr2=0x7f6b6c103440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:24.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.100+0000 7f6b74200700 1 --2- 172.21.15.28:0/581291335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b6c103060 0x7f6b6c103440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009910 tx=0x7f6b60009c20 comp rx=0 tx=0).stop 2024-06-06T08:32:24.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.101+0000 7f6b74200700 1 -- 172.21.15.28:0/581291335 shutdown_connections 2024-06-06T08:32:24.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.101+0000 7f6b74200700 1 --2- 172.21.15.28:0/581291335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b6c103060 0x7f6b6c103440 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:24.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.101+0000 7f6b74200700 1 -- 172.21.15.28:0/581291335 >> 172.21.15.28:0/581291335 conn(0x7f6b6c0fc890 msgr2=0x7f6b6c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:24.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.101+0000 7f6b74200700 1 -- 172.21.15.28:0/581291335 shutdown_connections 2024-06-06T08:32:24.100 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:23 smithi028 ceph-mon[31564]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:24.101 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:24.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.101+0000 7f6b74200700 1 -- 172.21.15.28:0/581291335 wait complete. 2024-06-06T08:32:24.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.102+0000 7f6b74200700 1 Processor -- start 2024-06-06T08:32:24.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.102+0000 7f6b74200700 1 -- start start 2024-06-06T08:32:24.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.102+0000 7f6b74200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b6c103060 0x7f6b6c19f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:24.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.103+0000 7f6b74200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c10c530 con 0x7f6b6c103060 2024-06-06T08:32:24.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.103+0000 7f6b71800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b6c103060 0x7f6b6c19f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:24.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.103+0000 7f6b71800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b6c103060 0x7f6b6c19f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38224/0 (socket says 172.21.15.28:38224) 2024-06-06T08:32:24.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.103+0000 7f6b71800700 1 -- 172.21.15.28:0/1538136622 learned_addr learned my addr 172.21.15.28:0/1538136622 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:32:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.103+0000 7f6b71800700 1 -- 172.21.15.28:0/1538136622 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c19fdb0 con 0x7f6b6c103060 2024-06-06T08:32:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.104+0000 7f6b71800700 1 --2- 172.21.15.28:0/1538136622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b6c103060 0x7f6b6c19f870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6b60006010 tx=0x7f6b60005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.104+0000 7f6b6a000700 1 -- 172.21.15.28:0/1538136622 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b60026070 con 0x7f6b6c103060 2024-06-06T08:32:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.104+0000 7f6b6a000700 1 -- 172.21.15.28:0/1538136622 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b6000bc30 con 0x7f6b6c103060 2024-06-06T08:32:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.104+0000 7f6b74200700 1 -- 172.21.15.28:0/1538136622 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6c1a0040 con 0x7f6b6c103060 2024-06-06T08:32:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.104+0000 7f6b6a000700 1 -- 172.21.15.28:0/1538136622 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b60003ab0 con 0x7f6b6c103060 2024-06-06T08:32:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.104+0000 7f6b74200700 1 -- 172.21.15.28:0/1538136622 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6c199a30 con 0x7f6b6c103060 2024-06-06T08:32:24.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.105+0000 7f6b6a000700 1 -- 172.21.15.28:0/1538136622 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6b60029070 con 0x7f6b6c103060 2024-06-06T08:32:24.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.105+0000 7f6b74200700 1 -- 172.21.15.28:0/1538136622 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6c06ab80 con 0x7f6b6c103060 2024-06-06T08:32:24.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.106+0000 7f6b6a000700 1 --2- 172.21.15.28:0/1538136622 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6b540390f0 0x7f6b5403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:24.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.106+0000 7f6b6a000700 1 -- 172.21.15.28:0/1538136622 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6b6001e070 con 0x7f6b6c103060 2024-06-06T08:32:24.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.106+0000 7f6b70e00700 1 --2- 172.21.15.28:0/1538136622 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6b540390f0 0x7f6b5403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:24.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.107+0000 7f6b70e00700 1 --2- 172.21.15.28:0/1538136622 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6b540390f0 0x7f6b5403b5b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b58006fd0 tx=0x7f6b58006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:24.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.112+0000 7f6b6a000700 1 -- 172.21.15.28:0/1538136622 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6b60013070 con 0x7f6b6c103060 2024-06-06T08:32:24.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.347+0000 7f6b74200700 1 -- 172.21.15.28:0/1538136622 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b6c19af60 con 0x7f6b540390f0 2024-06-06T08:32:24.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.349+0000 7f6b6a000700 1 -- 172.21.15.28:0/1538136622 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7f6b6c19af60 con 0x7f6b540390f0 2024-06-06T08:32:24.348 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:32:24.348 INFO:teuthology.orchestra.run.smithi028.stdout:[{"addr": "172.21.15.28", "hostname": "smithi028", "labels": [], "status": ""}, {"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}] 2024-06-06T08:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.352+0000 7f6b74200700 1 -- 172.21.15.28:0/1538136622 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6b540390f0 msgr2=0x7f6b5403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.352+0000 7f6b74200700 1 --2- 172.21.15.28:0/1538136622 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6b540390f0 0x7f6b5403b5b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b58006fd0 tx=0x7f6b58006e40 comp rx=0 tx=0).stop 2024-06-06T08:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.352+0000 7f6b74200700 1 -- 172.21.15.28:0/1538136622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b6c103060 msgr2=0x7f6b6c19f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.352+0000 7f6b74200700 1 --2- 172.21.15.28:0/1538136622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b6c103060 0x7f6b6c19f870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6b60006010 tx=0x7f6b60005050 comp rx=0 tx=0).stop 2024-06-06T08:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.352+0000 7f6b74200700 1 -- 172.21.15.28:0/1538136622 shutdown_connections 2024-06-06T08:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.352+0000 7f6b74200700 1 --2- 172.21.15.28:0/1538136622 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6b540390f0 0x7f6b5403b5b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.352+0000 7f6b74200700 1 --2- 172.21.15.28:0/1538136622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b6c103060 0x7f6b6c19f870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.352+0000 7f6b74200700 1 -- 172.21.15.28:0/1538136622 >> 172.21.15.28:0/1538136622 conn(0x7f6b6c0fc890 msgr2=0x7f6b6c108200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.352+0000 7f6b74200700 1 -- 172.21.15.28:0/1538136622 shutdown_connections 2024-06-06T08:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:24.353+0000 7f6b74200700 1 -- 172.21.15.28:0/1538136622 wait complete. 2024-06-06T08:32:25.050 INFO:tasks.cephadm:Setting crush tunables to default 2024-06-06T08:32:25.051 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd crush tunables default 2024-06-06T08:32:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:32:25.918 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:25 smithi028 ceph-mon[31564]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:25.918 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:25 smithi028 ceph-mon[31564]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:32:27.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.428+0000 7ffb23400700 1 -- 172.21.15.28:0/1335308907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffb1c102100 msgr2=0x7ffb1c1024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:27.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.428+0000 7ffb23400700 1 --2- 172.21.15.28:0/1335308907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffb1c102100 0x7ffb1c1024e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009910 tx=0x7ffb10009c20 comp rx=0 tx=0).stop 2024-06-06T08:32:27.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.428+0000 7ffb23400700 1 -- 172.21.15.28:0/1335308907 shutdown_connections 2024-06-06T08:32:27.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.428+0000 7ffb23400700 1 --2- 172.21.15.28:0/1335308907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffb1c102100 0x7ffb1c1024e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:27.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.428+0000 7ffb23400700 1 -- 172.21.15.28:0/1335308907 >> 172.21.15.28:0/1335308907 conn(0x7ffb1c0fd9d0 msgr2=0x7ffb1c0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:27.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.428+0000 7ffb23400700 1 -- 172.21.15.28:0/1335308907 shutdown_connections 2024-06-06T08:32:27.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.429+0000 7ffb23400700 1 -- 172.21.15.28:0/1335308907 wait complete. 2024-06-06T08:32:27.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.430+0000 7ffb23400700 1 Processor -- start 2024-06-06T08:32:27.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.430+0000 7ffb23400700 1 -- start start 2024-06-06T08:32:27.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.431+0000 7ffb23400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffb1c102100 0x7ffb1c074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:27.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.431+0000 7ffb23400700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c10c4d0 con 0x7ffb1c102100 2024-06-06T08:32:27.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.431+0000 7ffb20a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffb1c102100 0x7ffb1c074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:27.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.431+0000 7ffb20a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffb1c102100 0x7ffb1c074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56910/0 (socket says 172.21.15.28:56910) 2024-06-06T08:32:27.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.431+0000 7ffb20a00700 1 -- 172.21.15.28:0/314779916 learned_addr learned my addr 172.21.15.28:0/314779916 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:32:27.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.431+0000 7ffb20a00700 1 -- 172.21.15.28:0/314779916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c076680 con 0x7ffb1c102100 2024-06-06T08:32:27.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.432+0000 7ffb20a00700 1 --2- 172.21.15.28:0/314779916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffb1c102100 0x7ffb1c074790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb10006010 tx=0x7ffb10005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:27.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.432+0000 7ffb19600700 1 -- 172.21.15.28:0/314779916 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb10026070 con 0x7ffb1c102100 2024-06-06T08:32:27.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.432+0000 7ffb19600700 1 -- 172.21.15.28:0/314779916 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb1000bc30 con 0x7ffb1c102100 2024-06-06T08:32:27.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.432+0000 7ffb19600700 1 -- 172.21.15.28:0/314779916 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb100039d0 con 0x7ffb1c102100 2024-06-06T08:32:27.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.432+0000 7ffb23400700 1 -- 172.21.15.28:0/314779916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1c074d30 con 0x7ffb1c102100 2024-06-06T08:32:27.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.432+0000 7ffb23400700 1 -- 172.21.15.28:0/314779916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1c0751f0 con 0x7ffb1c102100 2024-06-06T08:32:27.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.433+0000 7ffb23400700 1 -- 172.21.15.28:0/314779916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1c1035e0 con 0x7ffb1c102100 2024-06-06T08:32:27.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.433+0000 7ffb19600700 1 -- 172.21.15.28:0/314779916 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ffb10029070 con 0x7ffb1c102100 2024-06-06T08:32:27.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.434+0000 7ffb19600700 1 --2- 172.21.15.28:0/314779916 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffb04039150 0x7ffb0403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:27.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.434+0000 7ffb19600700 1 -- 172.21.15.28:0/314779916 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ffb1001e070 con 0x7ffb1c102100 2024-06-06T08:32:27.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.434+0000 7ffb1be00700 1 --2- 172.21.15.28:0/314779916 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffb04039150 0x7ffb0403b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:27.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.435+0000 7ffb1be00700 1 --2- 172.21.15.28:0/314779916 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffb04039150 0x7ffb0403b610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffb08006fd0 tx=0x7ffb08006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:27.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.440+0000 7ffb19600700 1 -- 172.21.15.28:0/314779916 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ffb10050030 con 0x7ffb1c102100 2024-06-06T08:32:27.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:27.741+0000 7ffb23400700 1 -- 172.21.15.28:0/314779916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ffb1c075cc0 con 0x7ffb1c102100 2024-06-06T08:32:28.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:27 smithi028 ceph-mon[31564]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:28.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:28.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:28.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:28.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:28.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:32:28.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:28.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:32:28.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:27 smithi028 ceph-mon[31564]: Updating smithi059:/etc/ceph/ceph.conf 2024-06-06T08:32:28.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:28.637+0000 7ffb19600700 1 -- 172.21.15.28:0/314779916 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7ffb10030090 con 0x7ffb1c102100 2024-06-06T08:32:28.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:28.642+0000 7ffb23400700 1 -- 172.21.15.28:0/314779916 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffb04039150 msgr2=0x7ffb0403b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:28.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:28.642+0000 7ffb23400700 1 --2- 172.21.15.28:0/314779916 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffb04039150 0x7ffb0403b610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffb08006fd0 tx=0x7ffb08006e40 comp rx=0 tx=0).stop 2024-06-06T08:32:28.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:28.642+0000 7ffb23400700 1 -- 172.21.15.28:0/314779916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffb1c102100 msgr2=0x7ffb1c074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:28.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:28.642+0000 7ffb23400700 1 --2- 172.21.15.28:0/314779916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffb1c102100 0x7ffb1c074790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb10006010 tx=0x7ffb10005030 comp rx=0 tx=0).stop 2024-06-06T08:32:28.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:28.642+0000 7ffb23400700 1 -- 172.21.15.28:0/314779916 shutdown_connections 2024-06-06T08:32:28.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:28.642+0000 7ffb23400700 1 --2- 172.21.15.28:0/314779916 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffb04039150 0x7ffb0403b610 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:28.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:28.642+0000 7ffb23400700 1 --2- 172.21.15.28:0/314779916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffb1c102100 0x7ffb1c074790 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:28.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:28.642+0000 7ffb23400700 1 -- 172.21.15.28:0/314779916 >> 172.21.15.28:0/314779916 conn(0x7ffb1c0fd9d0 msgr2=0x7ffb1c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:28.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:28.642+0000 7ffb23400700 1 -- 172.21.15.28:0/314779916 shutdown_connections 2024-06-06T08:32:28.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:28.642+0000 7ffb23400700 1 -- 172.21.15.28:0/314779916 wait complete. 2024-06-06T08:32:28.643 INFO:teuthology.orchestra.run.smithi028.stderr:adjusted tunables profile to default 2024-06-06T08:32:28.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:28 smithi028 ceph-mon[31564]: Updating smithi059:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:28.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:28 smithi028 ceph-mon[31564]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-06-06T08:32:28.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:28 smithi028 ceph-mon[31564]: Updating smithi059:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T08:32:28.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:28 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/314779916' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-06T08:32:28.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:28.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:28.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:29.317 INFO:tasks.cephadm:Adding mon.a on smithi028 2024-06-06T08:32:29.317 INFO:tasks.cephadm:Adding mon.b on smithi037 2024-06-06T08:32:29.317 INFO:tasks.cephadm:Adding mon.c on smithi059 2024-06-06T08:32:29.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch apply mon '3;smithi028:172.21.15.28=a;smithi037:172.21.15.37=b;smithi059:172.21.15.59=c' 2024-06-06T08:32:29.565 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:30.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:29 smithi028 ceph-mon[31564]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:30.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:29 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/314779916' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-06T08:32:30.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:29 smithi028 ceph-mon[31564]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T08:32:30.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.904+0000 7fcc99272700 1 -- 172.21.15.59:0/1146783743 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc941020e0 msgr2=0x7fcc941024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:30.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.904+0000 7fcc99272700 1 --2- 172.21.15.59:0/1146783743 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc941020e0 0x7fcc941024c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009910 tx=0x7fcc84009c20 comp rx=0 tx=0).stop 2024-06-06T08:32:30.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.904+0000 7fcc99272700 1 -- 172.21.15.59:0/1146783743 shutdown_connections 2024-06-06T08:32:30.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.904+0000 7fcc99272700 1 --2- 172.21.15.59:0/1146783743 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc941020e0 0x7fcc941024c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:30.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.904+0000 7fcc99272700 1 -- 172.21.15.59:0/1146783743 >> 172.21.15.59:0/1146783743 conn(0x7fcc940fd9d0 msgr2=0x7fcc940ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.904+0000 7fcc99272700 1 -- 172.21.15.59:0/1146783743 shutdown_connections 2024-06-06T08:32:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.904+0000 7fcc99272700 1 -- 172.21.15.59:0/1146783743 wait complete. 2024-06-06T08:32:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.905+0000 7fcc99272700 1 Processor -- start 2024-06-06T08:32:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.905+0000 7fcc99272700 1 -- start start 2024-06-06T08:32:30.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.905+0000 7fcc99272700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc941020e0 0x7fcc94074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:30.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.905+0000 7fcc99272700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9410c4b0 con 0x7fcc941020e0 2024-06-06T08:32:30.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.906+0000 7fcc92ffd700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc941020e0 0x7fcc94074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:30.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.906+0000 7fcc92ffd700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc941020e0 0x7fcc94074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.59:35836/0 (socket says 172.21.15.59:35836) 2024-06-06T08:32:30.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.906+0000 7fcc92ffd700 1 -- 172.21.15.59:0/2279528046 learned_addr learned my addr 172.21.15.59:0/2279528046 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-06-06T08:32:30.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.906+0000 7fcc92ffd700 1 -- 172.21.15.59:0/2279528046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc94076680 con 0x7fcc941020e0 2024-06-06T08:32:30.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.907+0000 7fcc92ffd700 1 --2- 172.21.15.59:0/2279528046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc941020e0 0x7fcc94074790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcc84006010 tx=0x7fcc84005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:30.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.907+0000 7fcc7bfff700 1 -- 172.21.15.59:0/2279528046 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc84026070 con 0x7fcc941020e0 2024-06-06T08:32:30.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.907+0000 7fcc99272700 1 -- 172.21.15.59:0/2279528046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc94074d30 con 0x7fcc941020e0 2024-06-06T08:32:30.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.907+0000 7fcc99272700 1 -- 172.21.15.59:0/2279528046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc940751f0 con 0x7fcc941020e0 2024-06-06T08:32:30.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.907+0000 7fcc7bfff700 1 -- 172.21.15.59:0/2279528046 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc8400bbd0 con 0x7fcc941020e0 2024-06-06T08:32:30.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.907+0000 7fcc7bfff700 1 -- 172.21.15.59:0/2279528046 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc840038e0 con 0x7fcc941020e0 2024-06-06T08:32:30.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.908+0000 7fcc99272700 1 -- 172.21.15.59:0/2279528046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc80005330 con 0x7fcc941020e0 2024-06-06T08:32:30.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.908+0000 7fcc7bfff700 1 -- 172.21.15.59:0/2279528046 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fcc84029070 con 0x7fcc941020e0 2024-06-06T08:32:30.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.909+0000 7fcc7bfff700 1 --2- 172.21.15.59:0/2279528046 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcc7c039150 0x7fcc7c03b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:30.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.909+0000 7fcc7bfff700 1 -- 172.21.15.59:0/2279528046 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcc8401e070 con 0x7fcc941020e0 2024-06-06T08:32:30.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.909+0000 7fcc927fc700 1 --2- 172.21.15.59:0/2279528046 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcc7c039150 0x7fcc7c03b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:30.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.910+0000 7fcc927fc700 1 --2- 172.21.15.59:0/2279528046 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcc7c039150 0x7fcc7c03b610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcc88006fd0 tx=0x7fcc88006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:30.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:30.924+0000 7fcc7bfff700 1 -- 172.21.15.59:0/2279528046 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcc84013070 con 0x7fcc941020e0 2024-06-06T08:32:31.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.144+0000 7fcc99272700 1 -- 172.21.15.59:0/2279528046 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi028:172.21.15.28=a;smithi037:172.21.15.37=b;smithi059:172.21.15.59=c", "target": ["mon-mgr", ""]}) -- 0x7fcc80000c70 con 0x7fcc7c039150 2024-06-06T08:32:31.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.160+0000 7fcc7bfff700 1 -- 172.21.15.59:0/2279528046 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fcc80000c70 con 0x7fcc7c039150 2024-06-06T08:32:31.159 INFO:teuthology.orchestra.run.smithi059.stdout:Scheduled mon update... 2024-06-06T08:32:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.161+0000 7fcc99272700 1 -- 172.21.15.59:0/2279528046 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcc7c039150 msgr2=0x7fcc7c03b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.161+0000 7fcc99272700 1 --2- 172.21.15.59:0/2279528046 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcc7c039150 0x7fcc7c03b610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcc88006fd0 tx=0x7fcc88006e40 comp rx=0 tx=0).stop 2024-06-06T08:32:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.161+0000 7fcc99272700 1 -- 172.21.15.59:0/2279528046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc941020e0 msgr2=0x7fcc94074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.161+0000 7fcc99272700 1 --2- 172.21.15.59:0/2279528046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc941020e0 0x7fcc94074790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcc84006010 tx=0x7fcc84005030 comp rx=0 tx=0).stop 2024-06-06T08:32:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.162+0000 7fcc99272700 1 -- 172.21.15.59:0/2279528046 shutdown_connections 2024-06-06T08:32:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.162+0000 7fcc99272700 1 --2- 172.21.15.59:0/2279528046 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcc7c039150 0x7fcc7c03b610 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.162+0000 7fcc99272700 1 --2- 172.21.15.59:0/2279528046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc941020e0 0x7fcc94074790 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.162+0000 7fcc99272700 1 -- 172.21.15.59:0/2279528046 >> 172.21.15.59:0/2279528046 conn(0x7fcc940fd9d0 msgr2=0x7fcc94103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.162+0000 7fcc99272700 1 -- 172.21.15.59:0/2279528046 shutdown_connections 2024-06-06T08:32:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:31.162+0000 7fcc99272700 1 -- 172.21.15.59:0/2279528046 wait complete. 2024-06-06T08:32:31.753 DEBUG:teuthology.orchestra.run.smithi037:mon.b> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.b.service 2024-06-06T08:32:31.756 DEBUG:teuthology.orchestra.run.smithi059:mon.c> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.c.service 2024-06-06T08:32:31.758 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-06T08:32:31.758 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-06T08:32:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:31 smithi028 ceph-mon[31564]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:31 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:31 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:32:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:31 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:31 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:32:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:31 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:31 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:31 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:32.763 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:33.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:32 smithi028 ceph-mon[31564]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi028:172.21.15.28=a;smithi037:172.21.15.37=b;smithi059:172.21.15.59=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:32:33.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:32 smithi028 ceph-mon[31564]: Saving service mon spec with placement smithi028:172.21.15.28=a;smithi037:172.21.15.37=b;smithi059:172.21.15.59=c;count:3 2024-06-06T08:32:33.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:32 smithi028 ceph-mon[31564]: Deploying daemon mon.c on smithi059 2024-06-06T08:32:34.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:33 smithi028 ceph-mon[31564]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:34.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:34 smithi059 systemd[1]: Starting Ceph mon.c for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:32:35.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.311+0000 7f16c9610700 1 -- 172.21.15.59:0/1321850873 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c4101000 msgr2=0x7f16c41013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:35.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.311+0000 7f16c9610700 1 --2- 172.21.15.59:0/1321850873 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c4101000 0x7f16c41013e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009910 tx=0x7f16b4009c20 comp rx=0 tx=0).stop 2024-06-06T08:32:35.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.311+0000 7f16c9610700 1 -- 172.21.15.59:0/1321850873 shutdown_connections 2024-06-06T08:32:35.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.311+0000 7f16c9610700 1 --2- 172.21.15.59:0/1321850873 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c4101000 0x7f16c41013e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:35.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.311+0000 7f16c9610700 1 -- 172.21.15.59:0/1321850873 >> 172.21.15.59:0/1321850873 conn(0x7f16c40fc8b0 msgr2=0x7f16c40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:35.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.311+0000 7f16c9610700 1 -- 172.21.15.59:0/1321850873 shutdown_connections 2024-06-06T08:32:35.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.311+0000 7f16c9610700 1 -- 172.21.15.59:0/1321850873 wait complete. 2024-06-06T08:32:35.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.312+0000 7f16c9610700 1 Processor -- start 2024-06-06T08:32:35.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.312+0000 7f16c9610700 1 -- start start 2024-06-06T08:32:35.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.312+0000 7f16c9610700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c4101000 0x7f16c419f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:35.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.312+0000 7f16c9610700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f16c410b3d0 con 0x7f16c4101000 2024-06-06T08:32:35.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.313+0000 7f16c2ffd700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c4101000 0x7f16c419f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.313+0000 7f16c2ffd700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c4101000 0x7f16c419f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.59:33600/0 (socket says 172.21.15.59:33600) 2024-06-06T08:32:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.313+0000 7f16c2ffd700 1 -- 172.21.15.59:0/1872465289 learned_addr learned my addr 172.21.15.59:0/1872465289 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-06-06T08:32:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.313+0000 7f16c2ffd700 1 -- 172.21.15.59:0/1872465289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c419fd70 con 0x7f16c4101000 2024-06-06T08:32:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.314+0000 7f16c2ffd700 1 --2- 172.21.15.59:0/1872465289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c4101000 0x7f16c419f830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f16b4006010 tx=0x7f16b4005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.314+0000 7f16bbfff700 1 -- 172.21.15.59:0/1872465289 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b4026070 con 0x7f16c4101000 2024-06-06T08:32:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.314+0000 7f16c9610700 1 -- 172.21.15.59:0/1872465289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c41a0060 con 0x7f16c4101000 2024-06-06T08:32:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.315+0000 7f16c9610700 1 -- 172.21.15.59:0/1872465289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c41999f0 con 0x7f16c4101000 2024-06-06T08:32:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.315+0000 7f16bbfff700 1 -- 172.21.15.59:0/1872465289 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16b400b6f0 con 0x7f16c4101000 2024-06-06T08:32:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.315+0000 7f16bbfff700 1 -- 172.21.15.59:0/1872465289 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b4030060 con 0x7f16c4101000 2024-06-06T08:32:35.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.315+0000 7f16c9610700 1 -- 172.21.15.59:0/1872465289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a4005330 con 0x7f16c4101000 2024-06-06T08:32:35.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.316+0000 7f16bbfff700 1 -- 172.21.15.59:0/1872465289 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f16b4029070 con 0x7f16c4101000 2024-06-06T08:32:35.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.316+0000 7f16bbfff700 1 --2- 172.21.15.59:0/1872465289 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f16b00390f0 0x7f16b003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:35.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.316+0000 7f16bbfff700 1 -- 172.21.15.59:0/1872465289 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f16b401e070 con 0x7f16c4101000 2024-06-06T08:32:35.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.317+0000 7f16c27fc700 1 --2- 172.21.15.59:0/1872465289 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f16b00390f0 0x7f16b003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:35.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.318+0000 7f16c27fc700 1 --2- 172.21.15.59:0/1872465289 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f16b00390f0 0x7f16b003b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f16ac006fd0 tx=0x7f16ac006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.331+0000 7f16bbfff700 1 -- 172.21.15.59:0/1872465289 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f16b4013070 con 0x7f16c4101000 2024-06-06T08:32:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.643+0000 7f16c9610700 1 -- 172.21.15.59:0/1872465289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f16a40058f0 con 0x7f16c4101000 2024-06-06T08:32:35.643 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 podman[36637]: 2024-06-06 08:32:35.381571314 +0000 UTC m=+0.436703198 container create 5e521794a5c00cb9298d8cec7e8a42d49f1263700ebb6157897c518d07cb95db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-06-06T08:32:35.643 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 podman[36637]: 2024-06-06 08:32:35.292939319 +0000 UTC m=+0.348071201 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:32:35.643 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 podman[36637]: 2024-06-06 08:32:35.625837353 +0000 UTC m=+0.680969235 container init 5e521794a5c00cb9298d8cec7e8a42d49f1263700ebb6157897c518d07cb95db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-c, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-06-06T08:32:35.643 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 podman[36637]: 2024-06-06 08:32:35.629432483 +0000 UTC m=+0.684564365 container start 5e521794a5c00cb9298d8cec7e8a42d49f1263700ebb6157897c518d07cb95db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc) 2024-06-06T08:32:35.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.644+0000 7f16bbfff700 1 -- 172.21.15.59:0/1872465289 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f16b400e610 con 0x7f16c4101000 2024-06-06T08:32:35.644 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:32:35.644 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":1,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","modified":"2024-06-06T08:30:26.024887Z","created":"2024-06-06T08:30:26.024887Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-06T08:32:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.646+0000 7f16c9610700 1 -- 172.21.15.59:0/1872465289 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f16b00390f0 msgr2=0x7f16b003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.646+0000 7f16c9610700 1 --2- 172.21.15.59:0/1872465289 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f16b00390f0 0x7f16b003b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f16ac006fd0 tx=0x7f16ac006e40 comp rx=0 tx=0).stop 2024-06-06T08:32:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.646+0000 7f16c9610700 1 -- 172.21.15.59:0/1872465289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c4101000 msgr2=0x7f16c419f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.646+0000 7f16c9610700 1 --2- 172.21.15.59:0/1872465289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c4101000 0x7f16c419f830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f16b4006010 tx=0x7f16b4005030 comp rx=0 tx=0).stop 2024-06-06T08:32:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.646+0000 7f16c9610700 1 -- 172.21.15.59:0/1872465289 shutdown_connections 2024-06-06T08:32:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.646+0000 7f16c9610700 1 --2- 172.21.15.59:0/1872465289 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f16b00390f0 0x7f16b003b5b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.646+0000 7f16c9610700 1 --2- 172.21.15.59:0/1872465289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c4101000 0x7f16c419f830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.646+0000 7f16c9610700 1 -- 172.21.15.59:0/1872465289 >> 172.21.15.59:0/1872465289 conn(0x7f16c40fc8b0 msgr2=0x7f16c406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.646+0000 7f16c9610700 1 -- 172.21.15.59:0/1872465289 shutdown_connections 2024-06-06T08:32:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:35.646+0000 7f16c9610700 1 -- 172.21.15.59:0/1872465289 wait complete. 2024-06-06T08:32:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:dumped monmap epoch 1 2024-06-06T08:32:35.944 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: set uid:gid to 167:167 (ceph:ceph) 2024-06-06T08:32:35.944 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-06T08:32:35.944 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pidfile_write: ignore empty --pid-file 2024-06-06T08:32:35.944 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: load: jerasure load: lrc 2024-06-06T08:32:35.944 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: RocksDB version: 7.9.2 2024-06-06T08:32:35.944 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Git sha 0 2024-06-06T08:32:35.944 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-06T08:32:35.945 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: DB SUMMARY 2024-06-06T08:32:35.945 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: DB Session ID: 8FKWBR4LLIP258GN1VYI 2024-06-06T08:32:35.945 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: CURRENT file: CURRENT 2024-06-06T08:32:35.945 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: IDENTITY file: IDENTITY 2024-06-06T08:32:35.945 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-06-06T08:32:35.945 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-06-06T08:32:35.945 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-06-06T08:32:35.945 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.error_if_exists: 0 2024-06-06T08:32:35.945 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.create_if_missing: 0 2024-06-06T08:32:35.945 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.paranoid_checks: 1 2024-06-06T08:32:35.946 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-06T08:32:35.946 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-06T08:32:35.946 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-06T08:32:35.946 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.env: 0x55d4756abc60 2024-06-06T08:32:35.946 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.fs: PosixFileSystem 2024-06-06T08:32:35.946 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.info_log: 0x55d47699bb20 2024-06-06T08:32:35.946 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_file_opening_threads: 16 2024-06-06T08:32:35.946 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.statistics: (nil) 2024-06-06T08:32:35.946 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.use_fsync: 0 2024-06-06T08:32:35.946 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_log_file_size: 0 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.keep_log_file_num: 1000 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.recycle_log_file_num: 0 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.allow_fallocate: 1 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.allow_mmap_reads: 0 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.allow_mmap_writes: 0 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.use_direct_reads: 0 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.create_missing_column_families: 0 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.db_log_dir: 2024-06-06T08:32:35.947 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.wal_dir: 2024-06-06T08:32:35.948 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-06T08:32:35.949 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-06T08:32:35.950 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-06T08:32:35.950 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-06T08:32:35.950 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-06T08:32:35.950 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-06T08:32:35.950 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.advise_random_on_open: 1 2024-06-06T08:32:35.950 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.db_write_buffer_size: 0 2024-06-06T08:32:35.950 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.write_buffer_manager: 0x55d47696c1e0 2024-06-06T08:32:35.950 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-06T08:32:35.950 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-06T08:32:35.950 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-06T08:32:35.951 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.rate_limiter: (nil) 2024-06-06T08:32:35.951 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-06T08:32:35.951 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.wal_recovery_mode: 2 2024-06-06T08:32:35.951 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.enable_thread_tracking: 0 2024-06-06T08:32:35.951 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.enable_pipelined_write: 0 2024-06-06T08:32:35.951 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.unordered_write: 0 2024-06-06T08:32:35.951 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-06T08:32:35.951 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-06T08:32:35.951 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.row_cache: None 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.wal_filter: None 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.allow_ingest_behind: 0 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.two_write_queues: 0 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.manual_wal_flush: 0 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.wal_compression: 0 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.atomic_flush: 0 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.log_readahead_size: 0 2024-06-06T08:32:35.952 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-06T08:32:35.953 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.best_efforts_recovery: 0 2024-06-06T08:32:35.953 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-06T08:32:35.953 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-06T08:32:35.953 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.allow_data_in_errors: 0 2024-06-06T08:32:35.953 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.db_host_id: __hostname__ 2024-06-06T08:32:35.953 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-06T08:32:35.953 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_background_jobs: 2 2024-06-06T08:32:35.953 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_background_compactions: -1 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_subcompactions: 1 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_total_wal_size: 0 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_open_files: -1 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bytes_per_sync: 0 2024-06-06T08:32:35.954 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-06T08:32:35.955 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-06T08:32:35.955 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_readahead_size: 0 2024-06-06T08:32:35.955 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_background_flushes: -1 2024-06-06T08:32:35.955 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Compression algorithms supported: 2024-06-06T08:32:35.955 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-06T08:32:35.955 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: kZSTD supported: 0 2024-06-06T08:32:35.955 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: kXpressCompression supported: 0 2024-06-06T08:32:35.955 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: kLZ4HCCompression supported: 1 2024-06-06T08:32:35.955 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: kZlibCompression supported: 1 2024-06-06T08:32:35.955 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: kSnappyCompression supported: 1 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: kLZ4Compression supported: 1 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: kBZip2Compression supported: 0 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.merge_operator: 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_filter: None 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_filter_factory: None 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.sst_partitioner_factory: None 2024-06-06T08:32:35.956 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d47699bc40) 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout: cache_index_and_filter_blocks: 1 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout: pin_top_level_index_and_filter: 1 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout: index_type: 0 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout: data_block_index_type: 0 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout: index_shortening: 1 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout: checksum: 4 2024-06-06T08:32:35.957 INFO:journalctl@ceph.mon.c.smithi059.stdout: no_block_cache: 0 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: block_cache: 0x55d47699d090 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: block_cache_name: BinnedLRUCache 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: block_cache_options: 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: capacity : 536870912 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: num_shard_bits : 4 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: strict_capacity_limit : 0 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: high_pri_pool_ratio: 0.000 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: block_cache_compressed: (nil) 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: persistent_cache: (nil) 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: block_size: 4096 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: block_size_deviation: 10 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: block_restart_interval: 16 2024-06-06T08:32:35.958 INFO:journalctl@ceph.mon.c.smithi059.stdout: index_block_restart_interval: 1 2024-06-06T08:32:35.959 INFO:journalctl@ceph.mon.c.smithi059.stdout: metadata_block_size: 4096 2024-06-06T08:32:35.959 INFO:journalctl@ceph.mon.c.smithi059.stdout: partition_filters: 0 2024-06-06T08:32:35.959 INFO:journalctl@ceph.mon.c.smithi059.stdout: use_delta_encoding: 1 2024-06-06T08:32:35.959 INFO:journalctl@ceph.mon.c.smithi059.stdout: filter_policy: bloomfilter 2024-06-06T08:32:35.959 INFO:journalctl@ceph.mon.c.smithi059.stdout: whole_key_filtering: 1 2024-06-06T08:32:35.959 INFO:journalctl@ceph.mon.c.smithi059.stdout: verify_compression: 0 2024-06-06T08:32:35.959 INFO:journalctl@ceph.mon.c.smithi059.stdout: read_amp_bytes_per_bit: 0 2024-06-06T08:32:35.959 INFO:journalctl@ceph.mon.c.smithi059.stdout: format_version: 5 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout: enable_index_compression: 1 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout: block_align: 0 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout: max_auto_readahead_size: 262144 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout: prepopulate_block_cache: 0 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout: initial_auto_readahead_size: 8192 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout: num_file_reads_for_auto_readahead: 2 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.write_buffer_size: 33554432 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_write_buffer_number: 2 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compression: NoCompression 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bottommost_compression: Disabled 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.prefix_extractor: nullptr 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.num_levels: 7 2024-06-06T08:32:35.960 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-06T08:32:35.961 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-06T08:32:35.961 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-06T08:32:35.961 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-06T08:32:35.961 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-06T08:32:35.961 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-06T08:32:35.961 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-06T08:32:35.961 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-06T08:32:35.961 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compression_opts.level: 32767 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compression_opts.strategy: 0 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compression_opts.enabled: false 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-06T08:32:35.962 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-06T08:32:35.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-06T08:32:35.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-06T08:32:35.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.target_file_size_base: 67108864 2024-06-06T08:32:35.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-06T08:32:35.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-06T08:32:35.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-06T08:32:35.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-06T08:32:35.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-06T08:32:35.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-06T08:32:35.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-06T08:32:35.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.arena_block_size: 1048576 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.disable_auto_compactions: 0 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-06T08:32:35.964 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.table_properties_collectors: 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.inplace_update_support: 0 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-06T08:32:35.965 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.bloom_locality: 0 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.max_successive_merges: 0 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.paranoid_file_checks: 0 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.force_consistency_checks: 1 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.report_bg_io_stats: 0 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.ttl: 2592000 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.enable_blob_files: false 2024-06-06T08:32:35.966 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.min_blob_size: 0 2024-06-06T08:32:35.967 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.blob_file_size: 268435456 2024-06-06T08:32:35.967 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-06T08:32:35.967 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-06T08:32:35.967 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-06T08:32:35.967 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-06T08:32:35.967 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-06T08:32:35.967 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.blob_file_starting_level: 0 2024-06-06T08:32:35.967 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-06T08:32:35.967 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-06T08:32:35.967 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-06-06T08:32:35.967 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 55d6aed7-d928-47f0-8a39-f993d1cc139c 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717662755661155, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717662755661572, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717662755, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "55d6aed7-d928-47f0-8a39-f993d1cc139c", "db_session_id": "8FKWBR4LLIP258GN1VYI", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717662755661654, "job": 1, "event": "recovery_finished"} 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d476a8c000 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: DB pointer 0x55d476a76000 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout: ** DB Stats ** 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-06T08:32:35.968 INFO:journalctl@ceph.mon.c.smithi059.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T08:32:35.969 INFO:journalctl@ceph.mon.c.smithi059.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T08:32:35.969 INFO:journalctl@ceph.mon.c.smithi059.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-06T08:32:35.969 INFO:journalctl@ceph.mon.c.smithi059.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T08:32:35.969 INFO:journalctl@ceph.mon.c.smithi059.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T08:32:35.969 INFO:journalctl@ceph.mon.c.smithi059.stdout: 2024-06-06T08:32:35.969 INFO:journalctl@ceph.mon.c.smithi059.stdout: ** Compaction Stats [default] ** 2024-06-06T08:32:35.969 INFO:journalctl@ceph.mon.c.smithi059.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T08:32:35.969 INFO:journalctl@ceph.mon.c.smithi059.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-06T08:32:35.969 INFO:journalctl@ceph.mon.c.smithi059.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-06T08:32:35.969 INFO:journalctl@ceph.mon.c.smithi059.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-06T08:32:35.969 INFO:journalctl@ceph.mon.c.smithi059.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: ** Compaction Stats [default] ** 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-06T08:32:35.970 INFO:journalctl@ceph.mon.c.smithi059.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout: Block cache BinnedLRUCache@0x55d47699d090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout: 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: using public_addr v2:172.21.15.59:0/0 -> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: starting mon.c rank -1 at public addrs [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] at bind addrs [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(???) e0 preinit fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:35.971 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).mds e1 new map 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).mds e1 print_map 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout: e1 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout: legacy client fscid: -1 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout: 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout: No filesystems configured 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-06T08:32:35.972 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Added host smithi037 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.973 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Updating smithi037:/etc/ceph/ceph.conf 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Updating smithi037:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.974 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi059", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Updating smithi037:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Deploying cephadm binary to smithi059 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Added host smithi059 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.975 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Updating smithi059:/etc/ceph/ceph.conf 2024-06-06T08:32:35.976 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Updating smithi059:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Updating smithi059:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/314779916' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/314779916' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:32:35.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi028:172.21.15.28=a;smithi037:172.21.15.37=b;smithi059:172.21.15.59=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Saving service mon spec with placement smithi028:172.21.15.28=a;smithi037:172.21.15.37=b;smithi059:172.21.15.59=c;count:3 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: Deploying daemon mon.c on smithi059 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: from='client.? 172.21.15.59:0/1872465289' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 ceph-mon[36684]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-06T08:32:35.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 bash[36637]: 5e521794a5c00cb9298d8cec7e8a42d49f1263700ebb6157897c518d07cb95db 2024-06-06T08:32:35.979 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:35 smithi059 systemd[1]: Started Ceph mon.c for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:32:36.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:35 smithi028 ceph-mon[31564]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:36.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:35 smithi028 ceph-mon[31564]: from='client.? 172.21.15.59:0/1872465289' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T08:32:37.323 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-06T08:32:37.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-06T08:32:37.576 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:32:41.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:32:41.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: mon.a calling monitor election 2024-06-06T08:32:41.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:41.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: mon.c calling monitor election 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: monmap epoch 2 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: last_changed 2024-06-06T08:32:35.696265+0000 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: created 2024-06-06T08:30:26.024887+0000 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: min_mon_release 19 (squid) 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: election_strategy: 1 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-06-06T08:32:41.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: 1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.c 2024-06-06T08:32:41.044 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: fsmap 2024-06-06T08:32:41.044 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T08:32:41.044 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: mgrmap e13: x(active, since 60s) 2024-06-06T08:32:41.044 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: overall HEALTH_OK 2024-06-06T08:32:41.044 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:41.044 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:32:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: mon.a calling monitor election 2024-06-06T08:32:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: mon.c calling monitor election 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: monmap epoch 2 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: last_changed 2024-06-06T08:32:35.696265+0000 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: created 2024-06-06T08:30:26.024887+0000 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: min_mon_release 19 (squid) 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: election_strategy: 1 2024-06-06T08:32:41.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-06-06T08:32:41.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: 1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.c 2024-06-06T08:32:41.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: fsmap 2024-06-06T08:32:41.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T08:32:41.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: mgrmap e13: x(active, since 60s) 2024-06-06T08:32:41.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: overall HEALTH_OK 2024-06-06T08:32:41.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:41.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.001+0000 7fea190d0700 1 -- 172.21.15.59:0/1750807164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc0035c0 msgr2=0x7fe9fc005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.001+0000 7fea190d0700 1 --2- 172.21.15.59:0/1750807164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc0035c0 0x7fe9fc005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea14101eb0 tx=0x7fea0400feb0 comp rx=0 tx=0).stop 2024-06-06T08:32:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.001+0000 7fea190d0700 1 -- 172.21.15.59:0/1750807164 shutdown_connections 2024-06-06T08:32:42.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.001+0000 7fea190d0700 1 --2- 172.21.15.59:0/1750807164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9fc0035c0 0x7fe9fc005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:42.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.001+0000 7fea190d0700 1 -- 172.21.15.59:0/1750807164 >> 172.21.15.59:0/1750807164 conn(0x7fea140fda90 msgr2=0x7fea140ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:42.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.001+0000 7fea190d0700 1 -- 172.21.15.59:0/1750807164 shutdown_connections 2024-06-06T08:32:42.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.001+0000 7fea190d0700 1 -- 172.21.15.59:0/1750807164 wait complete. 2024-06-06T08:32:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.002+0000 7fea190d0700 1 Processor -- start 2024-06-06T08:32:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.003+0000 7fea190d0700 1 -- start start 2024-06-06T08:32:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.003+0000 7fea190d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc0035c0 0x7fea14074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.003+0000 7fea190d0700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea140763d0 0x7fea14074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.003+0000 7fea190d0700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fea1410a010 con 0x7fea140763d0 2024-06-06T08:32:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.003+0000 7fea190d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fea14109e90 con 0x7fe9fc0035c0 2024-06-06T08:32:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.003+0000 7fea12d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc0035c0 0x7fea14074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.004+0000 7fea12d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc0035c0 0x7fea14074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53100/0 (socket says 172.21.15.59:53100) 2024-06-06T08:32:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.004+0000 7fea12d9d700 1 -- 172.21.15.59:0/3697881902 learned_addr learned my addr 172.21.15.59:0/3697881902 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-06-06T08:32:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.004+0000 7fea12d9d700 1 -- 172.21.15.59:0/3697881902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc0035c0 msgr2=0x7fea14074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-06-06T08:32:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.004+0000 7fea12d9d700 1 -- 172.21.15.59:0/3697881902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc0035c0 msgr2=0x7fea14074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-06T08:32:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.004+0000 7fea12d9d700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc0035c0 0x7fea14074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-06T08:32:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.004+0000 7fea12d9d700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc0035c0 0x7fea14074790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T08:32:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.004+0000 7fea1259c700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea140763d0 0x7fea14074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.004+0000 7fea1259c700 1 -- 172.21.15.59:0/3697881902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc0035c0 msgr2=0x7fea14074790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T08:32:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.004+0000 7fea1259c700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc0035c0 0x7fea14074790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.004+0000 7fea1259c700 1 -- 172.21.15.59:0/3697881902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea14075210 con 0x7fea140763d0 2024-06-06T08:32:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.005+0000 7fea1259c700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea140763d0 0x7fea14074cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea0800b500 tx=0x7fea0800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:42.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.005+0000 7fe9fbfff700 1 -- 172.21.15.59:0/3697881902 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fea08011630 con 0x7fea140763d0 2024-06-06T08:32:42.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.005+0000 7fea190d0700 1 -- 172.21.15.59:0/3697881902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea14075500 con 0x7fea140763d0 2024-06-06T08:32:42.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.005+0000 7fea190d0700 1 -- 172.21.15.59:0/3697881902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea141a8770 con 0x7fea140763d0 2024-06-06T08:32:42.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.005+0000 7fe9fbfff700 1 -- 172.21.15.59:0/3697881902 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea08011cb0 con 0x7fea140763d0 2024-06-06T08:32:42.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.005+0000 7fe9fbfff700 1 -- 172.21.15.59:0/3697881902 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fea08019dd0 con 0x7fea140763d0 2024-06-06T08:32:42.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.006+0000 7fea190d0700 1 -- 172.21.15.59:0/3697881902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea141036c0 con 0x7fea140763d0 2024-06-06T08:32:42.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.007+0000 7fe9fbfff700 1 -- 172.21.15.59:0/3697881902 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fea08018020 con 0x7fea140763d0 2024-06-06T08:32:42.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.007+0000 7fe9fbfff700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fea00038e90 0x7fea0003b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:42.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.007+0000 7fe9fbfff700 1 -- 172.21.15.59:0/3697881902 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fea0804b300 con 0x7fea140763d0 2024-06-06T08:32:42.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.007+0000 7fea12d9d700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fea00038e90 0x7fea0003b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:42.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.008+0000 7fea12d9d700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fea00038e90 0x7fea0003b350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fea0400fa60 tx=0x7fea04005c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.022+0000 7fe9fbfff700 1 -- 172.21.15.59:0/3697881902 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fea0800e4c0 con 0x7fea140763d0 2024-06-06T08:32:42.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:41 smithi028 ceph-mon[31564]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:42.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:42.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:42.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:42.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:41 smithi028 ceph-mon[31564]: Deploying daemon mon.b on smithi037 2024-06-06T08:32:42.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:41 smithi059 ceph-mon[36684]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:41 smithi059 ceph-mon[36684]: Deploying daemon mon.b on smithi037 2024-06-06T08:32:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:42.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.317+0000 7fea190d0700 1 -- 172.21.15.59:0/3697881902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fea14075cc0 con 0x7fea140763d0 2024-06-06T08:32:42.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.318+0000 7fe9fbfff700 1 -- 172.21.15.59:0/3697881902 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7fea0800e260 con 0x7fea140763d0 2024-06-06T08:32:42.317 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:32:42.317 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":2,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","modified":"2024-06-06T08:32:35.696265Z","created":"2024-06-06T08:30:26.024887Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-06T08:32:42.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.320+0000 7fea190d0700 1 -- 172.21.15.59:0/3697881902 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fea00038e90 msgr2=0x7fea0003b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:42.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.320+0000 7fea190d0700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fea00038e90 0x7fea0003b350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fea0400fa60 tx=0x7fea04005c20 comp rx=0 tx=0).stop 2024-06-06T08:32:42.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.320+0000 7fea190d0700 1 -- 172.21.15.59:0/3697881902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea140763d0 msgr2=0x7fea14074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:42.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.320+0000 7fea190d0700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea140763d0 0x7fea14074cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea0800b500 tx=0x7fea0800b8c0 comp rx=0 tx=0).stop 2024-06-06T08:32:42.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.320+0000 7fea190d0700 1 -- 172.21.15.59:0/3697881902 shutdown_connections 2024-06-06T08:32:42.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.320+0000 7fea190d0700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fea00038e90 0x7fea0003b350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:42.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.320+0000 7fea190d0700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc0035c0 0x7fea14074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:42.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.320+0000 7fea190d0700 1 --2- 172.21.15.59:0/3697881902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea140763d0 0x7fea14074cd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:42.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.320+0000 7fea190d0700 1 -- 172.21.15.59:0/3697881902 >> 172.21.15.59:0/3697881902 conn(0x7fea140fda90 msgr2=0x7fea140feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:42.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.321+0000 7fea190d0700 1 -- 172.21.15.59:0/3697881902 shutdown_connections 2024-06-06T08:32:42.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:42.321+0000 7fea190d0700 1 -- 172.21.15.59:0/3697881902 wait complete. 2024-06-06T08:32:42.321 INFO:teuthology.orchestra.run.smithi059.stderr:dumped monmap epoch 2 2024-06-06T08:32:42.883 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:42 smithi059 ceph-mon[36684]: from='client.? 172.21.15.59:0/3697881902' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T08:32:43.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:42 smithi028 ceph-mon[31564]: from='client.? 172.21.15.59:0/3697881902' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T08:32:43.914 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-06T08:32:43.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-06T08:32:44.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:43 smithi059 ceph-mon[36684]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:44.168 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:32:44.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:43 smithi028 ceph-mon[31564]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:45.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:44 smithi037 systemd[1]: Started Ceph mon.b for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:32:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.098+0000 7f2375915700 1 -- 172.21.15.59:0/2371785396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23580035c0 msgr2=0x7f2358005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.098+0000 7f2375915700 1 --2- 172.21.15.59:0/2371785396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23580035c0 0x7f2358005a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2370100dd0 tx=0x7f236000fe60 comp rx=0 tx=0).stop 2024-06-06T08:32:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.098+0000 7f2375915700 1 -- 172.21.15.59:0/2371785396 shutdown_connections 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.098+0000 7f2375915700 1 --2- 172.21.15.59:0/2371785396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23580035c0 0x7f2358005a50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.098+0000 7f2375915700 1 -- 172.21.15.59:0/2371785396 >> 172.21.15.59:0/2371785396 conn(0x7f23700fc9d0 msgr2=0x7f23700fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.099+0000 7f2375915700 1 -- 172.21.15.59:0/2371785396 shutdown_connections 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.099+0000 7f2375915700 1 -- 172.21.15.59:0/2371785396 wait complete. 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.099+0000 7f2375915700 1 Processor -- start 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f2375915700 1 -- start start 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f2375915700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23580035c0 0x7f23700fd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f2375915700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23700fef30 0x7f23700fd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f2375915700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23700fdd70 0x7f23701aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f2375915700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2370108ee0 con 0x7f23700fdd70 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f2375915700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2370108d60 con 0x7f23700fef30 2024-06-06T08:32:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f2375915700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2370109060 con 0x7f23580035c0 2024-06-06T08:32:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f236effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23580035c0 0x7f23700fd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f236effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23580035c0 0x7f23700fd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51916/0 (socket says 172.21.15.59:51916) 2024-06-06T08:32:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f236effd700 1 -- 172.21.15.59:0/2121659387 learned_addr learned my addr 172.21.15.59:0/2121659387 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-06-06T08:32:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f236effd700 1 -- 172.21.15.59:0/2121659387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23580035c0 msgr2=0x7f23700fd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-06-06T08:32:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.100+0000 7f236effd700 1 -- 172.21.15.59:0/2121659387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23580035c0 msgr2=0x7f23700fd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-06T08:32:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236effd700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23580035c0 0x7f23700fd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-06T08:32:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236effd700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23580035c0 0x7f23700fd2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T08:32:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236e7fc700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23700fef30 0x7f23700fd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236f7fe700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23700fdd70 0x7f23701aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236e7fc700 1 -- 172.21.15.59:0/2121659387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23700fef30 msgr2=0x7f23700fd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-06-06T08:32:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236e7fc700 1 -- 172.21.15.59:0/2121659387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23700fef30 msgr2=0x7f23700fd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-06T08:32:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236e7fc700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23700fef30 0x7f23700fd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-06T08:32:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236e7fc700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23700fef30 0x7f23700fd830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-06T08:32:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236f7fe700 1 -- 172.21.15.59:0/2121659387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23580035c0 msgr2=0x7f23700fd2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T08:32:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236f7fe700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23580035c0 0x7f23700fd2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236f7fe700 1 -- 172.21.15.59:0/2121659387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23700fef30 msgr2=0x7f23700fd830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T08:32:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236f7fe700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23700fef30 0x7f23700fd830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.101+0000 7f236f7fe700 1 -- 172.21.15.59:0/2121659387 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23701aad30 con 0x7f23700fdd70 2024-06-06T08:32:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.102+0000 7f236f7fe700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23700fdd70 0x7f23701aa5e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f236800bd50 tx=0x7f236800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.102+0000 7f2374913700 1 -- 172.21.15.59:0/2121659387 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2368019070 con 0x7f23700fdd70 2024-06-06T08:32:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.102+0000 7f2375915700 1 -- 172.21.15.59:0/2121659387 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23701aafc0 con 0x7f23700fdd70 2024-06-06T08:32:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.102+0000 7f2374913700 1 -- 172.21.15.59:0/2121659387 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f236800cd10 con 0x7f23700fdd70 2024-06-06T08:32:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.102+0000 7f2374913700 1 -- 172.21.15.59:0/2121659387 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23680127e0 con 0x7f23700fdd70 2024-06-06T08:32:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.102+0000 7f2375915700 1 -- 172.21.15.59:0/2121659387 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23701ab500 con 0x7f23700fdd70 2024-06-06T08:32:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.103+0000 7f2375915700 1 -- 172.21.15.59:0/2121659387 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23701025e0 con 0x7f23700fdd70 2024-06-06T08:32:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.104+0000 7f2374913700 1 -- 172.21.15.59:0/2121659387 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f236801c070 con 0x7f23700fdd70 2024-06-06T08:32:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.104+0000 7f2374913700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f235c039580 0x7f235c03ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.104+0000 7f2374913700 1 -- 172.21.15.59:0/2121659387 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f236804bab0 con 0x7f23700fdd70 2024-06-06T08:32:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.105+0000 7f236effd700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f235c039580 0x7f235c03ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.106+0000 7f236effd700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f235c039580 0x7f235c03ba40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2360005850 tx=0x7f23600057c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:50.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.120+0000 7f2374913700 1 -- 172.21.15.59:0/2121659387 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2368018170 con 0x7f23700fdd70 2024-06-06T08:32:50.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:50.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: mon.c calling monitor election 2024-06-06T08:32:50.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:32:50.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: mon.a calling monitor election 2024-06-06T08:32:50.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:50.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:50.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:50.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: monmap epoch 3 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: last_changed 2024-06-06T08:32:44.838724+0000 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: created 2024-06-06T08:30:26.024887+0000 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: min_mon_release 19 (squid) 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: election_strategy: 1 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: 1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.c 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: 2: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: fsmap 2024-06-06T08:32:50.293 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T08:32:50.294 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: mgrmap e13: x(active, since 69s) 2024-06-06T08:32:50.294 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: overall HEALTH_OK 2024-06-06T08:32:50.294 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:50.294 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:50.294 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:50.294 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:50.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:50.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: mon.c calling monitor election 2024-06-06T08:32:50.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:32:50.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: mon.a calling monitor election 2024-06-06T08:32:50.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:50.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: monmap epoch 3 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: last_changed 2024-06-06T08:32:44.838724+0000 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: created 2024-06-06T08:30:26.024887+0000 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: min_mon_release 19 (squid) 2024-06-06T08:32:50.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: election_strategy: 1 2024-06-06T08:32:50.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-06-06T08:32:50.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: 1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.c 2024-06-06T08:32:50.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: 2: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2024-06-06T08:32:50.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: fsmap 2024-06-06T08:32:50.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T08:32:50.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: mgrmap e13: x(active, since 69s) 2024-06-06T08:32:50.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: overall HEALTH_OK 2024-06-06T08:32:50.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:50.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:50.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:50.352 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.418+0000 7f2375915700 1 -- 172.21.15.59:0/2121659387 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f237002dca0 con 0x7f23700fdd70 2024-06-06T08:32:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.419+0000 7f2374913700 1 -- 172.21.15.59:0/2121659387 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7f2368014440 con 0x7f23700fdd70 2024-06-06T08:32:50.418 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-06-06T08:32:50.419 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":3,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","modified":"2024-06-06T08:32:44.838724Z","created":"2024-06-06T08:30:26.024887Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-06T08:32:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.421+0000 7f2375915700 1 -- 172.21.15.59:0/2121659387 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f235c039580 msgr2=0x7f235c03ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.421+0000 7f2375915700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f235c039580 0x7f235c03ba40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2360005850 tx=0x7f23600057c0 comp rx=0 tx=0).stop 2024-06-06T08:32:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.421+0000 7f2375915700 1 -- 172.21.15.59:0/2121659387 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23700fdd70 msgr2=0x7f23701aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.421+0000 7f2375915700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23700fdd70 0x7f23701aa5e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f236800bd50 tx=0x7f236800be30 comp rx=0 tx=0).stop 2024-06-06T08:32:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.422+0000 7f2375915700 1 -- 172.21.15.59:0/2121659387 shutdown_connections 2024-06-06T08:32:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.422+0000 7f2375915700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f235c039580 0x7f235c03ba40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.422+0000 7f2375915700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23700fdd70 0x7f23701aa5e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.422+0000 7f2375915700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23580035c0 0x7f23700fd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.422+0000 7f2375915700 1 --2- 172.21.15.59:0/2121659387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23700fef30 0x7f23700fd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.422+0000 7f2375915700 1 -- 172.21.15.59:0/2121659387 >> 172.21.15.59:0/2121659387 conn(0x7f23700fc9d0 msgr2=0x7f237006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.422+0000 7f2375915700 1 -- 172.21.15.59:0/2121659387 shutdown_connections 2024-06-06T08:32:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:50.422+0000 7f2375915700 1 -- 172.21.15.59:0/2121659387 wait complete. 2024-06-06T08:32:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:dumped monmap epoch 3 2024-06-06T08:32:51.007 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-06-06T08:32:51.007 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph config generate-minimal-conf 2024-06-06T08:32:51.305 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:51 smithi059 ceph-mon[36684]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:51.305 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:51.305 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:32:51.305 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:51 smithi059 ceph-mon[36684]: from='client.? 172.21.15.59:0/2121659387' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T08:32:51.305 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:51.434 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:32:51.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:51 smithi028 ceph-mon[31564]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:51.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:51.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:32:51.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:51 smithi028 ceph-mon[31564]: from='client.? 172.21.15.59:0/2121659387' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T08:32:51.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: mon.c calling monitor election 2024-06-06T08:32:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:32:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: mon.a calling monitor election 2024-06-06T08:32:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:32:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: monmap epoch 3 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: last_changed 2024-06-06T08:32:44.838724+0000 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: created 2024-06-06T08:30:26.024887+0000 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: min_mon_release 19 (squid) 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: election_strategy: 1 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: 1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.c 2024-06-06T08:32:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: 2: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: fsmap 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: mgrmap e13: x(active, since 69s) 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: overall HEALTH_OK 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='client.? 172.21.15.59:0/2121659387' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T08:32:52.316 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:53.016 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: mon.b calling monitor election 2024-06-06T08:32:53.016 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: Updating smithi028:/etc/ceph/ceph.conf 2024-06-06T08:32:53.016 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: Updating smithi037:/etc/ceph/ceph.conf 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: Updating smithi059:/etc/ceph/ceph.conf 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: mon.b calling monitor election 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: mon.c calling monitor election 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: mon.a calling monitor election 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: monmap epoch 3 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: last_changed 2024-06-06T08:32:44.838724+0000 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: created 2024-06-06T08:30:26.024887+0000 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: min_mon_release 19 (squid) 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: election_strategy: 1 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-06-06T08:32:53.017 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: 1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.c 2024-06-06T08:32:53.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: 2: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2024-06-06T08:32:53.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: fsmap 2024-06-06T08:32:53.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T08:32:53.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: mgrmap e13: x(active, since 71s) 2024-06-06T08:32:53.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: overall HEALTH_OK 2024-06-06T08:32:53.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:52 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: mon.b calling monitor election 2024-06-06T08:32:53.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: Updating smithi028:/etc/ceph/ceph.conf 2024-06-06T08:32:53.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: Updating smithi037:/etc/ceph/ceph.conf 2024-06-06T08:32:53.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: Updating smithi059:/etc/ceph/ceph.conf 2024-06-06T08:32:53.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: mon.b calling monitor election 2024-06-06T08:32:53.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: mon.c calling monitor election 2024-06-06T08:32:53.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: mon.a calling monitor election 2024-06-06T08:32:53.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-06T08:32:53.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: monmap epoch 3 2024-06-06T08:32:53.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:53.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: last_changed 2024-06-06T08:32:44.838724+0000 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: created 2024-06-06T08:30:26.024887+0000 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: min_mon_release 19 (squid) 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: election_strategy: 1 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: 1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.c 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: 2: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: fsmap 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: mgrmap e13: x(active, since 71s) 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: overall HEALTH_OK 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.066 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:52 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: mon.b calling monitor election 2024-06-06T08:32:53.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: Updating smithi028:/etc/ceph/ceph.conf 2024-06-06T08:32:53.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: Updating smithi037:/etc/ceph/ceph.conf 2024-06-06T08:32:53.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: Updating smithi059:/etc/ceph/ceph.conf 2024-06-06T08:32:53.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: mon.b calling monitor election 2024-06-06T08:32:53.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: mon.c calling monitor election 2024-06-06T08:32:53.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: mon.a calling monitor election 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: monmap epoch 3 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: last_changed 2024-06-06T08:32:44.838724+0000 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: created 2024-06-06T08:30:26.024887+0000 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: min_mon_release 19 (squid) 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: election_strategy: 1 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: 0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: 1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.c 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: 2: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.b 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: fsmap 2024-06-06T08:32:53.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T08:32:53.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: mgrmap e13: x(active, since 71s) 2024-06-06T08:32:53.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: overall HEALTH_OK 2024-06-06T08:32:53.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:52 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.550+0000 7f4933000700 1 -- 172.21.15.28:0/471504347 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f492c102100 msgr2=0x7f492c1024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.550+0000 7f4933000700 1 --2- 172.21.15.28:0/471504347 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f492c102100 0x7f492c1024e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f491c009910 tx=0x7f491c009c20 comp rx=0 tx=0).stop 2024-06-06T08:32:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.550+0000 7f4933000700 1 -- 172.21.15.28:0/471504347 shutdown_connections 2024-06-06T08:32:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.550+0000 7f4933000700 1 --2- 172.21.15.28:0/471504347 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f492c102100 0x7f492c1024e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.550+0000 7f4933000700 1 -- 172.21.15.28:0/471504347 >> 172.21.15.28:0/471504347 conn(0x7f492c0fd9d0 msgr2=0x7f492c0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.550+0000 7f4933000700 1 -- 172.21.15.28:0/471504347 shutdown_connections 2024-06-06T08:32:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.551+0000 7f4933000700 1 -- 172.21.15.28:0/471504347 wait complete. 2024-06-06T08:32:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.552+0000 7f4933000700 1 Processor -- start 2024-06-06T08:32:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.552+0000 7f4933000700 1 -- start start 2024-06-06T08:32:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.553+0000 7f4933000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f492c102100 0x7f492c199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.553+0000 7f4933000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f492c19a390 0x7f492c19e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.553+0000 7f4933000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c19ec60 0x7f492c19f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.553+0000 7f4933000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f492c10c490 con 0x7f492c102100 2024-06-06T08:32:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.553+0000 7f4933000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f492c10c310 con 0x7f492c19ec60 2024-06-06T08:32:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.553+0000 7f4933000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f492c10c610 con 0x7f492c19a390 2024-06-06T08:32:53.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.553+0000 7f492be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f492c102100 0x7f492c199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:53.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.553+0000 7f492be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f492c102100 0x7f492c199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40734/0 (socket says 172.21.15.28:40734) 2024-06-06T08:32:53.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.553+0000 7f492be00700 1 -- 172.21.15.28:0/391734084 learned_addr learned my addr 172.21.15.28:0/391734084 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:32:53.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.553+0000 7f4931000700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c19ec60 0x7f492c19f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:53.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.553+0000 7f492b400700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f492c19a390 0x7f492c19e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:53.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.554+0000 7f492be00700 1 -- 172.21.15.28:0/391734084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f492c19a390 msgr2=0x7f492c19e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:53.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.554+0000 7f492be00700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f492c19a390 0x7f492c19e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:53.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.554+0000 7f492be00700 1 -- 172.21.15.28:0/391734084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c19ec60 msgr2=0x7f492c19f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:53.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.554+0000 7f492be00700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c19ec60 0x7f492c19f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:53.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.554+0000 7f492be00700 1 -- 172.21.15.28:0/391734084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c1a69d0 con 0x7f492c102100 2024-06-06T08:32:53.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.554+0000 7f492be00700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f492c102100 0x7f492c199e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f491c00bdc0 tx=0x7f491c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:53.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.555+0000 7f4928c00700 1 -- 172.21.15.28:0/391734084 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c026070 con 0x7f492c102100 2024-06-06T08:32:53.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.555+0000 7f4928c00700 1 -- 172.21.15.28:0/391734084 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f491c005da0 con 0x7f492c102100 2024-06-06T08:32:53.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.555+0000 7f4928c00700 1 -- 172.21.15.28:0/391734084 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0038e0 con 0x7f492c102100 2024-06-06T08:32:53.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.555+0000 7f4933000700 1 -- 172.21.15.28:0/391734084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c1a6c00 con 0x7f492c102100 2024-06-06T08:32:53.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.555+0000 7f4933000700 1 -- 172.21.15.28:0/391734084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c1a7140 con 0x7f492c102100 2024-06-06T08:32:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.556+0000 7f4933000700 1 -- 172.21.15.28:0/391734084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492c063af0 con 0x7f492c102100 2024-06-06T08:32:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.556+0000 7f4928c00700 1 -- 172.21.15.28:0/391734084 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f491c029070 con 0x7f492c102100 2024-06-06T08:32:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.557+0000 7f4928c00700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4910039580 0x7f491003ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.557+0000 7f4928c00700 1 -- 172.21.15.28:0/391734084 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f491c04ce60 con 0x7f492c102100 2024-06-06T08:32:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.558+0000 7f492b400700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4910039580 0x7f491003ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:53.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.559+0000 7f492b400700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4910039580 0x7f491003ba40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4918009ad0 tx=0x7f4918009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:53.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.569+0000 7f4928c00700 1 -- 172.21.15.28:0/391734084 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f491c050030 con 0x7f492c102100 2024-06-06T08:32:53.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.809+0000 7f4933000700 1 -- 172.21.15.28:0/391734084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f492c1a73a0 con 0x7f492c102100 2024-06-06T08:32:53.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.809+0000 7f4928c00700 1 -- 172.21.15.28:0/391734084 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7f491c030020 con 0x7f492c102100 2024-06-06T08:32:53.809 INFO:teuthology.orchestra.run.smithi028.stdout:# minimal ceph.conf for e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:53.809 INFO:teuthology.orchestra.run.smithi028.stdout:[global] 2024-06-06T08:32:53.809 INFO:teuthology.orchestra.run.smithi028.stdout: fsid = e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:32:53.809 INFO:teuthology.orchestra.run.smithi028.stdout: mon_host = [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] 2024-06-06T08:32:53.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.812+0000 7f4933000700 1 -- 172.21.15.28:0/391734084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4910039580 msgr2=0x7f491003ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:53.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.812+0000 7f4933000700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4910039580 0x7f491003ba40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4918009ad0 tx=0x7f4918009210 comp rx=0 tx=0).stop 2024-06-06T08:32:53.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.812+0000 7f4933000700 1 -- 172.21.15.28:0/391734084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f492c102100 msgr2=0x7f492c199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:53.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.812+0000 7f4933000700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f492c102100 0x7f492c199e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f491c00bdc0 tx=0x7f491c00bdf0 comp rx=0 tx=0).stop 2024-06-06T08:32:53.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.812+0000 7f4933000700 1 -- 172.21.15.28:0/391734084 shutdown_connections 2024-06-06T08:32:53.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.812+0000 7f4933000700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4910039580 0x7f491003ba40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:53.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.812+0000 7f4933000700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c19ec60 0x7f492c19f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:53.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.812+0000 7f4933000700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f492c102100 0x7f492c199e50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:53.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.812+0000 7f4933000700 1 --2- 172.21.15.28:0/391734084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f492c19a390 0x7f492c19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:53.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.812+0000 7f4933000700 1 -- 172.21.15.28:0/391734084 >> 172.21.15.28:0/391734084 conn(0x7f492c0fd9d0 msgr2=0x7f492c074760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:53.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.813+0000 7f4933000700 1 -- 172.21.15.28:0/391734084 shutdown_connections 2024-06-06T08:32:53.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:32:53.813+0000 7f4933000700 1 -- 172.21.15.28:0/391734084 wait complete. 2024-06-06T08:32:54.040 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:32:53.840+0000 7ff4ed800700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: Updating smithi037:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: Updating smithi059:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: Updating smithi028:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:54.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T08:32:54.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: Updating smithi037:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: Updating smithi059:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: Updating smithi028:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:54.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T08:32:54.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: Updating smithi037:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: Updating smithi059:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: Updating smithi028:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T08:32:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:32:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:54.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:54.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T08:32:54.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:54.533 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-06-06T08:32:54.533 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:32:54.533 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.conf 2024-06-06T08:32:54.608 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:32:54.609 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T08:32:54.726 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-06-06T08:32:54.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.conf 2024-06-06T08:32:54.760 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-06-06T08:32:54.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T08:32:54.830 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-06-06T08:32:54.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.conf 2024-06-06T08:32:54.861 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-06-06T08:32:54.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T08:32:54.927 INFO:tasks.cephadm:Adding mgr.x on smithi028 2024-06-06T08:32:54.928 INFO:tasks.cephadm:Adding mgr.y on smithi037 2024-06-06T08:32:54.928 INFO:tasks.cephadm:Adding mgr.z on smithi059 2024-06-06T08:32:54.928 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch apply mgr '3;smithi028=x;smithi037=y;smithi059=z' 2024-06-06T08:32:54.974 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:54 smithi028 ceph-mon[31564]: Reconfiguring mon.a (unknown last config time)... 2024-06-06T08:32:54.975 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:54 smithi028 ceph-mon[31564]: Reconfiguring daemon mon.a on smithi028 2024-06-06T08:32:54.975 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:54 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/391734084' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:55.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:54 smithi037 ceph-mon[36609]: Reconfiguring mon.a (unknown last config time)... 2024-06-06T08:32:55.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:54 smithi037 ceph-mon[36609]: Reconfiguring daemon mon.a on smithi028 2024-06-06T08:32:55.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:54 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/391734084' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:55.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:54 smithi059 ceph-mon[36684]: Reconfiguring mon.a (unknown last config time)... 2024-06-06T08:32:55.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:54 smithi059 ceph-mon[36684]: Reconfiguring daemon mon.a on smithi028 2024-06-06T08:32:55.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:54 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/391734084' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:55.204 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:32:56.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:55 smithi028 ceph-mon[31564]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:56.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:55 smithi037 ceph-mon[36609]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:56.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:55 smithi059 ceph-mon[36684]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.657+0000 7f7db3880700 1 -- 172.21.15.59:0/4177057576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dac100ea0 msgr2=0x7f7dac1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.657+0000 7f7db3880700 1 --2- 172.21.15.59:0/4177057576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dac100ea0 0x7f7dac1012c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009910 tx=0x7f7da8009c20 comp rx=0 tx=0).stop 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.657+0000 7f7db3880700 1 -- 172.21.15.59:0/4177057576 shutdown_connections 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.657+0000 7f7db3880700 1 --2- 172.21.15.59:0/4177057576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dac100ea0 0x7f7dac1012c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.657+0000 7f7db3880700 1 -- 172.21.15.59:0/4177057576 >> 172.21.15.59:0/4177057576 conn(0x7f7dac0fc490 msgr2=0x7f7dac0fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.657+0000 7f7db3880700 1 -- 172.21.15.59:0/4177057576 shutdown_connections 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.657+0000 7f7db3880700 1 -- 172.21.15.59:0/4177057576 wait complete. 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.657+0000 7f7db3880700 1 Processor -- start 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.657+0000 7f7db3880700 1 -- start start 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db3880700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac100ea0 0x7f7dac196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db3880700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac196ca0 0x7f7dac19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db3880700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dac197120 0x7f7dac19e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db3880700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac106e90 con 0x7f7dac197120 2024-06-06T08:32:56.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db3880700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac106d10 con 0x7f7dac196ca0 2024-06-06T08:32:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db3880700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac107010 con 0x7f7dac100ea0 2024-06-06T08:32:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db161c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac100ea0 0x7f7dac196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db161c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac100ea0 0x7f7dac196760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54524/0 (socket says 172.21.15.59:54524) 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db161c700 1 -- 172.21.15.59:0/588128192 learned_addr learned my addr 172.21.15.59:0/588128192 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db0e1b700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac196ca0 0x7f7dac19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db1e1d700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dac197120 0x7f7dac19e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db161c700 1 -- 172.21.15.59:0/588128192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac196ca0 msgr2=0x7f7dac19bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db161c700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac196ca0 0x7f7dac19bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db161c700 1 -- 172.21.15.59:0/588128192 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dac197120 msgr2=0x7f7dac19e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db161c700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dac197120 0x7f7dac19e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db161c700 1 -- 172.21.15.59:0/588128192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac19eb70 con 0x7f7dac100ea0 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db0e1b700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac196ca0 0x7f7dac19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.658+0000 7f7db161c700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac100ea0 0x7f7dac196760 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7da8000c00 tx=0x7f7da80050b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.659+0000 7f7da27fc700 1 -- 172.21.15.59:0/588128192 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8029070 con 0x7f7dac100ea0 2024-06-06T08:32:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.659+0000 7f7da27fc700 1 -- 172.21.15.59:0/588128192 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da8019650 con 0x7f7dac100ea0 2024-06-06T08:32:56.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.659+0000 7f7db3880700 1 -- 172.21.15.59:0/588128192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dac069e10 con 0x7f7dac100ea0 2024-06-06T08:32:56.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.659+0000 7f7da27fc700 1 -- 172.21.15.59:0/588128192 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da80246d0 con 0x7f7dac100ea0 2024-06-06T08:32:56.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.659+0000 7f7db3880700 1 -- 172.21.15.59:0/588128192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dac06a3c0 con 0x7f7dac100ea0 2024-06-06T08:32:56.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.660+0000 7f7da27fc700 1 -- 172.21.15.59:0/588128192 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7da802c070 con 0x7f7dac100ea0 2024-06-06T08:32:56.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.660+0000 7f7db3880700 1 -- 172.21.15.59:0/588128192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dac063af0 con 0x7f7dac100ea0 2024-06-06T08:32:56.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.660+0000 7f7da27fc700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d98039580 0x7f7d9803ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:32:56.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.660+0000 7f7da27fc700 1 -- 172.21.15.59:0/588128192 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7da804f5b0 con 0x7f7dac100ea0 2024-06-06T08:32:56.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.661+0000 7f7db0e1b700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d98039580 0x7f7d9803ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:32:56.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.662+0000 7f7db0e1b700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d98039580 0x7f7d9803ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009910 tx=0x7f7d9c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:32:56.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.665+0000 7f7da27fc700 1 -- 172.21.15.59:0/588128192 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7da8013070 con 0x7f7dac100ea0 2024-06-06T08:32:56.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.886+0000 7f7db3880700 1 -- 172.21.15.59:0/588128192 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi028=x;smithi037=y;smithi059=z", "target": ["mon-mgr", ""]}) -- 0x7f7dac0fe3d0 con 0x7f7d98039580 2024-06-06T08:32:56.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.900+0000 7f7da27fc700 1 -- 172.21.15.59:0/588128192 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7dac0fe3d0 con 0x7f7d98039580 2024-06-06T08:32:56.899 INFO:teuthology.orchestra.run.smithi059.stdout:Scheduled mgr update... 2024-06-06T08:32:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 -- 172.21.15.59:0/588128192 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d98039580 msgr2=0x7f7d9803ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d98039580 0x7f7d9803ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009910 tx=0x7f7d9c008040 comp rx=0 tx=0).stop 2024-06-06T08:32:56.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 -- 172.21.15.59:0/588128192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac100ea0 msgr2=0x7f7dac196760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:32:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac100ea0 0x7f7dac196760 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7da8000c00 tx=0x7f7da80050b0 comp rx=0 tx=0).stop 2024-06-06T08:32:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 -- 172.21.15.59:0/588128192 shutdown_connections 2024-06-06T08:32:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7d98039580 0x7f7d9803ba40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dac197120 0x7f7dac19e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac100ea0 0x7f7dac196760 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 --2- 172.21.15.59:0/588128192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac196ca0 0x7f7dac19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:32:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 -- 172.21.15.59:0/588128192 >> 172.21.15.59:0/588128192 conn(0x7f7dac0fc490 msgr2=0x7f7dac0fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:32:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 -- 172.21.15.59:0/588128192 shutdown_connections 2024-06-06T08:32:56.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:32:56.902+0000 7f7db3880700 1 -- 172.21.15.59:0/588128192 wait complete. 2024-06-06T08:32:57.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:57.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:57.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:56 smithi037 ceph-mon[36609]: Reconfiguring mon.b (monmap changed)... 2024-06-06T08:32:57.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:57.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T08:32:57.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:56 smithi059 ceph-mon[36684]: Reconfiguring mon.b (monmap changed)... 2024-06-06T08:32:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T08:32:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:57.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:57.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:57.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:56 smithi028 ceph-mon[31564]: Reconfiguring mon.b (monmap changed)... 2024-06-06T08:32:57.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:57.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T08:32:57.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:57.455 DEBUG:teuthology.orchestra.run.smithi037:mgr.y> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.y.service 2024-06-06T08:32:57.457 DEBUG:teuthology.orchestra.run.smithi059:mgr.z> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.z.service 2024-06-06T08:32:57.460 INFO:tasks.cephadm:Deploying OSDs... 2024-06-06T08:32:57.460 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:32:57.460 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/scratch_devs of=/dev/stdout 2024-06-06T08:32:57.518 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-06T08:32:57.519 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_1 2024-06-06T08:32:57.570 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-06T08:32:57.570 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:57.570 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 6h/6d Inode: 638 Links: 1 2024-06-06T08:32:57.570 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:57.570 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:57.571 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-06-06 08:31:57.159078682 +0000 2024-06-06T08:32:57.571 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-06-06 08:26:33.914355850 +0000 2024-06-06T08:32:57.571 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-06-06 08:26:33.914355850 +0000 2024-06-06T08:32:57.571 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-06-06 08:26:33.914355850 +0000 2024-06-06T08:32:57.571 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-06T08:32:57.653 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-06-06T08:32:57.654 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-06-06T08:32:57.654 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000280297 s, 1.8 MB/s 2024-06-06T08:32:57.658 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-06T08:32:57.716 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_2 2024-06-06T08:32:57.768 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-06T08:32:57.768 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:57.768 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 6h/6d Inode: 655 Links: 1 2024-06-06T08:32:57.768 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:57.768 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:57.769 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-06-06 08:31:57.211077257 +0000 2024-06-06T08:32:57.769 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-06-06 08:26:34.479340629 +0000 2024-06-06T08:32:57.769 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-06-06 08:26:34.479340629 +0000 2024-06-06T08:32:57.769 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-06-06 08:26:34.479340629 +0000 2024-06-06T08:32:57.769 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-06T08:32:57.856 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-06-06T08:32:57.856 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-06-06T08:32:57.856 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000280287 s, 1.8 MB/s 2024-06-06T08:32:57.860 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-06T08:32:57.916 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_3 2024-06-06T08:32:57.968 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-06T08:32:57.968 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:57.968 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 6h/6d Inode: 674 Links: 1 2024-06-06T08:32:57.968 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:57.968 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:57.968 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-06-06 08:31:57.257075995 +0000 2024-06-06T08:32:57.968 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-06-06 08:26:35.044325409 +0000 2024-06-06T08:32:57.969 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-06-06 08:26:35.044325409 +0000 2024-06-06T08:32:57.969 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-06-06 08:26:35.044325409 +0000 2024-06-06T08:32:57.969 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-06T08:32:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:57 smithi028 ceph-mon[31564]: Reconfiguring daemon mon.b on smithi037 2024-06-06T08:32:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:57 smithi028 ceph-mon[31564]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T08:32:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:58.052 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-06-06T08:32:58.052 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-06-06T08:32:58.053 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000296288 s, 1.7 MB/s 2024-06-06T08:32:58.057 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-06T08:32:58.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:57 smithi059 ceph-mon[36684]: Reconfiguring daemon mon.b on smithi037 2024-06-06T08:32:58.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:57 smithi059 ceph-mon[36684]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:58.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:58.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:58.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:58.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:58.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T08:32:58.085 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:58.116 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_4 2024-06-06T08:32:58.169 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-06T08:32:58.169 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:58.169 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 6h/6d Inode: 694 Links: 1 2024-06-06T08:32:58.169 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:58.169 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:58.170 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-06-06 08:31:57.313074460 +0000 2024-06-06T08:32:58.170 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-06-06 08:26:35.637309434 +0000 2024-06-06T08:32:58.170 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-06-06 08:26:35.637309434 +0000 2024-06-06T08:32:58.170 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-06-06 08:26:35.637309434 +0000 2024-06-06T08:32:58.170 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-06T08:32:58.251 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-06-06T08:32:58.251 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-06-06T08:32:58.252 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000267438 s, 1.9 MB/s 2024-06-06T08:32:58.255 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-06T08:32:58.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:57 smithi037 ceph-mon[36609]: Reconfiguring daemon mon.b on smithi037 2024-06-06T08:32:58.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:57 smithi037 ceph-mon[36609]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:32:58.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:58.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:58.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:32:58.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T08:32:58.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T08:32:58.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:32:58.316 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-06-06T08:32:58.316 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-06-06T08:32:58.335 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-06T08:32:58.335 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-06-06T08:32:58.394 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-06T08:32:58.394 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:58.394 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-06-06T08:32:58.395 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:58.395 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:58.395 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-06-06 08:32:44.227241389 +0000 2024-06-06T08:32:58.395 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-06-06 08:25:16.646115111 +0000 2024-06-06T08:32:58.395 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-06-06 08:25:16.646115111 +0000 2024-06-06T08:32:58.395 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-06-06 08:25:16.646115111 +0000 2024-06-06T08:32:58.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-06T08:32:58.463 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-06-06T08:32:58.463 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-06-06T08:32:58.463 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000289251 s, 1.8 MB/s 2024-06-06T08:32:58.465 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-06T08:32:58.523 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-06-06T08:32:58.581 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-06T08:32:58.581 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:58.581 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-06-06T08:32:58.581 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:58.581 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:58.581 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-06-06 08:32:44.228241377 +0000 2024-06-06T08:32:58.582 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-06-06 08:25:16.977110896 +0000 2024-06-06T08:32:58.582 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-06-06 08:25:16.977110896 +0000 2024-06-06T08:32:58.582 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-06-06 08:25:16.977110896 +0000 2024-06-06T08:32:58.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-06T08:32:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-06-06T08:32:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-06-06T08:32:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000237767 s, 2.2 MB/s 2024-06-06T08:32:58.650 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-06T08:32:58.710 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-06-06T08:32:58.768 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-06T08:32:58.768 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:58.768 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-06-06T08:32:58.768 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:58.769 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:58.769 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-06-06 08:32:44.228241377 +0000 2024-06-06T08:32:58.769 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-06-06 08:25:17.312106629 +0000 2024-06-06T08:32:58.769 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-06-06 08:25:17.312106629 +0000 2024-06-06T08:32:58.769 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-06-06 08:25:17.312106629 +0000 2024-06-06T08:32:58.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-06T08:32:58.836 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-06-06T08:32:58.837 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-06-06T08:32:58.837 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000239979 s, 2.1 MB/s 2024-06-06T08:32:58.838 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-06T08:32:58.898 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-06-06T08:32:58.955 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-06T08:32:58.955 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:58.955 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-06-06T08:32:58.955 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:58.955 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:58.955 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-06-06 08:32:44.228241377 +0000 2024-06-06T08:32:58.955 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-06-06 08:25:17.651102312 +0000 2024-06-06T08:32:58.956 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-06-06 08:25:17.651102312 +0000 2024-06-06T08:32:58.956 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-06-06 08:25:17.651102312 +0000 2024-06-06T08:32:58.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-06T08:32:58.981 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:58 smithi059 ceph-mon[36684]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi028=x;smithi037=y;smithi059=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:32:58.981 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:58 smithi059 ceph-mon[36684]: Saving service mgr spec with placement smithi028=x;smithi037=y;smithi059=z;count:3 2024-06-06T08:32:58.981 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:58 smithi059 ceph-mon[36684]: Reconfiguring mon.c (monmap changed)... 2024-06-06T08:32:58.981 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:58 smithi059 ceph-mon[36684]: Reconfiguring daemon mon.c on smithi059 2024-06-06T08:32:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-06-06T08:32:59.022 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-06-06T08:32:59.022 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000191358 s, 2.7 MB/s 2024-06-06T08:32:59.023 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-06T08:32:59.082 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-06-06T08:32:59.082 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-06-06T08:32:59.099 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-06T08:32:59.099 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-06-06T08:32:59.155 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-06T08:32:59.155 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:59.155 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-06-06T08:32:59.155 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:59.156 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:59.156 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-06-06 08:32:34.663623150 +0000 2024-06-06T08:32:59.156 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-06-06 08:25:16.637999033 +0000 2024-06-06T08:32:59.156 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-06-06 08:25:16.637999033 +0000 2024-06-06T08:32:59.156 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-06-06 08:25:16.637999033 +0000 2024-06-06T08:32:59.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-06T08:32:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-06-06T08:32:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-06-06T08:32:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000208228 s, 2.5 MB/s 2024-06-06T08:32:59.221 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-06T08:32:59.277 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-06-06T08:32:59.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:58 smithi028 ceph-mon[31564]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi028=x;smithi037=y;smithi059=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:32:59.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:58 smithi028 ceph-mon[31564]: Saving service mgr spec with placement smithi028=x;smithi037=y;smithi059=z;count:3 2024-06-06T08:32:59.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:58 smithi028 ceph-mon[31564]: Reconfiguring mon.c (monmap changed)... 2024-06-06T08:32:59.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:58 smithi028 ceph-mon[31564]: Reconfiguring daemon mon.c on smithi059 2024-06-06T08:32:59.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:58 smithi037 ceph-mon[36609]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi028=x;smithi037=y;smithi059=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:32:59.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:58 smithi037 ceph-mon[36609]: Saving service mgr spec with placement smithi028=x;smithi037=y;smithi059=z;count:3 2024-06-06T08:32:59.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:58 smithi037 ceph-mon[36609]: Reconfiguring mon.c (monmap changed)... 2024-06-06T08:32:59.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:58 smithi037 ceph-mon[36609]: Reconfiguring daemon mon.c on smithi059 2024-06-06T08:32:59.333 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-06T08:32:59.333 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:59.333 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-06-06T08:32:59.333 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:59.333 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:59.333 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-06-06 08:32:34.664623138 +0000 2024-06-06T08:32:59.334 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-06-06 08:25:16.990994664 +0000 2024-06-06T08:32:59.334 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-06-06 08:25:16.990994664 +0000 2024-06-06T08:32:59.334 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-06-06 08:25:16.990994664 +0000 2024-06-06T08:32:59.334 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-06T08:32:59.397 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-06-06T08:32:59.397 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-06-06T08:32:59.397 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000219697 s, 2.3 MB/s 2024-06-06T08:32:59.399 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-06T08:32:59.455 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-06-06T08:32:59.510 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-06T08:32:59.510 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:59.510 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-06-06T08:32:59.510 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:59.510 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:59.510 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-06-06 08:32:34.664623138 +0000 2024-06-06T08:32:59.510 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-06-06 08:25:17.324990531 +0000 2024-06-06T08:32:59.511 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-06-06 08:25:17.324990531 +0000 2024-06-06T08:32:59.511 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-06-06 08:25:17.324990531 +0000 2024-06-06T08:32:59.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-06T08:32:59.576 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-06-06T08:32:59.576 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-06-06T08:32:59.576 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000200999 s, 2.5 MB/s 2024-06-06T08:32:59.577 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-06T08:32:59.636 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-06-06T08:32:59.691 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-06T08:32:59.692 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T08:32:59.692 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-06-06T08:32:59.692 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:32:59.692 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T08:32:59.692 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-06-06 08:32:34.665623126 +0000 2024-06-06T08:32:59.692 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-06-06 08:25:17.658986397 +0000 2024-06-06T08:32:59.692 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-06-06 08:25:17.658986397 +0000 2024-06-06T08:32:59.692 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-06-06 08:25:17.658986397 +0000 2024-06-06T08:32:59.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-06T08:32:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-06-06T08:32:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-06-06T08:32:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000190768 s, 2.7 MB/s 2024-06-06T08:32:59.757 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-06T08:32:59.814 INFO:tasks.cephadm:Deploying osd.0 on smithi028 with /dev/vg_nvme/lv_4... 2024-06-06T08:32:59.814 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-06T08:33:00.060 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:59 smithi059 ceph-mon[36684]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:00.060 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:00.060 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:00.060 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:00.061 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:00.061 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:00.061 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:00.061 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T08:33:00.061 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T08:33:00.061 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T08:33:00.061 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:32:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:00.274 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:33:00.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:59 smithi028 ceph-mon[31564]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:00.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:00.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:00.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:00.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:00.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:00.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:00.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T08:33:00.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T08:33:00.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T08:33:00.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:32:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:00.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:59 smithi037 ceph-mon[36609]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T08:33:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T08:33:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T08:33:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:32:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:01.009 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:00 smithi059 ceph-mon[36684]: Deploying daemon mgr.z on smithi059 2024-06-06T08:33:01.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:00 smithi028 ceph-mon[31564]: Deploying daemon mgr.z on smithi059 2024-06-06T08:33:01.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:00 smithi037 ceph-mon[36609]: Deploying daemon mgr.z on smithi059 2024-06-06T08:33:01.600 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:01.562+0000 7f5522ab0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T08:33:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:01 smithi028 ceph-mon[31564]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T08:33:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T08:33:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T08:33:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:02.100 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:01.754+0000 7f5522ab0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T08:33:02.100 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:01.859+0000 7f5522ab0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T08:33:02.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:01 smithi059 ceph-mon[36684]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:02.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:02.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:02.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:02.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T08:33:02.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T08:33:02.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T08:33:02.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:02.215 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:01 smithi037 ceph-mon[36609]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:02.215 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:02.215 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:02.215 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:02.215 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T08:33:02.215 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T08:33:02.215 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T08:33:02.215 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:02.541 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:02 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:02.180+0000 7f5522ab0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T08:33:02.541 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:02 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:02.268+0000 7f5522ab0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T08:33:03.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:02 smithi037 ceph-mon[36609]: Deploying daemon mgr.y on smithi037 2024-06-06T08:33:03.077 INFO:teuthology.orchestra.run.smithi028.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-06T08:33:03.077 INFO:teuthology.orchestra.run.smithi028.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-06T08:33:03.077 INFO:teuthology.orchestra.run.smithi028.stderr: stderr: 10+0 records in 2024-06-06T08:33:03.077 INFO:teuthology.orchestra.run.smithi028.stderr:10+0 records out 2024-06-06T08:33:03.077 INFO:teuthology.orchestra.run.smithi028.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0398178 s, 263 MB/s 2024-06-06T08:33:03.078 INFO:teuthology.orchestra.run.smithi028.stderr:--> Zapping successful for: 2024-06-06T08:33:03.124 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:02 smithi028 ceph-mon[31564]: Deploying daemon mgr.y on smithi037 2024-06-06T08:33:03.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:02 smithi059 ceph-mon[36684]: Deploying daemon mgr.y on smithi037 2024-06-06T08:33:03.768 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi028:vg_nvme/lv_4 2024-06-06T08:33:03.814 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:03 smithi037 podman[37979]: 2024-06-06 08:33:03.749242861 +0000 UTC m=+0.129755854 container create 1c61dd9f9c0ee6f5f40c722bc483e1528bca25ac0ffaffc268565ba31f0ef75f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, ceph=True) 2024-06-06T08:33:03.849 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:03.527+0000 7f5522ab0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T08:33:03.850 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:03.700+0000 7f5522ab0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T08:33:04.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:03 smithi028 ceph-mon[31564]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:04.119 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:03 smithi037 ceph-mon[36609]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:04.120 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:03 smithi037 podman[37979]: 2024-06-06 08:33:03.951622842 +0000 UTC m=+0.332135845 container init 1c61dd9f9c0ee6f5f40c722bc483e1528bca25ac0ffaffc268565ba31f0ef75f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:33:04.120 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:03 smithi037 podman[37979]: 2024-06-06 08:33:03.954321837 +0000 UTC m=+0.334834837 container start 1c61dd9f9c0ee6f5f40c722bc483e1528bca25ac0ffaffc268565ba31f0ef75f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-06-06T08:33:04.120 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:03 smithi037 ceph-mgr[37998]: -- 172.21.15.37:0/4158083547 <== mon.2 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5592665745a0 con 0x559266549000 2024-06-06T08:33:04.120 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:04 smithi037 bash[37979]: 1c61dd9f9c0ee6f5f40c722bc483e1528bca25ac0ffaffc268565ba31f0ef75f 2024-06-06T08:33:04.120 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:04 smithi037 systemd[1]: Started Ceph mgr.y for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:33:04.120 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:04 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:04.120+0000 7f9cd5f03200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T08:33:04.173 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:03 smithi059 ceph-mon[36684]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:04.173 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:03.875+0000 7f5522ab0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T08:33:04.173 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:04.174+0000 7f5522ab0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T08:33:04.230 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:33:04.420 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:04 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:04.314+0000 7f9cd5f03200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T08:33:04.421 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:04 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:04.421+0000 7f9cd5f03200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T08:33:04.479 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:04.268+0000 7f5522ab0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T08:33:04.479 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:04.479+0000 7f5522ab0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T08:33:04.850 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:04.683+0000 7f5522ab0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T08:33:05.063 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:04 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:04.754+0000 7f9cd5f03200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T08:33:05.064 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:04 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:04.844+0000 7f9cd5f03200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T08:33:05.347 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:05 smithi037 ceph-mon[36609]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:05.347 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.347 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.347 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.347 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.347 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:05.349 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:05.334+0000 7f5522ab0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T08:33:05.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:05 smithi059 ceph-mon[36684]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:05.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:05.386 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:05 smithi028 ceph-mon[31564]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:05.386 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.386 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.386 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.386 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:05.387 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:06.089 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:05.782+0000 7f5522ab0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T08:33:06.089 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:05.882+0000 7f5522ab0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T08:33:06.089 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:06.089+0000 7f5522ab0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T08:33:06.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.307+0000 7f03bf200700 1 -- 172.21.15.28:0/1871793167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b8103720 msgr2=0x7f03b8103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:33:06.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.307+0000 7f03bf200700 1 --2- 172.21.15.28:0/1871793167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b8103720 0x7f03b8103b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03a40099c0 tx=0x7f03a4009cd0 comp rx=0 tx=0).stop 2024-06-06T08:33:06.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.307+0000 7f03bf200700 1 -- 172.21.15.28:0/1871793167 shutdown_connections 2024-06-06T08:33:06.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.307+0000 7f03bf200700 1 --2- 172.21.15.28:0/1871793167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b81040c0 0x7f03b810a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:06.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.307+0000 7f03bf200700 1 --2- 172.21.15.28:0/1871793167 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03b8102520 0x7f03b8102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:06.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.307+0000 7f03bf200700 1 --2- 172.21.15.28:0/1871793167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b8103720 0x7f03b8103b80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:06.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.307+0000 7f03bf200700 1 -- 172.21.15.28:0/1871793167 >> 172.21.15.28:0/1871793167 conn(0x7f03b80fdae0 msgr2=0x7f03b80fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:33:06.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.307+0000 7f03bf200700 1 -- 172.21.15.28:0/1871793167 shutdown_connections 2024-06-06T08:33:06.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.308+0000 7f03bf200700 1 -- 172.21.15.28:0/1871793167 wait complete. 2024-06-06T08:33:06.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.309+0000 7f03bf200700 1 Processor -- start 2024-06-06T08:33:06.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.309+0000 7f03bf200700 1 -- start start 2024-06-06T08:33:06.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.310+0000 7f03bf200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b8102520 0x7f03b81986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:33:06.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.310+0000 7f03bf200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03b8103720 0x7f03b8198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:33:06.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.310+0000 7f03bf200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b81040c0 0x7f03b819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:33:06.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.310+0000 7f03bf200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f03b810e130 con 0x7f03b8103720 2024-06-06T08:33:06.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.310+0000 7f03bf200700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03b810dfb0 con 0x7f03b81040c0 2024-06-06T08:33:06.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.310+0000 7f03bf200700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f03b810e2b0 con 0x7f03b8102520 2024-06-06T08:33:06.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.310+0000 7f03b7e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b8102520 0x7f03b81986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:33:06.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.310+0000 7f03b7400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03b8103720 0x7f03b8198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:33:06.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.310+0000 7f03b7e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b8102520 0x7f03b81986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:59158/0 (socket says 172.21.15.28:59158) 2024-06-06T08:33:06.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.310+0000 7f03b7e00700 1 -- 172.21.15.28:0/1073451282 learned_addr learned my addr 172.21.15.28:0/1073451282 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:33:06.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.310+0000 7f03bd200700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b81040c0 0x7f03b819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:33:06.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03b7e00700 1 -- 172.21.15.28:0/1073451282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b81040c0 msgr2=0x7f03b819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:33:06.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03b7e00700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b81040c0 0x7f03b819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:06.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03b7e00700 1 -- 172.21.15.28:0/1073451282 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03b8103720 msgr2=0x7f03b8198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:33:06.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03b7e00700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03b8103720 0x7f03b8198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:06.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03b7e00700 1 -- 172.21.15.28:0/1073451282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b81a0310 con 0x7f03b8102520 2024-06-06T08:33:06.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03bd200700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b81040c0 0x7f03b819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:33:06.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03b7400700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03b8103720 0x7f03b8198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:33:06.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03b7e00700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b8102520 0x7f03b81986b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03a800e9a0 tx=0x7f03a800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:33:06.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03b4c00700 1 -- 172.21.15.28:0/1073451282 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8004220 con 0x7f03b8102520 2024-06-06T08:33:06.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03b4c00700 1 -- 172.21.15.28:0/1073451282 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03a80043c0 con 0x7f03b8102520 2024-06-06T08:33:06.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03b4c00700 1 -- 172.21.15.28:0/1073451282 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8003df0 con 0x7f03b8102520 2024-06-06T08:33:06.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03bf200700 1 -- 172.21.15.28:0/1073451282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b81a0600 con 0x7f03b8102520 2024-06-06T08:33:06.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.311+0000 7f03bf200700 1 -- 172.21.15.28:0/1073451282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b81a0b90 con 0x7f03b8102520 2024-06-06T08:33:06.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.312+0000 7f03b4c00700 1 -- 172.21.15.28:0/1073451282 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f03a8018430 con 0x7f03b8102520 2024-06-06T08:33:06.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.313+0000 7f03bf200700 1 -- 172.21.15.28:0/1073451282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b8069180 con 0x7f03b8102520 2024-06-06T08:33:06.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.313+0000 7f03b4c00700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f039c039330 0x7f039c03b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:33:06.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.313+0000 7f03b4c00700 1 -- 172.21.15.28:0/1073451282 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f03a804c5b0 con 0x7f03b8102520 2024-06-06T08:33:06.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.313+0000 7f03b7400700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f039c039330 0x7f039c03b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:33:06.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.314+0000 7f03b7400700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f039c039330 0x7f039c03b7f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f03a4000c00 tx=0x7f03a4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:33:06.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.318+0000 7f03b4c00700 1 -- 172.21.15.28:0/1073451282 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f03a800ce10 con 0x7f03b8102520 2024-06-06T08:33:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T08:33:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T08:33:06.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:06.499 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.500 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.500 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.500 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.500 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.500 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:06.500 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:06.500 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.500 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T08:33:06.500 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T08:33:06.500 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:06.501 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:06.148+0000 7f9cd5f03200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T08:33:06.501 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:06.324+0000 7f9cd5f03200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T08:33:06.501 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:06.500+0000 7f9cd5f03200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T08:33:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:06.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:06.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:06.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T08:33:06.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T08:33:06.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:06.558+0000 7f03bf200700 1 -- 172.21.15.28:0/1073451282 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f03b80628d0 con 0x7f039c039330 2024-06-06T08:33:06.974 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:06.631+0000 7f5522ab0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T08:33:06.974 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:06.724+0000 7f5522ab0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T08:33:07.063 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:06.799+0000 7f9cd5f03200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T08:33:07.063 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:06 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:06.895+0000 7f9cd5f03200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T08:33:07.327 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:07 smithi059 ceph-mon[36684]: Reconfiguring mgr.x (unknown last config time)... 2024-06-06T08:33:07.327 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:07 smithi059 ceph-mon[36684]: Reconfiguring daemon mgr.x on smithi028 2024-06-06T08:33:07.327 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:07 smithi059 ceph-mon[36684]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:07.327 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:07 smithi059 ceph-mon[36684]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:33:07.327 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:07 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:33:07.327 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:07 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:33:07.327 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:07 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:07.328 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:06.974+0000 7f5522ab0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T08:33:07.328 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:07 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:07.111+0000 7f5522ab0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T08:33:07.328 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:07 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:07.209+0000 7f5522ab0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T08:33:07.328 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:07 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:07.327+0000 7f5522ab0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T08:33:07.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:07 smithi028 ceph-mon[31564]: Reconfiguring mgr.x (unknown last config time)... 2024-06-06T08:33:07.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:07 smithi028 ceph-mon[31564]: Reconfiguring daemon mgr.x on smithi028 2024-06-06T08:33:07.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:07 smithi028 ceph-mon[31564]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:07.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:07 smithi028 ceph-mon[31564]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:33:07.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:07 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:33:07.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:07 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:33:07.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:07 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:07.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:07 smithi037 ceph-mon[36609]: Reconfiguring mgr.x (unknown last config time)... 2024-06-06T08:33:07.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:07 smithi037 ceph-mon[36609]: Reconfiguring daemon mgr.x on smithi028 2024-06-06T08:33:07.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:07 smithi037 ceph-mon[36609]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:07.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:07 smithi037 ceph-mon[36609]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:33:07.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:07 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:33:07.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:07 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:33:07.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:07 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:07.564 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:07 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:07.106+0000 7f9cd5f03200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T08:33:07.564 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:07 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:07.305+0000 7f9cd5f03200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T08:33:08.099 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:07 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:07.635+0000 7f5522ab0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T08:33:08.313 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:07 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:07.936+0000 7f9cd5f03200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T08:33:08.600 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:08 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:08.259+0000 7f5522ab0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T08:33:08.600 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:33:08 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z[38541]: 2024-06-06T08:33:08.480+0000 7f5522ab0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T08:33:08.681 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:08 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:08.374+0000 7f9cd5f03200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T08:33:08.682 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:08 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:08.475+0000 7f9cd5f03200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T08:33:08.682 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:08 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:08.682+0000 7f9cd5f03200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T08:33:09.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:09.201+0000 7f03b4c00700 1 -- 172.21.15.28:0/1073451282 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f03a801dd20 con 0x7f03b8102520 2024-06-06T08:33:09.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:09.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:09.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:09.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:09.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:09.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:09.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:09.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-06T08:33:09.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T08:33:09.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: Standby manager daemon z started 2024-06-06T08:33:09.266 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-06T08:33:09.267 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:09 smithi028 ceph-mon[31564]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T08:33:09.563 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:09.229+0000 7f9cd5f03200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T08:33:09.564 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:09.324+0000 7f9cd5f03200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T08:33:09.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:09.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:09.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:09.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:09.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:09.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:09.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:09.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-06T08:33:09.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T08:33:09.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: Standby manager daemon z started 2024-06-06T08:33:09.565 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-06T08:33:09.565 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-mon[36609]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T08:33:09.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:09.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:09.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:09.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:09.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:09.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:09.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:09.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-06T08:33:09.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T08:33:09.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: Standby manager daemon z started 2024-06-06T08:33:09.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-06T08:33:09.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:09 smithi059 ceph-mon[36684]: from='mgr.? 172.21.15.59:0/1447298065' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T08:33:09.931 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:09.575+0000 7f9cd5f03200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T08:33:09.931 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:09.714+0000 7f9cd5f03200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T08:33:09.931 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:09.812+0000 7f9cd5f03200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T08:33:09.931 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:09 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:09.931+0000 7f9cd5f03200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T08:33:10.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:10 smithi028 ceph-mon[31564]: mgrmap e14: x(active, since 89s), standbys: z 2024-06-06T08:33:10.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-06T08:33:10.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:10 smithi037 ceph-mon[36609]: mgrmap e14: x(active, since 89s), standbys: z 2024-06-06T08:33:10.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:10 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-06T08:33:10.563 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:10 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:10.242+0000 7f9cd5f03200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T08:33:10.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:10 smithi059 ceph-mon[36684]: mgrmap e14: x(active, since 89s), standbys: z 2024-06-06T08:33:10.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:10 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-06T08:33:11.206 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:10 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:10.870+0000 7f9cd5f03200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T08:33:11.206 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y[37994]: 2024-06-06T08:33:11.094+0000 7f9cd5f03200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T08:33:11.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:11 smithi028 ceph-mon[31564]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:11.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:11 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1896984555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7edaffea-7613-4d20-b9b8-108a17af8f00"}]: dispatch 2024-06-06T08:33:11.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:11 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7edaffea-7613-4d20-b9b8-108a17af8f00"}]: dispatch 2024-06-06T08:33:11.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:11 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7edaffea-7613-4d20-b9b8-108a17af8f00"}]': finished 2024-06-06T08:33:11.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:11 smithi028 ceph-mon[31564]: osdmap e5: 1 total, 0 up, 1 in 2024-06-06T08:33:11.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:11 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:11.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:11 smithi028 ceph-mon[31564]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-06T08:33:11.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:11 smithi028 ceph-mon[31564]: Standby manager daemon y started 2024-06-06T08:33:11.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:11 smithi028 ceph-mon[31564]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T08:33:11.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:11 smithi028 ceph-mon[31564]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-06T08:33:11.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:11 smithi028 ceph-mon[31564]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T08:33:11.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-mon[36609]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1896984555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7edaffea-7613-4d20-b9b8-108a17af8f00"}]: dispatch 2024-06-06T08:33:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7edaffea-7613-4d20-b9b8-108a17af8f00"}]: dispatch 2024-06-06T08:33:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7edaffea-7613-4d20-b9b8-108a17af8f00"}]': finished 2024-06-06T08:33:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-mon[36609]: osdmap e5: 1 total, 0 up, 1 in 2024-06-06T08:33:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-mon[36609]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-06T08:33:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-mon[36609]: Standby manager daemon y started 2024-06-06T08:33:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-mon[36609]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T08:33:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-mon[36609]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-06T08:33:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:11 smithi037 ceph-mon[36609]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T08:33:11.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:11 smithi059 ceph-mon[36684]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:11.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:11 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1896984555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7edaffea-7613-4d20-b9b8-108a17af8f00"}]: dispatch 2024-06-06T08:33:11.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:11 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7edaffea-7613-4d20-b9b8-108a17af8f00"}]: dispatch 2024-06-06T08:33:11.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:11 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7edaffea-7613-4d20-b9b8-108a17af8f00"}]': finished 2024-06-06T08:33:11.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:11 smithi059 ceph-mon[36684]: osdmap e5: 1 total, 0 up, 1 in 2024-06-06T08:33:11.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:11 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:11.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:11 smithi059 ceph-mon[36684]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-06T08:33:11.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:11 smithi059 ceph-mon[36684]: Standby manager daemon y started 2024-06-06T08:33:11.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:11 smithi059 ceph-mon[36684]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T08:33:11.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:11 smithi059 ceph-mon[36684]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-06T08:33:11.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:11 smithi059 ceph-mon[36684]: from='mgr.? 172.21.15.37:0/2480593654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T08:33:12.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:12.109+0000 7f03b4c00700 1 -- 172.21.15.28:0/1073451282 <== mon.1 v2:172.21.15.59:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f03a8017cd0 con 0x7f03b8102520 2024-06-06T08:33:12.474 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:12 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1973013894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:33:12.474 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:12 smithi028 ceph-mon[31564]: mgrmap e15: x(active, since 92s), standbys: z, y 2024-06-06T08:33:12.474 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:12 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-06T08:33:12.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:12 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1973013894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:33:12.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:12 smithi037 ceph-mon[36609]: mgrmap e15: x(active, since 92s), standbys: z, y 2024-06-06T08:33:12.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:12 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-06T08:33:12.586 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:12 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1973013894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:33:12.586 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:12 smithi059 ceph-mon[36684]: mgrmap e15: x(active, since 92s), standbys: z, y 2024-06-06T08:33:12.587 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:12 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-06T08:33:13.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:13 smithi028 ceph-mon[31564]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:13.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:13 smithi037 ceph-mon[36609]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:13.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:13 smithi059 ceph-mon[36684]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:15.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:15 smithi028 ceph-mon[31564]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:15.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:15 smithi037 ceph-mon[36609]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:15.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:15 smithi059 ceph-mon[36684]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:17.492 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:17 smithi028 ceph-mon[31564]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:17.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:17 smithi037 ceph-mon[36609]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:17.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:17 smithi059 ceph-mon[36684]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:19.526 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:19 smithi028 ceph-mon[31564]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:19.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:19 smithi037 ceph-mon[36609]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:19.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:19 smithi059 ceph-mon[36684]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:21.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:21 smithi028 ceph-mon[31564]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:21.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-06T08:33:21.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:21.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:21 smithi028 ceph-mon[31564]: Deploying daemon osd.0 on smithi028 2024-06-06T08:33:21.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:21 smithi037 ceph-mon[36609]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:21.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-06T08:33:21.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:21.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:21 smithi037 ceph-mon[36609]: Deploying daemon osd.0 on smithi028 2024-06-06T08:33:21.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:21 smithi059 ceph-mon[36684]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:21.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-06T08:33:21.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:21.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:21 smithi059 ceph-mon[36684]: Deploying daemon osd.0 on smithi028 2024-06-06T08:33:23.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:23 smithi028 ceph-mon[31564]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:23.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:23 smithi037 ceph-mon[36609]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:23.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:23 smithi059 ceph-mon[36684]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:25.471 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:25 smithi028 ceph-mon[31564]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:25.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:25 smithi037 ceph-mon[36609]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:25.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:25 smithi059 ceph-mon[36684]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:27.503 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:27 smithi028 ceph-mon[31564]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:27 smithi037 ceph-mon[36609]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:27.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:27 smithi059 ceph-mon[36684]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:30.005 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:29 smithi028 ceph-mon[31564]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:30.005 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:29 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:30.006 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:29 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:30.006 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:29 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:30.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:29 smithi037 ceph-mon[36609]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:30.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:29 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:30.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:29 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:30.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:29 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:29 smithi059 ceph-mon[36684]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:29 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:29 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:29 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:31 smithi028 ceph-mon[31564]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:32.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:31 smithi037 ceph-mon[36609]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:32.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:31 smithi059 ceph-mon[36684]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:33.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.150+0000 7f03b4c00700 1 -- 172.21.15.28:0/1073451282 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f03b80628d0 con 0x7f039c039330 2024-06-06T08:33:33.150 INFO:teuthology.orchestra.run.smithi028.stdout:Created osd(s) 0 on host 'smithi028' 2024-06-06T08:33:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.154+0000 7f03bf200700 1 -- 172.21.15.28:0/1073451282 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f039c039330 msgr2=0x7f039c03b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:33:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.154+0000 7f03bf200700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f039c039330 0x7f039c03b7f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f03a4000c00 tx=0x7f03a4005fb0 comp rx=0 tx=0).stop 2024-06-06T08:33:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.154+0000 7f03bf200700 1 -- 172.21.15.28:0/1073451282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b8102520 msgr2=0x7f03b81986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:33:33.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.154+0000 7f03bf200700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b8102520 0x7f03b81986b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03a800e9a0 tx=0x7f03a800ecb0 comp rx=0 tx=0).stop 2024-06-06T08:33:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.155+0000 7f03bf200700 1 -- 172.21.15.28:0/1073451282 shutdown_connections 2024-06-06T08:33:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.155+0000 7f03bf200700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f039c039330 0x7f039c03b7f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:33.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.155+0000 7f03bf200700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b81040c0 0x7f03b819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:33.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.155+0000 7f03bf200700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b8102520 0x7f03b81986b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:33.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.155+0000 7f03bf200700 1 --2- 172.21.15.28:0/1073451282 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03b8103720 0x7f03b8198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:33.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.155+0000 7f03bf200700 1 -- 172.21.15.28:0/1073451282 >> 172.21.15.28:0/1073451282 conn(0x7f03b80fdae0 msgr2=0x7f03b81069c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:33:33.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.155+0000 7f03bf200700 1 -- 172.21.15.28:0/1073451282 shutdown_connections 2024-06-06T08:33:33.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:33:33.155+0000 7f03bf200700 1 -- 172.21.15.28:0/1073451282 wait complete. 2024-06-06T08:33:33.268 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:33 smithi028 ceph-mon[31564]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:33.268 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:33 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.268 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:33 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.268 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:33 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:33.268 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:33 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:33.269 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:33 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.269 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:33 smithi028 ceph-mon[31564]: from='osd.0 [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T08:33:33.269 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:33 smithi028 ceph-mon[31564]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T08:33:33.269 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:33 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:33.269 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:33 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:33 smithi037 ceph-mon[36609]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:33.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:33 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:33 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:33 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:33.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:33 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:33.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:33 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:33 smithi037 ceph-mon[36609]: from='osd.0 [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T08:33:33.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:33 smithi037 ceph-mon[36609]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T08:33:33.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:33 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:33.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:33 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:33 smithi059 ceph-mon[36684]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:33.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:33 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:33 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:33 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:33.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:33 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:33.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:33 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:33 smithi059 ceph-mon[36684]: from='osd.0 [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T08:33:33.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:33 smithi059 ceph-mon[36684]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T08:33:33.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:33 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:33.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:33 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:33.950 DEBUG:teuthology.orchestra.run.smithi028:osd.0> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.0.service 2024-06-06T08:33:33.955 INFO:tasks.cephadm:Deploying osd.1 on smithi037 with /dev/vg_nvme/lv_4... 2024-06-06T08:33:33.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-06T08:33:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:33:34.404 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:34.405 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:34 smithi028 ceph-mon[31564]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-06T08:33:34.405 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:34 smithi028 ceph-mon[31564]: from='osd.0 [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:33:34.405 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:34 smithi028 ceph-mon[31564]: osdmap e6: 1 total, 0 up, 1 in 2024-06-06T08:33:34.405 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:34.405 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:34 smithi028 ceph-mon[31564]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:33:34.434 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:34.434 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:34 smithi037 ceph-mon[36609]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-06T08:33:34.434 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:34 smithi037 ceph-mon[36609]: from='osd.0 [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:33:34.434 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:34 smithi037 ceph-mon[36609]: osdmap e6: 1 total, 0 up, 1 in 2024-06-06T08:33:34.434 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:34.435 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:34 smithi037 ceph-mon[36609]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:33:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:34 smithi059 ceph-mon[36684]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-06T08:33:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:34 smithi059 ceph-mon[36684]: from='osd.0 [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:33:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:34 smithi059 ceph-mon[36684]: osdmap e6: 1 total, 0 up, 1 in 2024-06-06T08:33:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:34 smithi059 ceph-mon[36684]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:33:35.042 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:33:34 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0[46018]: 2024-06-06T08:33:34.776+0000 7f2796600700 -1 osd.0 0 waiting for initial osdmap 2024-06-06T08:33:35.042 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:33:34 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0[46018]: 2024-06-06T08:33:34.785+0000 7f2791400700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T08:33:35.842 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:35 smithi028 ceph-mon[31564]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:35.842 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:35 smithi028 ceph-mon[31564]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:33:35.842 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:35 smithi028 ceph-mon[31564]: osdmap e7: 1 total, 0 up, 1 in 2024-06-06T08:33:35.843 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:35 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:35.843 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:35 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-06T08:33:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-06T08:33:35.991 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2024-06-06T08:33:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2024-06-06T08:33:35.991 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112061 s, 936 MB/s 2024-06-06T08:33:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2024-06-06T08:33:36.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:35 smithi037 ceph-mon[36609]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:36.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:35 smithi037 ceph-mon[36609]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:33:36.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:35 smithi037 ceph-mon[36609]: osdmap e7: 1 total, 0 up, 1 in 2024-06-06T08:33:36.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:35 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:36.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:35 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:36.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:35 smithi059 ceph-mon[36684]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:36.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:35 smithi059 ceph-mon[36684]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:33:36.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:35 smithi059 ceph-mon[36684]: osdmap e7: 1 total, 0 up, 1 in 2024-06-06T08:33:36.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:36.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:36.575 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_4 2024-06-06T08:33:36.816 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:33:36.924 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:36 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:33:36.924 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:36 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:33:36.924 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:36 smithi037 ceph-mon[36609]: osd.0 [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636] boot 2024-06-06T08:33:36.925 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:36 smithi037 ceph-mon[36609]: osdmap e8: 1 total, 1 up, 1 in 2024-06-06T08:33:36.925 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:36 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:37.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:36 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:33:37.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:36 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:33:37.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:36 smithi028 ceph-mon[31564]: osd.0 [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636] boot 2024-06-06T08:33:37.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:36 smithi028 ceph-mon[31564]: osdmap e8: 1 total, 1 up, 1 in 2024-06-06T08:33:37.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:36 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:37.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:36 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:33:37.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:36 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:33:37.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:36 smithi059 ceph-mon[36684]: osd.0 [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636] boot 2024-06-06T08:33:37.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:36 smithi059 ceph-mon[36684]: osdmap e8: 1 total, 1 up, 1 in 2024-06-06T08:33:37.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:36 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T08:33:38.008 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:37 smithi037 ceph-mon[36609]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:38.008 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:37 smithi037 ceph-mon[36609]: osdmap e9: 1 total, 1 up, 1 in 2024-06-06T08:33:38.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:37 smithi028 ceph-mon[31564]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:38.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:37 smithi028 ceph-mon[31564]: osdmap e9: 1 total, 1 up, 1 in 2024-06-06T08:33:38.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:37 smithi059 ceph-mon[36684]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T08:33:38.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:37 smithi059 ceph-mon[36684]: osdmap e9: 1 total, 1 up, 1 in 2024-06-06T08:33:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.215+0000 7f22488a5700 1 -- 172.21.15.37:0/3733189359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22441081e0 msgr2=0x7f224410a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:33:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.215+0000 7f22488a5700 1 --2- 172.21.15.37:0/3733189359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22441081e0 0x7f224410a650 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f223c00b0a0 tx=0x7f223c00b3b0 comp rx=0 tx=0).stop 2024-06-06T08:33:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.215+0000 7f22488a5700 1 -- 172.21.15.37:0/3733189359 shutdown_connections 2024-06-06T08:33:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.215+0000 7f22488a5700 1 --2- 172.21.15.37:0/3733189359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22441081e0 0x7f224410a650 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.215+0000 7f22488a5700 1 --2- 172.21.15.37:0/3733189359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2244102f80 0x7f2244105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.215+0000 7f22488a5700 1 --2- 172.21.15.37:0/3733189359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22441058b0 0x7f2244107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.215+0000 7f22488a5700 1 -- 172.21.15.37:0/3733189359 >> 172.21.15.37:0/3733189359 conn(0x7f22440fc990 msgr2=0x7f22440fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.215+0000 7f22488a5700 1 -- 172.21.15.37:0/3733189359 shutdown_connections 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.215+0000 7f22488a5700 1 -- 172.21.15.37:0/3733189359 wait complete. 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.216+0000 7f22488a5700 1 Processor -- start 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.216+0000 7f22488a5700 1 -- start start 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.216+0000 7f22488a5700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2244102f80 0x7f22441986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.216+0000 7f22488a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22441058b0 0x7f2244198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.216+0000 7f22488a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22441081e0 0x7f224419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.216+0000 7f22488a5700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f224410e120 con 0x7f2244102f80 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.216+0000 7f22488a5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f224410dfa0 con 0x7f22441081e0 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.216+0000 7f22488a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f224410e2a0 con 0x7f22441058b0 2024-06-06T08:33:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.216+0000 7f2242d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22441081e0 0x7f224419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.216+0000 7f2242d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22441081e0 0x7f224419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45944/0 (socket says 172.21.15.37:45944) 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.216+0000 7f2242d9d700 1 -- 172.21.15.37:0/3341633237 learned_addr learned my addr 172.21.15.37:0/3341633237 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f2241d9b700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22441058b0 0x7f2244198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f2242d9d700 1 -- 172.21.15.37:0/3341633237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22441058b0 msgr2=0x7f2244198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f2242d9d700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22441058b0 0x7f2244198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f2242d9d700 1 -- 172.21.15.37:0/3341633237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2244102f80 msgr2=0x7f22441986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f2242d9d700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2244102f80 0x7f22441986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f2242d9d700 1 -- 172.21.15.37:0/3341633237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22441a0340 con 0x7f22441081e0 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f2242d9d700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22441081e0 0x7f224419fca0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f223c007fa0 tx=0x7f223c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f22337fe700 1 -- 172.21.15.37:0/3341633237 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c021030 con 0x7f22441081e0 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f22337fe700 1 -- 172.21.15.37:0/3341633237 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f223c007bb0 con 0x7f22441081e0 2024-06-06T08:33:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f22488a5700 1 -- 172.21.15.37:0/3341633237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22441a05d0 con 0x7f22441081e0 2024-06-06T08:33:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f22337fe700 1 -- 172.21.15.37:0/3341633237 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c01d470 con 0x7f22441081e0 2024-06-06T08:33:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.217+0000 7f22488a5700 1 -- 172.21.15.37:0/3341633237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22441a0a80 con 0x7f22441081e0 2024-06-06T08:33:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.218+0000 7f22488a5700 1 -- 172.21.15.37:0/3341633237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2244069180 con 0x7f22441081e0 2024-06-06T08:33:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.219+0000 7f22337fe700 1 -- 172.21.15.37:0/3341633237 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f223c024070 con 0x7f22441081e0 2024-06-06T08:33:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.220+0000 7f22337fe700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f222c0a2c10 0x7f222c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:33:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.220+0000 7f22337fe700 1 -- 172.21.15.37:0/3341633237 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f223c00f020 con 0x7f22441081e0 2024-06-06T08:33:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.220+0000 7f224259c700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f222c0a2c10 0x7f222c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:33:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.221+0000 7f224259c700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f222c0a2c10 0x7f222c0a50d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22340097b0 tx=0x7f2234006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:33:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.225+0000 7f22337fe700 1 -- 172.21.15.37:0/3341633237 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f223c09ce40 con 0x7f22441081e0 2024-06-06T08:33:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:38.441+0000 7f22488a5700 1 -- 172.21.15.37:0/3341633237 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f22440628d0 con 0x7f222c0a2c10 2024-06-06T08:33:39.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:38 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:33:39.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:38 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:33:39.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:38 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:39.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:38 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:33:39.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:38 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:33:39.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:38 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:39.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:38 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:33:39.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:38 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:33:39.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:38 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:39 smithi028 ceph-mon[31564]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:39 smithi028 ceph-mon[31564]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:33:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:39 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi028 2024-06-06T08:33:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:33:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:39 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi028 to 17094M 2024-06-06T08:33:40.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:40.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:40.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:40.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:40.047 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:39 smithi037 ceph-mon[36609]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:40.047 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:39 smithi037 ceph-mon[36609]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:33:40.047 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:39 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi028 2024-06-06T08:33:40.047 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:40.047 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:40.048 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:33:40.048 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:39 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi028 to 17094M 2024-06-06T08:33:40.048 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:40.048 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:40.048 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:40.048 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:39 smithi059 ceph-mon[36684]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:39 smithi059 ceph-mon[36684]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:33:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:39 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi028 2024-06-06T08:33:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:33:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:39 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi028 to 17094M 2024-06-06T08:33:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:42.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:41 smithi028 ceph-mon[31564]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:42.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:41 smithi028 ceph-mon[31564]: from='client.? 172.21.15.37:0/727804678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17eb7536-c2a4-4f8b-bec4-b1abb5125836"}]: dispatch 2024-06-06T08:33:42.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:41 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17eb7536-c2a4-4f8b-bec4-b1abb5125836"}]: dispatch 2024-06-06T08:33:42.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:41 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17eb7536-c2a4-4f8b-bec4-b1abb5125836"}]': finished 2024-06-06T08:33:42.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:41 smithi028 ceph-mon[31564]: osdmap e10: 2 total, 1 up, 2 in 2024-06-06T08:33:42.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:33:42.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:41 smithi037 ceph-mon[36609]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:42.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:41 smithi037 ceph-mon[36609]: from='client.? 172.21.15.37:0/727804678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17eb7536-c2a4-4f8b-bec4-b1abb5125836"}]: dispatch 2024-06-06T08:33:42.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:41 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17eb7536-c2a4-4f8b-bec4-b1abb5125836"}]: dispatch 2024-06-06T08:33:42.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:41 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17eb7536-c2a4-4f8b-bec4-b1abb5125836"}]': finished 2024-06-06T08:33:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:41 smithi037 ceph-mon[36609]: osdmap e10: 2 total, 1 up, 2 in 2024-06-06T08:33:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:33:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:41 smithi059 ceph-mon[36684]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:41 smithi059 ceph-mon[36684]: from='client.? 172.21.15.37:0/727804678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17eb7536-c2a4-4f8b-bec4-b1abb5125836"}]: dispatch 2024-06-06T08:33:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:41 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17eb7536-c2a4-4f8b-bec4-b1abb5125836"}]: dispatch 2024-06-06T08:33:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:41 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17eb7536-c2a4-4f8b-bec4-b1abb5125836"}]': finished 2024-06-06T08:33:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:41 smithi059 ceph-mon[36684]: osdmap e10: 2 total, 1 up, 2 in 2024-06-06T08:33:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:33:43.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:42 smithi028 ceph-mon[31564]: from='client.? 172.21.15.37:0/2697548671' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:33:43.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:42 smithi037 ceph-mon[36609]: from='client.? 172.21.15.37:0/2697548671' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:33:43.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:42 smithi059 ceph-mon[36684]: from='client.? 172.21.15.37:0/2697548671' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:33:44.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:43 smithi028 ceph-mon[31564]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:44.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:43 smithi037 ceph-mon[36609]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:44.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:43 smithi059 ceph-mon[36684]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:46.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:45 smithi037 ceph-mon[36609]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:46.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:45 smithi059 ceph-mon[36684]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:46.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:45 smithi028 ceph-mon[31564]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:48.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:47 smithi037 ceph-mon[36609]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:48.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:47 smithi059 ceph-mon[36684]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:48.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:47 smithi028 ceph-mon[31564]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:49.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:48 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-06T08:33:49.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:48 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:49.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:48 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-06T08:33:49.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:48 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:49.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:48 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-06T08:33:49.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:48 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:50.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:49 smithi037 ceph-mon[36609]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:50.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:49 smithi037 ceph-mon[36609]: Deploying daemon osd.1 on smithi037 2024-06-06T08:33:50.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:49 smithi059 ceph-mon[36684]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:49 smithi059 ceph-mon[36684]: Deploying daemon osd.1 on smithi037 2024-06-06T08:33:50.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:49 smithi028 ceph-mon[31564]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:50.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:49 smithi028 ceph-mon[31564]: Deploying daemon osd.1 on smithi037 2024-06-06T08:33:52.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:51 smithi059 ceph-mon[36684]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:52.111 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:51 smithi037 ceph-mon[36609]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:52.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:51 smithi028 ceph-mon[31564]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:54.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:53 smithi028 ceph-mon[31564]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:54.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:53 smithi037 ceph-mon[36609]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:54.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:53 smithi059 ceph-mon[36684]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:55.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:55 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:55.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:55 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:55.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:55 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:55.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:55 smithi037 ceph-mon[36609]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:55.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:55 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:55.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:55 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:55.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:55 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:55.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:55 smithi059 ceph-mon[36684]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:55.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:55 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:55.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:55 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:55.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:55 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:55.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:55 smithi028 ceph-mon[31564]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.623+0000 7f22337fe700 1 -- 172.21.15.37:0/3341633237 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f22440628d0 con 0x7f222c0a2c10 2024-06-06T08:33:57.622 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 1 on host 'smithi037' 2024-06-06T08:33:57.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 -- 172.21.15.37:0/3341633237 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f222c0a2c10 msgr2=0x7f222c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:33:57.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f222c0a2c10 0x7f222c0a50d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22340097b0 tx=0x7f2234006d20 comp rx=0 tx=0).stop 2024-06-06T08:33:57.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 -- 172.21.15.37:0/3341633237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22441081e0 msgr2=0x7f224419fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:33:57.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22441081e0 0x7f224419fca0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f223c007fa0 tx=0x7f223c00bf10 comp rx=0 tx=0).stop 2024-06-06T08:33:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 -- 172.21.15.37:0/3341633237 shutdown_connections 2024-06-06T08:33:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f222c0a2c10 0x7f222c0a50d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22441081e0 0x7f224419fca0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2244102f80 0x7f22441986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 --2- 172.21.15.37:0/3341633237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22441058b0 0x7f2244198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:33:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 -- 172.21.15.37:0/3341633237 >> 172.21.15.37:0/3341633237 conn(0x7f22440fc990 msgr2=0x7f2244103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:33:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 -- 172.21.15.37:0/3341633237 shutdown_connections 2024-06-06T08:33:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:33:57.625+0000 7f22488a5700 1 -- 172.21.15.37:0/3341633237 wait complete. 2024-06-06T08:33:57.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:57 smithi037 ceph-mon[36609]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:57.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:57 smithi028 ceph-mon[31564]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:58.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:58.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:58.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:58.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:58.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:58.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:57 smithi059 ceph-mon[36684]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:33:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:33:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:33:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:33:58.312 DEBUG:teuthology.orchestra.run.smithi037:osd.1> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.1.service 2024-06-06T08:33:58.315 INFO:tasks.cephadm:Deploying osd.2 on smithi059 with /dev/vg_nvme/lv_4... 2024-06-06T08:33:58.315 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-06T08:33:58.566 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:33:58.928 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:58 smithi059 ceph-mon[36684]: from='osd.1 [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T08:33:58.928 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:58 smithi059 ceph-mon[36684]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T08:33:59.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:58 smithi028 ceph-mon[31564]: from='osd.1 [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T08:33:59.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:58 smithi028 ceph-mon[31564]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T08:33:59.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:58 smithi037 ceph-mon[36609]: from='osd.1 [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T08:33:59.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:58 smithi037 ceph-mon[36609]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T08:33:59.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:59 smithi037 ceph-mon[36609]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:59.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:59 smithi037 ceph-mon[36609]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-06T08:33:59.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:59 smithi037 ceph-mon[36609]: from='osd.1 [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:33:59.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:59 smithi037 ceph-mon[36609]: osdmap e11: 2 total, 1 up, 2 in 2024-06-06T08:33:59.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:33:59.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:33:59 smithi037 ceph-mon[36609]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:33:59.919 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:59 smithi059 ceph-mon[36684]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:33:59.919 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:59 smithi059 ceph-mon[36684]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-06T08:33:59.919 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:59 smithi059 ceph-mon[36684]: from='osd.1 [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:33:59.919 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:59 smithi059 ceph-mon[36684]: osdmap e11: 2 total, 1 up, 2 in 2024-06-06T08:33:59.919 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:33:59.919 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:33:59 smithi059 ceph-mon[36684]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:34:00.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:59 smithi028 ceph-mon[31564]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:34:00.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:59 smithi028 ceph-mon[31564]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-06T08:34:00.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:59 smithi028 ceph-mon[31564]: from='osd.1 [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:34:00.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:59 smithi028 ceph-mon[31564]: osdmap e11: 2 total, 1 up, 2 in 2024-06-06T08:34:00.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:00.043 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:33:59 smithi028 ceph-mon[31564]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:34:00.313 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:34:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1[41132]: 2024-06-06T08:34:00.059+0000 7f94483eb700 -1 osd.1 0 waiting for initial osdmap 2024-06-06T08:34:00.314 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:34:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1[41132]: 2024-06-06T08:34:00.065+0000 7f94401d6700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T08:34:00.725 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-06T08:34:00.725 INFO:teuthology.orchestra.run.smithi059.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-06T08:34:00.725 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10+0 records in 2024-06-06T08:34:00.725 INFO:teuthology.orchestra.run.smithi059.stderr:10+0 records out 2024-06-06T08:34:00.725 INFO:teuthology.orchestra.run.smithi059.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128077 s, 819 MB/s 2024-06-06T08:34:00.725 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping successful for: 2024-06-06T08:34:00.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:00 smithi059 ceph-mon[36684]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:34:00.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:00 smithi059 ceph-mon[36684]: osdmap e12: 2 total, 1 up, 2 in 2024-06-06T08:34:00.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:00 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:00.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:00 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:00.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:00 smithi059 ceph-mon[36684]: from='osd.1 ' entity='osd.1' 2024-06-06T08:34:01.032 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:00 smithi037 ceph-mon[36609]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:34:01.032 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:00 smithi037 ceph-mon[36609]: osdmap e12: 2 total, 1 up, 2 in 2024-06-06T08:34:01.032 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:00 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:01.033 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:00 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:01.033 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:00 smithi037 ceph-mon[36609]: from='osd.1 ' entity='osd.1' 2024-06-06T08:34:01.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:00 smithi028 ceph-mon[31564]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:34:01.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:00 smithi028 ceph-mon[31564]: osdmap e12: 2 total, 1 up, 2 in 2024-06-06T08:34:01.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:00 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:01.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:00 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:01.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:00 smithi028 ceph-mon[31564]: from='osd.1 ' entity='osd.1' 2024-06-06T08:34:01.315 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_4 2024-06-06T08:34:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:34:01.924 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:34:01.924 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:34:01.924 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:34:01.924 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:01.924 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: osd.1 [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648] boot 2024-06-06T08:34:01.924 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: osdmap e13: 2 total, 2 up, 2 in 2024-06-06T08:34:01.925 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:01.925 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:01.925 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:01.925 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:34:01.925 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:01.925 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:01.925 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:34:01.925 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:34:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:34:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:34:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: osd.1 [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648] boot 2024-06-06T08:34:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: osdmap e13: 2 total, 2 up, 2 in 2024-06-06T08:34:02.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:02.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:02.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:02.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:34:02.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:02.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:02.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:34:02.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:02.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:34:02.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:34:02.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-06T08:34:02.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:02.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: osd.1 [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648] boot 2024-06-06T08:34:02.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: osdmap e13: 2 total, 2 up, 2 in 2024-06-06T08:34:02.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T08:34:02.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:02.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:02.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:34:02.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:02.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:02.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:34:02.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:02.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:02 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi037 2024-06-06T08:34:02.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:02 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi037 to 17093M 2024-06-06T08:34:03.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:02 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi037 2024-06-06T08:34:03.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:02 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi037 to 17093M 2024-06-06T08:34:03.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:02 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi037 2024-06-06T08:34:03.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:02 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi037 to 17093M 2024-06-06T08:34:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.071+0000 7f1ddedd5700 1 -- 172.21.15.59:0/1112827274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd8102f90 msgr2=0x7f1dd8109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:34:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.071+0000 7f1ddedd5700 1 --2- 172.21.15.59:0/1112827274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd8102f90 0x7f1dd8109840 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000b0a0 tx=0x7f1dd000b3b0 comp rx=0 tx=0).stop 2024-06-06T08:34:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.071+0000 7f1ddedd5700 1 -- 172.21.15.59:0/1112827274 shutdown_connections 2024-06-06T08:34:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.071+0000 7f1ddedd5700 1 --2- 172.21.15.59:0/1112827274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd8102f90 0x7f1dd8109840 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.071+0000 7f1ddedd5700 1 --2- 172.21.15.59:0/1112827274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1dd81013f0 0x7f1dd8101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.071+0000 7f1ddedd5700 1 --2- 172.21.15.59:0/1112827274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd81025f0 0x7f1dd8102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.071+0000 7f1ddedd5700 1 -- 172.21.15.59:0/1112827274 >> 172.21.15.59:0/1112827274 conn(0x7f1dd80fc990 msgr2=0x7f1dd80fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:34:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.071+0000 7f1ddedd5700 1 -- 172.21.15.59:0/1112827274 shutdown_connections 2024-06-06T08:34:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.071+0000 7f1ddedd5700 1 -- 172.21.15.59:0/1112827274 wait complete. 2024-06-06T08:34:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.072+0000 7f1ddedd5700 1 Processor -- start 2024-06-06T08:34:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.072+0000 7f1ddedd5700 1 -- start start 2024-06-06T08:34:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.072+0000 7f1ddedd5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd81013f0 0x7f1dd806acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:34:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.072+0000 7f1ddedd5700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1dd81025f0 0x7f1dd819d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:34:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.072+0000 7f1ddedd5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd8102f90 0x7f1dd819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:34:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.072+0000 7f1ddedd5700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd810d0d0 con 0x7f1dd81025f0 2024-06-06T08:34:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.072+0000 7f1ddedd5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd810cf50 con 0x7f1dd8102f90 2024-06-06T08:34:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.072+0000 7f1ddedd5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd810d250 con 0x7f1dd81013f0 2024-06-06T08:34:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1ddcb71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd81013f0 0x7f1dd806acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:34:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1ddcb71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd81013f0 0x7f1dd806acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49382/0 (socket says 172.21.15.59:49382) 2024-06-06T08:34:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1ddcb71700 1 -- 172.21.15.59:0/2496632720 learned_addr learned my addr 172.21.15.59:0/2496632720 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-06-06T08:34:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1ddd372700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd8102f90 0x7f1dd819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:34:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1ddcb71700 1 -- 172.21.15.59:0/2496632720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd8102f90 msgr2=0x7f1dd819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:34:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1ddcb71700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd8102f90 0x7f1dd819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1ddcb71700 1 -- 172.21.15.59:0/2496632720 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1dd81025f0 msgr2=0x7f1dd819d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:34:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1ddcb71700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1dd81025f0 0x7f1dd819d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1ddcb71700 1 -- 172.21.15.59:0/2496632720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd81a0450 con 0x7f1dd81013f0 2024-06-06T08:34:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1ddcb71700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd81013f0 0x7f1dd806acd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00b500 tx=0x7f1dcc00b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:34:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1dd5ffb700 1 -- 172.21.15.59:0/2496632720 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc015020 con 0x7f1dd81013f0 2024-06-06T08:34:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1ddedd5700 1 -- 172.21.15.59:0/2496632720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd81a0740 con 0x7f1dd81013f0 2024-06-06T08:34:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1dd5ffb700 1 -- 172.21.15.59:0/2496632720 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dcc011d10 con 0x7f1dd81013f0 2024-06-06T08:34:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.073+0000 7f1dd5ffb700 1 -- 172.21.15.59:0/2496632720 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc010e50 con 0x7f1dd81013f0 2024-06-06T08:34:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.074+0000 7f1ddedd5700 1 -- 172.21.15.59:0/2496632720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd81a0d00 con 0x7f1dd81013f0 2024-06-06T08:34:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.074+0000 7f1ddedd5700 1 -- 172.21.15.59:0/2496632720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dd8069180 con 0x7f1dd81013f0 2024-06-06T08:34:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.075+0000 7f1dd5ffb700 1 -- 172.21.15.59:0/2496632720 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f1dcc018020 con 0x7f1dd81013f0 2024-06-06T08:34:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.076+0000 7f1dd5ffb700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1dc80a2d30 0x7f1dc80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:34:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.076+0000 7f1dd5ffb700 1 -- 172.21.15.59:0/2496632720 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f1dcc0ccf50 con 0x7f1dd81013f0 2024-06-06T08:34:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.076+0000 7f1dd7fff700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1dc80a2d30 0x7f1dc80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:34:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.077+0000 7f1dd7fff700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1dc80a2d30 0x7f1dc80a51f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4005950 tx=0x7f1dc40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:34:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.081+0000 7f1dd5ffb700 1 -- 172.21.15.59:0/2496632720 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1dcc01f020 con 0x7f1dd81013f0 2024-06-06T08:34:03.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:03.296+0000 7f1ddedd5700 1 -- 172.21.15.59:0/2496632720 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1dd80628d0 con 0x7f1dc80a2d30 2024-06-06T08:34:03.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:03 smithi059 ceph-mon[36684]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:03.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:03 smithi059 ceph-mon[36684]: osdmap e14: 2 total, 2 up, 2 in 2024-06-06T08:34:03.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:34:03.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:34:03.963 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:03.965 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:03 smithi037 ceph-mon[36609]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:03.965 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:03 smithi037 ceph-mon[36609]: osdmap e14: 2 total, 2 up, 2 in 2024-06-06T08:34:03.965 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:34:03.965 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:34:03.965 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:04.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:03 smithi028 ceph-mon[31564]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:04.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:03 smithi028 ceph-mon[31564]: osdmap e14: 2 total, 2 up, 2 in 2024-06-06T08:34:04.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:34:04.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:34:04.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:04.932 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:04 smithi059 ceph-mon[36684]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:34:04.981 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:04 smithi037 ceph-mon[36609]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:34:05.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:04 smithi028 ceph-mon[31564]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:34:06.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:05 smithi028 ceph-mon[31564]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:06.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:05 smithi037 ceph-mon[36609]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:06.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:05 smithi059 ceph-mon[36684]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:07.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:06 smithi028 ceph-mon[31564]: from='client.? 172.21.15.59:0/2315148082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ea64fd8-13f4-4d53-933b-07055ec72701"}]: dispatch 2024-06-06T08:34:07.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:06 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ea64fd8-13f4-4d53-933b-07055ec72701"}]: dispatch 2024-06-06T08:34:07.048 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:06 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ea64fd8-13f4-4d53-933b-07055ec72701"}]': finished 2024-06-06T08:34:07.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:06 smithi028 ceph-mon[31564]: osdmap e15: 3 total, 2 up, 3 in 2024-06-06T08:34:07.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:07.049 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:06 smithi028 ceph-mon[31564]: from='client.? 172.21.15.59:0/855270305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:34:07.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:06 smithi037 ceph-mon[36609]: from='client.? 172.21.15.59:0/2315148082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ea64fd8-13f4-4d53-933b-07055ec72701"}]: dispatch 2024-06-06T08:34:07.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:06 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ea64fd8-13f4-4d53-933b-07055ec72701"}]: dispatch 2024-06-06T08:34:07.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:06 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ea64fd8-13f4-4d53-933b-07055ec72701"}]': finished 2024-06-06T08:34:07.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:06 smithi037 ceph-mon[36609]: osdmap e15: 3 total, 2 up, 3 in 2024-06-06T08:34:07.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:07.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:06 smithi037 ceph-mon[36609]: from='client.? 172.21.15.59:0/855270305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:34:07.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:06 smithi059 ceph-mon[36684]: from='client.? 172.21.15.59:0/2315148082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ea64fd8-13f4-4d53-933b-07055ec72701"}]: dispatch 2024-06-06T08:34:07.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:06 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ea64fd8-13f4-4d53-933b-07055ec72701"}]: dispatch 2024-06-06T08:34:07.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:06 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ea64fd8-13f4-4d53-933b-07055ec72701"}]': finished 2024-06-06T08:34:07.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:06 smithi059 ceph-mon[36684]: osdmap e15: 3 total, 2 up, 3 in 2024-06-06T08:34:07.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:07.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:06 smithi059 ceph-mon[36684]: from='client.? 172.21.15.59:0/855270305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:34:08.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:07 smithi028 ceph-mon[31564]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:08.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:07 smithi037 ceph-mon[36609]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:08.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:07 smithi059 ceph-mon[36684]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:09.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:08 smithi028 ceph-mon[31564]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:09.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:08 smithi037 ceph-mon[36609]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:09.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:08 smithi059 ceph-mon[36684]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:11.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:11 smithi059 ceph-mon[36684]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:11.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:11 smithi028 ceph-mon[31564]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:11.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:11 smithi037 ceph-mon[36609]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:13.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:13 smithi028 ceph-mon[31564]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:13.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:13 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-06T08:34:13.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:13 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:13.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:13 smithi037 ceph-mon[36609]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:13.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:13 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-06T08:34:13.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:13 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:13.574 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:13 smithi059 ceph-mon[36684]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:13.574 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:13 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-06T08:34:13.574 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:13 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:14.429 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:14 smithi059 ceph-mon[36684]: Deploying daemon osd.2 on smithi059 2024-06-06T08:34:14.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:14 smithi028 ceph-mon[31564]: Deploying daemon osd.2 on smithi059 2024-06-06T08:34:14.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:14 smithi037 ceph-mon[36609]: Deploying daemon osd.2 on smithi059 2024-06-06T08:34:15.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:15 smithi059 ceph-mon[36684]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:15.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:15 smithi028 ceph-mon[31564]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:15.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:15 smithi037 ceph-mon[36609]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:17.326 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:17 smithi059 ceph-mon[36684]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:17.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:17 smithi028 ceph-mon[31564]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:17.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:17 smithi037 ceph-mon[36609]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:19.444 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:19 smithi059 ceph-mon[36684]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:19.444 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:19.444 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:19.444 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:34:19.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:19 smithi028 ceph-mon[31564]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:19.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:19.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:19.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:34:19.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:19 smithi037 ceph-mon[36609]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:19.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:19.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:19.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:34:21.828 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:21 smithi059 ceph-mon[36684]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:21.828 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:21.828 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:21.828 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:21.829 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:34:21.829 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:21.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.829+0000 7f1dd5ffb700 1 -- 172.21.15.59:0/2496632720 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1dd80628d0 con 0x7f1dc80a2d30 2024-06-06T08:34:21.829 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 2 on host 'smithi059' 2024-06-06T08:34:21.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.831+0000 7f1ddedd5700 1 -- 172.21.15.59:0/2496632720 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1dc80a2d30 msgr2=0x7f1dc80a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:34:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.831+0000 7f1ddedd5700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1dc80a2d30 0x7f1dc80a51f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4005950 tx=0x7f1dc40058e0 comp rx=0 tx=0).stop 2024-06-06T08:34:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.831+0000 7f1ddedd5700 1 -- 172.21.15.59:0/2496632720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd81013f0 msgr2=0x7f1dd806acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:34:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.831+0000 7f1ddedd5700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd81013f0 0x7f1dd806acd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00b500 tx=0x7f1dcc00b810 comp rx=0 tx=0).stop 2024-06-06T08:34:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.831+0000 7f1ddedd5700 1 -- 172.21.15.59:0/2496632720 shutdown_connections 2024-06-06T08:34:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.831+0000 7f1ddedd5700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1dc80a2d30 0x7f1dc80a51f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.831+0000 7f1ddedd5700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd8102f90 0x7f1dd819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.831+0000 7f1ddedd5700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dd81013f0 0x7f1dd806acd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.831+0000 7f1ddedd5700 1 --2- 172.21.15.59:0/2496632720 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1dd81025f0 0x7f1dd819d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.831+0000 7f1ddedd5700 1 -- 172.21.15.59:0/2496632720 >> 172.21.15.59:0/2496632720 conn(0x7f1dd80fc990 msgr2=0x7f1dd81058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:34:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.832+0000 7f1ddedd5700 1 -- 172.21.15.59:0/2496632720 shutdown_connections 2024-06-06T08:34:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:34:21.832+0000 7f1ddedd5700 1 -- 172.21.15.59:0/2496632720 wait complete. 2024-06-06T08:34:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:21 smithi028 ceph-mon[31564]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:34:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:22.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:21 smithi037 ceph-mon[36609]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:22.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:22.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:22.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:22.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:34:22.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:22.483 DEBUG:teuthology.orchestra.run.smithi059:osd.2> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.2.service 2024-06-06T08:34:22.486 INFO:tasks.cephadm:Deploying osd.3 on smithi028 with /dev/vg_nvme/lv_3... 2024-06-06T08:34:22.486 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-06T08:34:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:34:23.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:23.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:23.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:34:23.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:22 smithi028 ceph-mon[31564]: from='osd.2 [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T08:34:23.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:22 smithi028 ceph-mon[31564]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T08:34:23.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:23.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:23.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:34:23.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:22 smithi037 ceph-mon[36609]: from='osd.2 [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T08:34:23.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:22 smithi037 ceph-mon[36609]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T08:34:23.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:23.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:23.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:34:23.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:22 smithi059 ceph-mon[36684]: from='osd.2 [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T08:34:23.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:22 smithi059 ceph-mon[36684]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T08:34:23.926 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:23 smithi059 ceph-mon[36684]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:23.927 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:23 smithi059 ceph-mon[36684]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-06T08:34:23.927 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:23 smithi059 ceph-mon[36684]: osdmap e16: 3 total, 2 up, 3 in 2024-06-06T08:34:23.927 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:23.927 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:23 smithi059 ceph-mon[36684]: from='osd.2 [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:34:23.927 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:23 smithi059 ceph-mon[36684]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:34:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:23 smithi037 ceph-mon[36609]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:23 smithi037 ceph-mon[36609]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-06T08:34:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:23 smithi037 ceph-mon[36609]: osdmap e16: 3 total, 2 up, 3 in 2024-06-06T08:34:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:23 smithi037 ceph-mon[36609]: from='osd.2 [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:34:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:23 smithi037 ceph-mon[36609]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:34:24.143 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:23 smithi028 ceph-mon[31564]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:24.143 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:23 smithi028 ceph-mon[31564]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-06T08:34:24.143 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:23 smithi028 ceph-mon[31564]: osdmap e16: 3 total, 2 up, 3 in 2024-06-06T08:34:24.144 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:24.144 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:23 smithi028 ceph-mon[31564]: from='osd.2 [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:34:24.144 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:23 smithi028 ceph-mon[31564]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:34:24.600 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:34:24 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2[41776]: 2024-06-06T08:34:24.241+0000 7fcdc32df700 -1 osd.2 0 waiting for initial osdmap 2024-06-06T08:34:24.600 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:34:24 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2[41776]: 2024-06-06T08:34:24.245+0000 7fcdbb0ca700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T08:34:24.938 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:24 smithi028 ceph-mon[31564]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:34:24.938 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:24 smithi028 ceph-mon[31564]: osdmap e17: 3 total, 2 up, 3 in 2024-06-06T08:34:24.938 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:24.938 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:24.938 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:24 smithi028 ceph-mon[31564]: from='osd.2 ' entity='osd.2' 2024-06-06T08:34:25.062 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:24 smithi059 ceph-mon[36684]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:34:25.063 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:24 smithi059 ceph-mon[36684]: osdmap e17: 3 total, 2 up, 3 in 2024-06-06T08:34:25.063 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:25.063 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:25.063 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:24 smithi059 ceph-mon[36684]: from='osd.2 ' entity='osd.2' 2024-06-06T08:34:25.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:24 smithi037 ceph-mon[36609]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:34:25.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:24 smithi037 ceph-mon[36609]: osdmap e17: 3 total, 2 up, 3 in 2024-06-06T08:34:25.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:25.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:25.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:24 smithi037 ceph-mon[36609]: from='osd.2 ' entity='osd.2' 2024-06-06T08:34:25.850 INFO:teuthology.orchestra.run.smithi028.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-06T08:34:25.851 INFO:teuthology.orchestra.run.smithi028.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-06T08:34:25.851 INFO:teuthology.orchestra.run.smithi028.stderr: stderr: 10+0 records in 2024-06-06T08:34:25.851 INFO:teuthology.orchestra.run.smithi028.stderr:10+0 records out 2024-06-06T08:34:25.851 INFO:teuthology.orchestra.run.smithi028.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0349299 s, 300 MB/s 2024-06-06T08:34:25.851 INFO:teuthology.orchestra.run.smithi028.stderr:--> Zapping successful for: 2024-06-06T08:34:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: osd.2 [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886] boot 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: osdmap e18: 3 total, 3 up, 3 in 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:34:26.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:34:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:34:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: osd.2 [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886] boot 2024-06-06T08:34:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: osdmap e18: 3 total, 3 up, 3 in 2024-06-06T08:34:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:34:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:26.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:34:26.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.269 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:34:26.269 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:34:26.269 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-06T08:34:26.269 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:26.269 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: osd.2 [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886] boot 2024-06-06T08:34:26.270 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: osdmap e18: 3 total, 3 up, 3 in 2024-06-06T08:34:26.270 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T08:34:26.270 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.270 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.270 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:34:26.270 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.270 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:26.270 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:34:26.270 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:26.700 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi028:vg_nvme/lv_3 2024-06-06T08:34:27.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:26 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi059 2024-06-06T08:34:27.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:26 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi059 to 17093M 2024-06-06T08:34:27.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:34:27.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:26 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi059 2024-06-06T08:34:27.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:26 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi059 to 17093M 2024-06-06T08:34:27.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:34:27.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:26 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi059 2024-06-06T08:34:27.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:26 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi059 to 17093M 2024-06-06T08:34:27.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:34:27.132 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:34:28.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:27 smithi059 ceph-mon[36684]: pgmap v91: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:28.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:27 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-06T08:34:28.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:27 smithi059 ceph-mon[36684]: osdmap e19: 3 total, 3 up, 3 in 2024-06-06T08:34:28.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:27 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:34:28.257 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:27 smithi028 ceph-mon[31564]: pgmap v91: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:28.257 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-06T08:34:28.257 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:27 smithi028 ceph-mon[31564]: osdmap e19: 3 total, 3 up, 3 in 2024-06-06T08:34:28.257 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:34:28.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:27 smithi037 ceph-mon[36609]: pgmap v91: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:28.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:27 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-06T08:34:28.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:27 smithi037 ceph-mon[36609]: osdmap e19: 3 total, 3 up, 3 in 2024-06-06T08:34:28.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:27 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:34:28.840 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:34:28 smithi028 sudo[50487]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T08:34:28.840 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:34:28 smithi028 sudo[50487]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:28.840 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:34:28 smithi028 sudo[50487]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:28.840 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:34:28 smithi028 sudo[50487]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:29.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:28 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-06T08:34:29.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:28 smithi059 ceph-mon[36684]: osdmap e20: 3 total, 3 up, 3 in 2024-06-06T08:34:29.111 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-06T08:34:29.111 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:28 smithi028 ceph-mon[31564]: osdmap e20: 3 total, 3 up, 3 in 2024-06-06T08:34:29.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:28 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-06T08:34:29.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:28 smithi037 ceph-mon[36609]: osdmap e20: 3 total, 3 up, 3 in 2024-06-06T08:34:29.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.358+0000 7f5698c00700 1 -- 172.21.15.28:0/3253091334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694074e70 msgr2=0x7f56940752f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:34:29.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.358+0000 7f5698c00700 1 --2- 172.21.15.28:0/3253091334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694074e70 0x7f56940752f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5680009990 tx=0x7f5680009ca0 comp rx=0 tx=0).stop 2024-06-06T08:34:29.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.358+0000 7f5698c00700 1 -- 172.21.15.28:0/3253091334 shutdown_connections 2024-06-06T08:34:29.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.358+0000 7f5698c00700 1 --2- 172.21.15.28:0/3253091334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569410a410 0x7f569410c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.358+0000 7f5698c00700 1 --2- 172.21.15.28:0/3253091334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5694076440 0x7f56940748a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.358+0000 7f5698c00700 1 --2- 172.21.15.28:0/3253091334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694074e70 0x7f56940752f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.358+0000 7f5698c00700 1 -- 172.21.15.28:0/3253091334 >> 172.21.15.28:0/3253091334 conn(0x7f56940fdab0 msgr2=0x7f56940ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:34:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.358+0000 7f5698c00700 1 -- 172.21.15.28:0/3253091334 shutdown_connections 2024-06-06T08:34:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.358+0000 7f5698c00700 1 -- 172.21.15.28:0/3253091334 wait complete. 2024-06-06T08:34:29.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.359+0000 7f5698c00700 1 Processor -- start 2024-06-06T08:34:29.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.359+0000 7f5698c00700 1 -- start start 2024-06-06T08:34:29.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.359+0000 7f5698c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694074e70 0x7f569419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:34:29.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.359+0000 7f5698c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5694076440 0x7f569419ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:34:29.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.359+0000 7f5698c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569410a410 0x7f56941a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:34:29.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.359+0000 7f5698c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5694110330 con 0x7f5694074e70 2024-06-06T08:34:29.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.359+0000 7f5698c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f56941101b0 con 0x7f569410a410 2024-06-06T08:34:29.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.359+0000 7f5698c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56941104b0 con 0x7f5694076440 2024-06-06T08:34:29.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5691e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694074e70 0x7f569419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:34:29.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5692800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569410a410 0x7f56941a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:34:29.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5692800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569410a410 0x7f56941a1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:59158/0 (socket says 172.21.15.28:59158) 2024-06-06T08:34:29.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5692800700 1 -- 172.21.15.28:0/2770521232 learned_addr learned my addr 172.21.15.28:0/2770521232 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:34:29.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5691400700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5694076440 0x7f569419ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:34:29.362 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:34:29 smithi028 sudo[50512]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T08:34:29.362 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:34:29 smithi028 sudo[50512]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:29.362 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:34:29 smithi028 sudo[50512]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:29.362 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:34:29 smithi028 sudo[50512]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:29.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5692800700 1 -- 172.21.15.28:0/2770521232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5694076440 msgr2=0x7f569419ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:34:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5692800700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5694076440 0x7f569419ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5692800700 1 -- 172.21.15.28:0/2770521232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694074e70 msgr2=0x7f569419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:34:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5692800700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694074e70 0x7f569419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5692800700 1 -- 172.21.15.28:0/2770521232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56941a2550 con 0x7f569410a410 2024-06-06T08:34:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5691e00700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694074e70 0x7f569419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:34:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.360+0000 7f5692800700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569410a410 0x7f56941a1eb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f568c00ef30 tx=0x7f568c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:34:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.361+0000 7f568aa00700 1 -- 172.21.15.28:0/2770521232 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c0092e0 con 0x7f569410a410 2024-06-06T08:34:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.361+0000 7f5698c00700 1 -- 172.21.15.28:0/2770521232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56941a27e0 con 0x7f569410a410 2024-06-06T08:34:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.361+0000 7f568aa00700 1 -- 172.21.15.28:0/2770521232 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f568c004bb0 con 0x7f569410a410 2024-06-06T08:34:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.361+0000 7f568aa00700 1 -- 172.21.15.28:0/2770521232 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c004280 con 0x7f569410a410 2024-06-06T08:34:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.361+0000 7f5698c00700 1 -- 172.21.15.28:0/2770521232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56941a2d20 con 0x7f569410a410 2024-06-06T08:34:29.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.362+0000 7f5698c00700 1 -- 172.21.15.28:0/2770521232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5694069180 con 0x7f569410a410 2024-06-06T08:34:29.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.365+0000 7f568aa00700 1 -- 172.21.15.28:0/2770521232 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f568c01b030 con 0x7f569410a410 2024-06-06T08:34:29.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.367+0000 7f568aa00700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2c20 0x7f56780a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:34:29.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.367+0000 7f568aa00700 1 -- 172.21.15.28:0/2770521232 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7f568c0cd7e0 con 0x7f569410a410 2024-06-06T08:34:29.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.367+0000 7f5691e00700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2c20 0x7f56780a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:34:29.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.368+0000 7f5691e00700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2c20 0x7f56780a50e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5684010420 tx=0x7f56840073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:34:29.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.373+0000 7f568aa00700 1 -- 172.21.15.28:0/2770521232 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f568c022020 con 0x7f569410a410 2024-06-06T08:34:29.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:29.602+0000 7f5698c00700 1 -- 172.21.15.28:0/2770521232 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f569402e0b0 con 0x7f56780a2c20 2024-06-06T08:34:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:29 smithi059 ceph-mon[36684]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:29 smithi059 ceph-mon[36684]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-06T08:34:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:29 smithi059 ceph-mon[36684]: osdmap e21: 3 total, 3 up, 3 in 2024-06-06T08:34:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:29 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:29 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:34:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:29 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:34:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:29 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:30.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:29 smithi028 ceph-mon[31564]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:30.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:29 smithi028 ceph-mon[31564]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-06T08:34:30.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:29 smithi028 ceph-mon[31564]: osdmap e21: 3 total, 3 up, 3 in 2024-06-06T08:34:30.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:29 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:30.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:29 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:34:30.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:29 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:34:30.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:29 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:30.293 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:34:29 smithi037 sudo[45237]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T08:34:30.293 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:34:29 smithi037 sudo[45237]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:30.293 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:34:29 smithi037 sudo[45237]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:30.293 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:34:29 smithi037 sudo[45237]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:30.293 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:29 smithi037 ceph-mon[36609]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:30.294 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:29 smithi037 ceph-mon[36609]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-06T08:34:30.294 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:29 smithi037 ceph-mon[36609]: osdmap e21: 3 total, 3 up, 3 in 2024-06-06T08:34:30.294 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:29 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:30.294 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:29 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:34:30.294 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:29 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:34:30.294 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:29 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:30.563 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:34:30 smithi037 sudo[45240]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T08:34:30.563 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:34:30 smithi037 sudo[45240]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:30.564 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:34:30 smithi037 sudo[45240]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:30.564 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:34:30 smithi037 sudo[45240]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:31.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:30 smithi059 ceph-mon[36684]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:34:31.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:31.100 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:34:30 smithi059 sudo[45399]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T08:34:31.100 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:34:30 smithi059 sudo[45399]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:31.100 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:34:30 smithi059 sudo[45399]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:31.100 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:34:30 smithi059 sudo[45399]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:31.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:30 smithi028 ceph-mon[31564]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:34:31.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:31.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:30 smithi037 ceph-mon[36609]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:34:31.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:31.600 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:34:31 smithi059 sudo[45402]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T08:34:31.600 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:34:31 smithi059 sudo[45402]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:31.600 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:34:31 smithi059 sudo[45402]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:31.600 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:34:31 smithi059 sudo[45402]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:32.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:31 smithi028 sudo[50678]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T08:34:32.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:31 smithi028 sudo[50678]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:32.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:31 smithi028 sudo[50678]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:31 smithi028 sudo[50678]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:32 smithi028 sudo[50707]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T08:34:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:32 smithi028 sudo[50707]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:32 smithi028 sudo[50707]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:32 smithi028 sudo[50707]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:32 smithi028 ceph-mon[31564]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:32 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:32 smithi028 ceph-mon[31564]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T08:34:32.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:32 smithi037 ceph-mon[36609]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:32.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:32 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:32.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:32 smithi037 ceph-mon[36609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T08:34:32.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:32 smithi059 ceph-mon[36684]: pgmap v96: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:32.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:32 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:32.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:32 smithi059 ceph-mon[36684]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T08:34:33.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:32 smithi059 sudo[45405]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T08:34:33.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:32 smithi059 sudo[45405]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:33.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:32 smithi059 sudo[45405]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:33.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:32 smithi059 sudo[45405]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:33.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:33 smithi059 sudo[45408]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T08:34:33.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:33 smithi059 sudo[45408]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:33.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:33 smithi059 sudo[45408]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:33.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:33 smithi059 sudo[45408]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:34.298 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:33 smithi037 sudo[45243]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T08:34:34.299 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:33 smithi037 sudo[45243]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:34.299 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:33 smithi037 sudo[45243]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:34.299 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:33 smithi037 sudo[45243]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:34.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 sudo[45246]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T08:34:34.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 sudo[45246]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T08:34:34.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 sudo[45246]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-06T08:34:34.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 sudo[45246]: pam_unix(sudo:session): session closed for user root 2024-06-06T08:34:34.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:34.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T08:34:34.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:34:34.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:34:34.565 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:34:34.565 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T08:34:34.565 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:34:34.565 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:34:34.565 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:34:34.565 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T08:34:34.565 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:34:34.565 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:34:34.565 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:34:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T08:34:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:34:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:34:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:34:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T08:34:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:34:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:34:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:34:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T08:34:34.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:34:34.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:34:34.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:34:34.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T08:34:34.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T08:34:35.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:35 smithi037 ceph-mon[36609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T08:34:35.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:35 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1096390248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be9cdb5-12a9-438e-b8cd-ce65988b0ac6"}]: dispatch 2024-06-06T08:34:35.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:35 smithi037 ceph-mon[36609]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:35.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:35 smithi037 ceph-mon[36609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T08:34:35.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:35 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be9cdb5-12a9-438e-b8cd-ce65988b0ac6"}]: dispatch 2024-06-06T08:34:35.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:35 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8be9cdb5-12a9-438e-b8cd-ce65988b0ac6"}]': finished 2024-06-06T08:34:35.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:35 smithi037 ceph-mon[36609]: osdmap e22: 4 total, 3 up, 4 in 2024-06-06T08:34:35.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:35 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:35.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:35 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1633014774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:34:35.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:35 smithi059 ceph-mon[36684]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T08:34:35.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:35 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1096390248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be9cdb5-12a9-438e-b8cd-ce65988b0ac6"}]: dispatch 2024-06-06T08:34:35.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:35 smithi059 ceph-mon[36684]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:35.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:35 smithi059 ceph-mon[36684]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T08:34:35.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:35 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be9cdb5-12a9-438e-b8cd-ce65988b0ac6"}]: dispatch 2024-06-06T08:34:35.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:35 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8be9cdb5-12a9-438e-b8cd-ce65988b0ac6"}]': finished 2024-06-06T08:34:35.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:35 smithi059 ceph-mon[36684]: osdmap e22: 4 total, 3 up, 4 in 2024-06-06T08:34:35.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:35.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:35 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1633014774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:34:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:35 smithi028 ceph-mon[31564]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T08:34:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:35 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1096390248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be9cdb5-12a9-438e-b8cd-ce65988b0ac6"}]: dispatch 2024-06-06T08:34:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:35 smithi028 ceph-mon[31564]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:35 smithi028 ceph-mon[31564]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T08:34:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:35 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8be9cdb5-12a9-438e-b8cd-ce65988b0ac6"}]: dispatch 2024-06-06T08:34:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:35 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8be9cdb5-12a9-438e-b8cd-ce65988b0ac6"}]': finished 2024-06-06T08:34:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:35 smithi028 ceph-mon[31564]: osdmap e22: 4 total, 3 up, 4 in 2024-06-06T08:34:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:35 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:35 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1633014774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:34:37.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:37 smithi037 ceph-mon[36609]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:37.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:37 smithi059 ceph-mon[36684]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:37.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:37 smithi028 ceph-mon[31564]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:39.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:39 smithi059 ceph-mon[36684]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-06T08:34:39.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:39 smithi028 ceph-mon[31564]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-06T08:34:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:39 smithi037 ceph-mon[36609]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-06T08:34:41.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:41 smithi059 ceph-mon[36684]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-06T08:34:41.732 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:41 smithi028 ceph-mon[31564]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-06T08:34:41.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:41 smithi037 ceph-mon[36609]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-06T08:34:43.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:43 smithi059 ceph-mon[36684]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-06T08:34:43.706 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:43 smithi028 ceph-mon[31564]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-06T08:34:43.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:43 smithi037 ceph-mon[36609]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-06T08:34:44.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:44 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-06T08:34:44.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:44 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:44.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:44 smithi059 ceph-mon[36684]: Deploying daemon osd.3 on smithi028 2024-06-06T08:34:44.741 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:44 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-06T08:34:44.741 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:44 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:44.742 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:44 smithi028 ceph-mon[31564]: Deploying daemon osd.3 on smithi028 2024-06-06T08:34:44.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:44 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-06T08:34:44.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:44 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:34:44.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:44 smithi037 ceph-mon[36609]: Deploying daemon osd.3 on smithi028 2024-06-06T08:34:45.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:45 smithi059 ceph-mon[36684]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-06T08:34:45.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:45 smithi028 ceph-mon[31564]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-06T08:34:45.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:45 smithi037 ceph-mon[36609]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-06T08:34:47.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:47 smithi059 ceph-mon[36684]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 781 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-06T08:34:47.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:47 smithi028 ceph-mon[31564]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 781 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-06T08:34:47.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:47 smithi037 ceph-mon[36609]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 781 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-06T08:34:49.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:49 smithi028 ceph-mon[31564]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-06T08:34:49.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:49 smithi059 ceph-mon[36684]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-06T08:34:49.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:49 smithi037 ceph-mon[36609]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-06T08:34:51.679 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:51 smithi028 ceph-mon[31564]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:51.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:51 smithi037 ceph-mon[36609]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:51.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:51 smithi059 ceph-mon[36684]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:53.433 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:53 smithi028 ceph-mon[31564]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:53.434 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:53.434 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:53.434 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:34:53.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:53 smithi037 ceph-mon[36609]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:53.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:53.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:53.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:34:53.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:53 smithi059 ceph-mon[36684]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:53.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:53.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:53.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:34:55.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:55 smithi028 ceph-mon[31564]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:55.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:55 smithi037 ceph-mon[36609]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:55.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:55 smithi059 ceph-mon[36684]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:56.647 INFO:teuthology.orchestra.run.smithi028.stdout:Created osd(s) 3 on host 'smithi028' 2024-06-06T08:34:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.647+0000 7f568aa00700 1 -- 172.21.15.28:0/2770521232 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f569402e0b0 con 0x7f56780a2c20 2024-06-06T08:34:56.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.652+0000 7f5698c00700 1 -- 172.21.15.28:0/2770521232 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2c20 msgr2=0x7f56780a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:34:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.652+0000 7f5698c00700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2c20 0x7f56780a50e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5684010420 tx=0x7f56840073d0 comp rx=0 tx=0).stop 2024-06-06T08:34:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.652+0000 7f5698c00700 1 -- 172.21.15.28:0/2770521232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569410a410 msgr2=0x7f56941a1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:34:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.652+0000 7f5698c00700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569410a410 0x7f56941a1eb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f568c00ef30 tx=0x7f568c00c3a0 comp rx=0 tx=0).stop 2024-06-06T08:34:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.652+0000 7f5698c00700 1 -- 172.21.15.28:0/2770521232 shutdown_connections 2024-06-06T08:34:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.652+0000 7f5698c00700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2c20 0x7f56780a50e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.652+0000 7f5698c00700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569410a410 0x7f56941a1eb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.652+0000 7f5698c00700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5694074e70 0x7f569419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.652+0000 7f5698c00700 1 --2- 172.21.15.28:0/2770521232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5694076440 0x7f569419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:34:56.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.652+0000 7f5698c00700 1 -- 172.21.15.28:0/2770521232 >> 172.21.15.28:0/2770521232 conn(0x7f56940fdab0 msgr2=0x7f5694106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:34:56.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.653+0000 7f5698c00700 1 -- 172.21.15.28:0/2770521232 shutdown_connections 2024-06-06T08:34:56.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:34:56.653+0000 7f5698c00700 1 -- 172.21.15.28:0/2770521232 wait complete. 2024-06-06T08:34:57.026 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.026 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.026 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:56 smithi028 ceph-mon[31564]: from='osd.3 [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T08:34:57.026 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:56 smithi028 ceph-mon[31564]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T08:34:57.026 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.026 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:56 smithi037 ceph-mon[36609]: from='osd.3 [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T08:34:57.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:56 smithi037 ceph-mon[36609]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T08:34:57.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:56 smithi059 ceph-mon[36684]: from='osd.3 [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T08:34:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:56 smithi059 ceph-mon[36684]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T08:34:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:34:57.459 DEBUG:teuthology.orchestra.run.smithi028:osd.3> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.3.service 2024-06-06T08:34:57.465 INFO:tasks.cephadm:Deploying osd.4 on smithi037 with /dev/vg_nvme/lv_3... 2024-06-06T08:34:57.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-06T08:34:57.720 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:34:58.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:57 smithi028 ceph-mon[31564]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:58.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:57 smithi028 ceph-mon[31564]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-06T08:34:58.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:57 smithi028 ceph-mon[31564]: osdmap e23: 4 total, 3 up, 4 in 2024-06-06T08:34:58.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:58.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:57 smithi028 ceph-mon[31564]: from='osd.3 [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:34:58.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:57 smithi028 ceph-mon[31564]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:34:58.019 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:34:57 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3[52800]: 2024-06-06T08:34:57.778+0000 7f7ffd400700 -1 osd.3 0 waiting for initial osdmap 2024-06-06T08:34:58.019 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:34:57 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3[52800]: 2024-06-06T08:34:57.787+0000 7f7ff8200700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T08:34:58.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:57 smithi037 ceph-mon[36609]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:58.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:57 smithi037 ceph-mon[36609]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-06T08:34:58.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:57 smithi037 ceph-mon[36609]: osdmap e23: 4 total, 3 up, 4 in 2024-06-06T08:34:58.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:58.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:57 smithi037 ceph-mon[36609]: from='osd.3 [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:34:58.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:57 smithi037 ceph-mon[36609]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:34:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:57 smithi059 ceph-mon[36684]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:57 smithi059 ceph-mon[36684]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-06T08:34:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:57 smithi059 ceph-mon[36684]: osdmap e23: 4 total, 3 up, 4 in 2024-06-06T08:34:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:57 smithi059 ceph-mon[36684]: from='osd.3 [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:34:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:57 smithi059 ceph-mon[36684]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:34:59.029 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:58 smithi028 ceph-mon[31564]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:34:59.029 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:58 smithi028 ceph-mon[31564]: osdmap e24: 4 total, 3 up, 4 in 2024-06-06T08:34:59.029 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:58 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:59.029 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:58 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:59.030 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:58 smithi028 ceph-mon[31564]: osd.3 [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430] boot 2024-06-06T08:34:59.030 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:58 smithi028 ceph-mon[31564]: osdmap e25: 4 total, 4 up, 4 in 2024-06-06T08:34:59.030 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:58 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:59.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:58 smithi037 ceph-mon[36609]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:34:59.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:58 smithi037 ceph-mon[36609]: osdmap e24: 4 total, 3 up, 4 in 2024-06-06T08:34:59.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:58 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:59.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:58 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:59.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:58 smithi037 ceph-mon[36609]: osd.3 [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430] boot 2024-06-06T08:34:59.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:58 smithi037 ceph-mon[36609]: osdmap e25: 4 total, 4 up, 4 in 2024-06-06T08:34:59.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:58 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:59.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:58 smithi059 ceph-mon[36684]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:34:59.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:58 smithi059 ceph-mon[36684]: osdmap e24: 4 total, 3 up, 4 in 2024-06-06T08:34:59.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:58 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:59.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:58 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:59.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:58 smithi059 ceph-mon[36684]: osd.3 [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430] boot 2024-06-06T08:34:59.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:58 smithi059 ceph-mon[36684]: osdmap e25: 4 total, 4 up, 4 in 2024-06-06T08:34:59.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:58 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T08:34:59.878 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:59 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:34:59.878 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:59 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:34:59.878 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:59 smithi028 ceph-mon[31564]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:34:59.878 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:34:59 smithi028 ceph-mon[31564]: osdmap e26: 4 total, 4 up, 4 in 2024-06-06T08:34:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-06T08:34:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-06T08:34:59.882 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2024-06-06T08:34:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2024-06-06T08:34:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111349 s, 942 MB/s 2024-06-06T08:34:59.882 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2024-06-06T08:35:00.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:59 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:35:00.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:59 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:35:00.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:59 smithi037 ceph-mon[36609]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:35:00.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:34:59 smithi037 ceph-mon[36609]: osdmap e26: 4 total, 4 up, 4 in 2024-06-06T08:35:00.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:59 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:35:00.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:59 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:35:00.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:59 smithi059 ceph-mon[36684]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T08:35:00.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:34:59 smithi059 ceph-mon[36684]: osdmap e26: 4 total, 4 up, 4 in 2024-06-06T08:35:00.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_3 2024-06-06T08:35:00.869 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:35:01.223 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:01 smithi037 ceph-mon[36609]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:01.223 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:01 smithi037 ceph-mon[36609]: osdmap e27: 4 total, 4 up, 4 in 2024-06-06T08:35:01.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:01 smithi028 ceph-mon[31564]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:01.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:01 smithi028 ceph-mon[31564]: osdmap e27: 4 total, 4 up, 4 in 2024-06-06T08:35:01.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:01 smithi059 ceph-mon[36684]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:01.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:01 smithi059 ceph-mon[36684]: osdmap e27: 4 total, 4 up, 4 in 2024-06-06T08:35:02.231 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:02 smithi037 ceph-mon[36609]: osdmap e28: 4 total, 4 up, 4 in 2024-06-06T08:35:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.454+0000 7f787510b700 1 -- 172.21.15.37:0/2498394640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7870074ef0 msgr2=0x7f7870075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.454+0000 7f787510b700 1 --2- 172.21.15.37:0/2498394640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7870074ef0 0x7f7870075370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7858009990 tx=0x7f7858009ca0 comp rx=0 tx=0).stop 2024-06-06T08:35:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.454+0000 7f787510b700 1 -- 172.21.15.37:0/2498394640 shutdown_connections 2024-06-06T08:35:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.454+0000 7f787510b700 1 --2- 172.21.15.37:0/2498394640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787010a3c0 0x7f787010c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.454+0000 7f787510b700 1 --2- 172.21.15.37:0/2498394640 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78700764c0 0x7f7870074920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.454+0000 7f787510b700 1 --2- 172.21.15.37:0/2498394640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7870074ef0 0x7f7870075370 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.454+0000 7f787510b700 1 -- 172.21.15.37:0/2498394640 >> 172.21.15.37:0/2498394640 conn(0x7f78700fda90 msgr2=0x7f78700ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:35:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.454+0000 7f787510b700 1 -- 172.21.15.37:0/2498394640 shutdown_connections 2024-06-06T08:35:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.454+0000 7f787510b700 1 -- 172.21.15.37:0/2498394640 wait complete. 2024-06-06T08:35:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f787510b700 1 Processor -- start 2024-06-06T08:35:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f787510b700 1 -- start start 2024-06-06T08:35:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f787510b700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7870074ef0 0x7f787019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f787510b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78700764c0 0x7f787019b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f787510b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787010a3c0 0x7f78701a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f787510b700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f78701103d0 con 0x7f7870074ef0 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f787510b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7870110250 con 0x7f787010a3c0 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f787510b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7870110550 con 0x7f78700764c0 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f786f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787010a3c0 0x7f78701a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f786f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787010a3c0 0x7f78701a20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56300/0 (socket says 172.21.15.37:56300) 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f786f59e700 1 -- 172.21.15.37:0/3470087709 learned_addr learned my addr 172.21.15.37:0/3470087709 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.455+0000 7f786e59c700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78700764c0 0x7f787019b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f786f59e700 1 -- 172.21.15.37:0/3470087709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78700764c0 msgr2=0x7f787019b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f786f59e700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78700764c0 0x7f787019b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f786ed9d700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7870074ef0 0x7f787019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:35:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f786f59e700 1 -- 172.21.15.37:0/3470087709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7870074ef0 msgr2=0x7f787019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f786f59e700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7870074ef0 0x7f787019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f786f59e700 1 -- 172.21.15.37:0/3470087709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78701a2750 con 0x7f787010a3c0 2024-06-06T08:35:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f786f59e700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787010a3c0 0x7f78701a20b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f786000b970 tx=0x7f786000bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:35:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f7867fff700 1 -- 172.21.15.37:0/3470087709 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860019070 con 0x7f787010a3c0 2024-06-06T08:35:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f787510b700 1 -- 172.21.15.37:0/3470087709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78701a2a40 con 0x7f787010a3c0 2024-06-06T08:35:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f7867fff700 1 -- 172.21.15.37:0/3470087709 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f786000ce10 con 0x7f787010a3c0 2024-06-06T08:35:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f7867fff700 1 -- 172.21.15.37:0/3470087709 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860007390 con 0x7f787010a3c0 2024-06-06T08:35:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.456+0000 7f787510b700 1 -- 172.21.15.37:0/3470087709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78701a2fd0 con 0x7f787010a3c0 2024-06-06T08:35:02.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.457+0000 7f787510b700 1 -- 172.21.15.37:0/3470087709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7870069180 con 0x7f787010a3c0 2024-06-06T08:35:02.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.458+0000 7f7867fff700 1 -- 172.21.15.37:0/3470087709 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f786001c070 con 0x7f787010a3c0 2024-06-06T08:35:02.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.459+0000 7f7867fff700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f785c0a2ca0 0x7f785c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:02.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.459+0000 7f7867fff700 1 -- 172.21.15.37:0/3470087709 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3669+0+0 (secure 0 0 0) 0x7f78600cd670 con 0x7f787010a3c0 2024-06-06T08:35:02.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.460+0000 7f786ed9d700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f785c0a2ca0 0x7f785c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:35:02.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.460+0000 7f786ed9d700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f785c0a2ca0 0x7f785c0a5160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7868006fd0 tx=0x7f7868008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:35:02.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.463+0000 7f7867fff700 1 -- 172.21.15.37:0/3470087709 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f786009b750 con 0x7f787010a3c0 2024-06-06T08:35:02.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:02 smithi028 ceph-mon[31564]: osdmap e28: 4 total, 4 up, 4 in 2024-06-06T08:35:02.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:02 smithi059 ceph-mon[36684]: osdmap e28: 4 total, 4 up, 4 in 2024-06-06T08:35:02.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:02.679+0000 7f787510b700 1 -- 172.21.15.37:0/3470087709 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f78700628d0 con 0x7f785c0a2ca0 2024-06-06T08:35:03.479 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: pgmap v119: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-06T08:35:03.480 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: osdmap e29: 4 total, 4 up, 4 in 2024-06-06T08:35:03.480 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:35:03.480 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:35:03.480 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:35:03.480 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:03.480 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi028 2024-06-06T08:35:03.480 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.480 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.480 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:03.480 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:03.481 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi028 to 8547M 2024-06-06T08:35:03.481 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.481 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:03.481 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:03.481 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.481 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:03.481 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:03.481 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:03.481 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: pgmap v119: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-06T08:35:03.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: osdmap e29: 4 total, 4 up, 4 in 2024-06-06T08:35:03.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:35:03.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:35:03.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:35:03.543 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:03.543 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi028 2024-06-06T08:35:03.543 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.544 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.544 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:03.544 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:03.544 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi028 to 8547M 2024-06-06T08:35:03.544 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.544 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:03.545 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:03.545 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.545 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:03.545 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:03.546 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:03.546 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: pgmap v119: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-06T08:35:03.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: osdmap e29: 4 total, 4 up, 4 in 2024-06-06T08:35:03.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:35:03.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:35:03.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:35:03.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:03.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi028 2024-06-06T08:35:03.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:03.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:03.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi028 to 8547M 2024-06-06T08:35:03.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:03.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:03.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:03.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:03.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:03.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:03.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:05.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:05 smithi059 ceph-mon[36684]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-06-06T08:35:05.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:05 smithi028 ceph-mon[31564]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-06-06T08:35:05.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:05 smithi037 ceph-mon[36609]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-06-06T08:35:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:06 smithi028 ceph-mon[31564]: from='client.? 172.21.15.37:0/836414877' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddea397d-d7b1-46f3-9a13-dd318cade055"}]: dispatch 2024-06-06T08:35:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:06 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddea397d-d7b1-46f3-9a13-dd318cade055"}]: dispatch 2024-06-06T08:35:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:06 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddea397d-d7b1-46f3-9a13-dd318cade055"}]': finished 2024-06-06T08:35:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:06 smithi028 ceph-mon[31564]: osdmap e30: 5 total, 4 up, 5 in 2024-06-06T08:35:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:06.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:06 smithi037 ceph-mon[36609]: from='client.? 172.21.15.37:0/836414877' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddea397d-d7b1-46f3-9a13-dd318cade055"}]: dispatch 2024-06-06T08:35:06.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:06 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddea397d-d7b1-46f3-9a13-dd318cade055"}]: dispatch 2024-06-06T08:35:06.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:06 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddea397d-d7b1-46f3-9a13-dd318cade055"}]': finished 2024-06-06T08:35:06.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:06 smithi037 ceph-mon[36609]: osdmap e30: 5 total, 4 up, 5 in 2024-06-06T08:35:06.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:06.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:06 smithi059 ceph-mon[36684]: from='client.? 172.21.15.37:0/836414877' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddea397d-d7b1-46f3-9a13-dd318cade055"}]: dispatch 2024-06-06T08:35:06.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:06 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddea397d-d7b1-46f3-9a13-dd318cade055"}]: dispatch 2024-06-06T08:35:06.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:06 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddea397d-d7b1-46f3-9a13-dd318cade055"}]': finished 2024-06-06T08:35:06.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:06 smithi059 ceph-mon[36684]: osdmap e30: 5 total, 4 up, 5 in 2024-06-06T08:35:06.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:07.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:07 smithi028 ceph-mon[31564]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:35:07.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:07 smithi028 ceph-mon[31564]: from='client.? 172.21.15.37:0/3652441404' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:35:07.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:07 smithi037 ceph-mon[36609]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:35:07.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:07 smithi037 ceph-mon[36609]: from='client.? 172.21.15.37:0/3652441404' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:35:07.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:07 smithi059 ceph-mon[36684]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:35:07.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:07 smithi059 ceph-mon[36684]: from='client.? 172.21.15.37:0/3652441404' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:35:09.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:09 smithi028 ceph-mon[31564]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-06-06T08:35:09.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:09 smithi037 ceph-mon[36609]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-06-06T08:35:09.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:09 smithi059 ceph-mon[36684]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-06-06T08:35:11.270 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:11 smithi037 ceph-mon[36609]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:11.543 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:11 smithi028 ceph-mon[31564]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:11.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:11 smithi059 ceph-mon[36684]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:13.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:13 smithi028 ceph-mon[31564]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:13.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:13 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-06T08:35:13.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:13 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:13.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:13 smithi037 ceph-mon[36609]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:13.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:13 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-06T08:35:13.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:13 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:13.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:13 smithi059 ceph-mon[36684]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:13.622 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:13 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-06T08:35:13.622 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:13 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:14.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:14 smithi028 ceph-mon[31564]: Deploying daemon osd.4 on smithi037 2024-06-06T08:35:14.497 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:14 smithi037 ceph-mon[36609]: Deploying daemon osd.4 on smithi037 2024-06-06T08:35:14.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:14 smithi059 ceph-mon[36684]: Deploying daemon osd.4 on smithi037 2024-06-06T08:35:15.522 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:15 smithi037 ceph-mon[36609]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:15.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:15 smithi028 ceph-mon[31564]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:15.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:15 smithi059 ceph-mon[36684]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:17.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:17 smithi028 ceph-mon[31564]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:17.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:17 smithi037 ceph-mon[36609]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:17.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:17 smithi059 ceph-mon[36684]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:20.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:19 smithi028 ceph-mon[31564]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:20.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:20.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:20.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:20.059 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:19 smithi037 ceph-mon[36609]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:20.059 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:20.059 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:20.059 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:19 smithi059 ceph-mon[36684]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:21.995 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:21 smithi037 ceph-mon[36609]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:21.995 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:21.995 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:21.995 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:21.995 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:21.995 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:21 smithi028 ceph-mon[31564]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:22.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:22.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:21 smithi059 ceph-mon[36684]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:22.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:22.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:22.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:22.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:22.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:22.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.668+0000 7f7867fff700 1 -- 172.21.15.37:0/3470087709 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f78700628d0 con 0x7f785c0a2ca0 2024-06-06T08:35:22.667 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 4 on host 'smithi037' 2024-06-06T08:35:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.670+0000 7f787510b700 1 -- 172.21.15.37:0/3470087709 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f785c0a2ca0 msgr2=0x7f785c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.670+0000 7f787510b700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f785c0a2ca0 0x7f785c0a5160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7868006fd0 tx=0x7f7868008040 comp rx=0 tx=0).stop 2024-06-06T08:35:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.670+0000 7f787510b700 1 -- 172.21.15.37:0/3470087709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787010a3c0 msgr2=0x7f78701a20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.670+0000 7f787510b700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787010a3c0 0x7f78701a20b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f786000b970 tx=0x7f786000bc80 comp rx=0 tx=0).stop 2024-06-06T08:35:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.671+0000 7f787510b700 1 -- 172.21.15.37:0/3470087709 shutdown_connections 2024-06-06T08:35:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.671+0000 7f787510b700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f785c0a2ca0 0x7f785c0a5160 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.671+0000 7f787510b700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787010a3c0 0x7f78701a20b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.671+0000 7f787510b700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7870074ef0 0x7f787019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.671+0000 7f787510b700 1 --2- 172.21.15.37:0/3470087709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78700764c0 0x7f787019b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.671+0000 7f787510b700 1 -- 172.21.15.37:0/3470087709 >> 172.21.15.37:0/3470087709 conn(0x7f78700fda90 msgr2=0x7f78701062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:35:22.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.671+0000 7f787510b700 1 -- 172.21.15.37:0/3470087709 shutdown_connections 2024-06-06T08:35:22.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:35:22.671+0000 7f787510b700 1 -- 172.21.15.37:0/3470087709 wait complete. 2024-06-06T08:35:22.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:22 smithi037 ceph-mon[36609]: from='osd.4 [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T08:35:22.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:22 smithi037 ceph-mon[36609]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T08:35:22.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:22.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:22.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:23.001 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:22 smithi059 ceph-mon[36684]: from='osd.4 [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T08:35:23.001 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:22 smithi059 ceph-mon[36684]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T08:35:23.002 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:23.002 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:23.002 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:23.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:22 smithi028 ceph-mon[31564]: from='osd.4 [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T08:35:23.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:22 smithi028 ceph-mon[31564]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T08:35:23.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:23.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:23.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:23.380 DEBUG:teuthology.orchestra.run.smithi037:osd.4> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.4.service 2024-06-06T08:35:23.382 INFO:tasks.cephadm:Deploying osd.5 on smithi059 with /dev/vg_nvme/lv_3... 2024-06-06T08:35:23.383 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-06T08:35:23.637 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:35:23.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:23 smithi028 ceph-mon[31564]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:23.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:23 smithi028 ceph-mon[31564]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-06T08:35:23.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:23 smithi028 ceph-mon[31564]: from='osd.4 [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:35:23.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:23 smithi028 ceph-mon[31564]: osdmap e31: 5 total, 4 up, 5 in 2024-06-06T08:35:23.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:23.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:23 smithi028 ceph-mon[31564]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:35:23.996 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:23 smithi059 ceph-mon[36684]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:23.996 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:23 smithi059 ceph-mon[36684]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-06T08:35:23.996 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:23 smithi059 ceph-mon[36684]: from='osd.4 [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:35:23.996 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:23 smithi059 ceph-mon[36684]: osdmap e31: 5 total, 4 up, 5 in 2024-06-06T08:35:23.996 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:23.996 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:23 smithi059 ceph-mon[36684]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:35:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:23 smithi037 ceph-mon[36609]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:23 smithi037 ceph-mon[36609]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-06T08:35:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:23 smithi037 ceph-mon[36609]: from='osd.4 [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:35:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:23 smithi037 ceph-mon[36609]: osdmap e31: 5 total, 4 up, 5 in 2024-06-06T08:35:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:23 smithi037 ceph-mon[36609]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:35:24.064 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:35:23 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4[48048]: 2024-06-06T08:35:23.700+0000 7f7648311700 -1 osd.4 0 waiting for initial osdmap 2024-06-06T08:35:24.064 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:35:23 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4[48048]: 2024-06-06T08:35:23.706+0000 7f7644104700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T08:35:24.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:24 smithi037 ceph-mon[36609]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:35:24.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:24 smithi037 ceph-mon[36609]: osdmap e32: 5 total, 4 up, 5 in 2024-06-06T08:35:24.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:24.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:25.025 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:24 smithi059 ceph-mon[36684]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:35:25.026 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:24 smithi059 ceph-mon[36684]: osdmap e32: 5 total, 4 up, 5 in 2024-06-06T08:35:25.026 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:25.026 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:25.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:24 smithi028 ceph-mon[31564]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:35:25.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:24 smithi028 ceph-mon[31564]: osdmap e32: 5 total, 4 up, 5 in 2024-06-06T08:35:25.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:25.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:25.741 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-06T08:35:25.742 INFO:teuthology.orchestra.run.smithi059.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-06T08:35:25.742 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10+0 records in 2024-06-06T08:35:25.742 INFO:teuthology.orchestra.run.smithi059.stderr:10+0 records out 2024-06-06T08:35:25.742 INFO:teuthology.orchestra.run.smithi059.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114499 s, 916 MB/s 2024-06-06T08:35:25.742 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping successful for: 2024-06-06T08:35:26.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:25 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:35:26.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:25 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:35:26.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:25 smithi028 ceph-mon[31564]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:26.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:25 smithi028 ceph-mon[31564]: osd.4 [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266] boot 2024-06-06T08:35:26.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:25 smithi028 ceph-mon[31564]: osdmap e33: 5 total, 5 up, 5 in 2024-06-06T08:35:26.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:25 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:35:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:25 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:35:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:25 smithi037 ceph-mon[36609]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:25 smithi037 ceph-mon[36609]: osd.4 [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266] boot 2024-06-06T08:35:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:25 smithi037 ceph-mon[36609]: osdmap e33: 5 total, 5 up, 5 in 2024-06-06T08:35:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:26.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:25 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:35:26.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:25 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:35:26.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:25 smithi059 ceph-mon[36684]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T08:35:26.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:25 smithi059 ceph-mon[36684]: osd.4 [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266] boot 2024-06-06T08:35:26.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:25 smithi059 ceph-mon[36684]: osdmap e33: 5 total, 5 up, 5 in 2024-06-06T08:35:26.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T08:35:26.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_3 2024-06-06T08:35:26.678 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:35:26.977 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:26 smithi059 ceph-mon[36684]: osdmap e34: 5 total, 5 up, 5 in 2024-06-06T08:35:26.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:26.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:26.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:26.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:26.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:26.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:26.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:26.978 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:26 smithi028 ceph-mon[31564]: osdmap e34: 5 total, 5 up, 5 in 2024-06-06T08:35:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:27.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:26 smithi037 ceph-mon[36609]: osdmap e34: 5 total, 5 up, 5 in 2024-06-06T08:35:27.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:27.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:27.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:27.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:27.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:27.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:27.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:27.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:28.028 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:27 smithi059 ceph-mon[36684]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:28.028 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:27 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi037 2024-06-06T08:35:28.028 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:27 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi037 to 8546M 2024-06-06T08:35:28.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:27 smithi028 ceph-mon[31564]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:28.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:27 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi037 2024-06-06T08:35:28.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:27 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi037 to 8546M 2024-06-06T08:35:28.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:27 smithi037 ceph-mon[36609]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:28.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:27 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi037 2024-06-06T08:35:28.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:27 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi037 to 8546M 2024-06-06T08:35:28.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.249+0000 7f2348c65700 1 -- 172.21.15.59:0/179710193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23441024f0 msgr2=0x7f2344102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:28.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.249+0000 7f2348c65700 1 --2- 172.21.15.59:0/179710193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23441024f0 0x7f2344102910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2334009990 tx=0x7f2334009ca0 comp rx=0 tx=0).stop 2024-06-06T08:35:28.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.249+0000 7f2348c65700 1 -- 172.21.15.59:0/179710193 shutdown_connections 2024-06-06T08:35:28.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.249+0000 7f2348c65700 1 --2- 172.21.15.59:0/179710193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2344104090 0x7f234410a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:28.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.249+0000 7f2348c65700 1 --2- 172.21.15.59:0/179710193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23441024f0 0x7f2344102910 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:28.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.249+0000 7f2348c65700 1 --2- 172.21.15.59:0/179710193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23441036f0 0x7f2344103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.249+0000 7f2348c65700 1 -- 172.21.15.59:0/179710193 >> 172.21.15.59:0/179710193 conn(0x7f23440fda90 msgr2=0x7f23440ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.249+0000 7f2348c65700 1 -- 172.21.15.59:0/179710193 shutdown_connections 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.249+0000 7f2348c65700 1 -- 172.21.15.59:0/179710193 wait complete. 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2348c65700 1 Processor -- start 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2348c65700 1 -- start start 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2348c65700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23441024f0 0x7f23441987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2348c65700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23441036f0 0x7f2344198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2348c65700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344104090 0x7f234419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2348c65700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f234410e160 con 0x7f23441036f0 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2348c65700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f234410dfe0 con 0x7f23441024f0 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2348c65700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f234410e2e0 con 0x7f2344104090 2024-06-06T08:35:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2342d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344104090 0x7f234419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2342d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344104090 0x7f234419fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60274/0 (socket says 172.21.15.59:60274) 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2342d9d700 1 -- 172.21.15.59:0/989189854 learned_addr learned my addr 172.21.15.59:0/989189854 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f234259c700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23441024f0 0x7f23441987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2342d9d700 1 -- 172.21.15.59:0/989189854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23441024f0 msgr2=0x7f23441987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2342d9d700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23441024f0 0x7f23441987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2342d9d700 1 -- 172.21.15.59:0/989189854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23441036f0 msgr2=0x7f2344198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2342d9d700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23441036f0 0x7f2344198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.250+0000 7f2342d9d700 1 -- 172.21.15.59:0/989189854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23441a0420 con 0x7f2344104090 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.251+0000 7f2342d9d700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344104090 0x7f234419fd80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f233c007f10 tx=0x7f233c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.251+0000 7f23337fe700 1 -- 172.21.15.59:0/989189854 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c004bb0 con 0x7f2344104090 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.251+0000 7f23337fe700 1 -- 172.21.15.59:0/989189854 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f233c004d50 con 0x7f2344104090 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.251+0000 7f2348c65700 1 -- 172.21.15.59:0/989189854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23441a0710 con 0x7f2344104090 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.251+0000 7f23337fe700 1 -- 172.21.15.59:0/989189854 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c005a60 con 0x7f2344104090 2024-06-06T08:35:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.251+0000 7f2348c65700 1 -- 172.21.15.59:0/989189854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23441a0d20 con 0x7f2344104090 2024-06-06T08:35:28.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.252+0000 7f2348c65700 1 -- 172.21.15.59:0/989189854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2344069180 con 0x7f2344104090 2024-06-06T08:35:28.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.253+0000 7f23337fe700 1 -- 172.21.15.59:0/989189854 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f233c01a020 con 0x7f2344104090 2024-06-06T08:35:28.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.253+0000 7f23337fe700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f232c0a2d20 0x7f232c0a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:28.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.254+0000 7f23337fe700 1 -- 172.21.15.59:0/989189854 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f233c0cd770 con 0x7f2344104090 2024-06-06T08:35:28.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.254+0000 7f234259c700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f232c0a2d20 0x7f232c0a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:35:28.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.255+0000 7f234259c700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f232c0a2d20 0x7f232c0a51e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2334003890 tx=0x7f2334005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:35:28.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.258+0000 7f23337fe700 1 -- 172.21.15.59:0/989189854 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f233c010070 con 0x7f2344104090 2024-06-06T08:35:28.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:28.471+0000 7f2348c65700 1 -- 172.21.15.59:0/989189854 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f23440628d0 con 0x7f232c0a2d20 2024-06-06T08:35:29.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:35:29.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:35:29.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:29.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:28 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:35:29.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:28 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:35:29.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:28 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:29.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:28 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:35:29.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:28 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:35:29.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:28 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:30.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:29 smithi028 ceph-mon[31564]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:30.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:29 smithi028 ceph-mon[31564]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:35:30.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:29 smithi037 ceph-mon[36609]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:30.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:29 smithi037 ceph-mon[36609]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:35:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:29 smithi059 ceph-mon[36684]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:30.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:29 smithi059 ceph-mon[36684]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:35:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:31 smithi028 ceph-mon[31564]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:31 smithi028 ceph-mon[31564]: from='client.? 172.21.15.59:0/2141276873' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee19857b-b047-4d15-8b17-257b6e4966a2"}]: dispatch 2024-06-06T08:35:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:31 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee19857b-b047-4d15-8b17-257b6e4966a2"}]: dispatch 2024-06-06T08:35:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:31 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee19857b-b047-4d15-8b17-257b6e4966a2"}]': finished 2024-06-06T08:35:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:31 smithi028 ceph-mon[31564]: osdmap e35: 6 total, 5 up, 6 in 2024-06-06T08:35:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:31 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:32.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:31 smithi037 ceph-mon[36609]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:32.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:31 smithi037 ceph-mon[36609]: from='client.? 172.21.15.59:0/2141276873' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee19857b-b047-4d15-8b17-257b6e4966a2"}]: dispatch 2024-06-06T08:35:32.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:31 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee19857b-b047-4d15-8b17-257b6e4966a2"}]: dispatch 2024-06-06T08:35:32.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:31 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee19857b-b047-4d15-8b17-257b6e4966a2"}]': finished 2024-06-06T08:35:32.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:31 smithi037 ceph-mon[36609]: osdmap e35: 6 total, 5 up, 6 in 2024-06-06T08:35:32.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:31 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:32.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:31 smithi059 ceph-mon[36684]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:32.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:31 smithi059 ceph-mon[36684]: from='client.? 172.21.15.59:0/2141276873' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee19857b-b047-4d15-8b17-257b6e4966a2"}]: dispatch 2024-06-06T08:35:32.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:31 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee19857b-b047-4d15-8b17-257b6e4966a2"}]: dispatch 2024-06-06T08:35:32.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:31 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee19857b-b047-4d15-8b17-257b6e4966a2"}]': finished 2024-06-06T08:35:32.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:31 smithi059 ceph-mon[36684]: osdmap e35: 6 total, 5 up, 6 in 2024-06-06T08:35:32.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:31 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:33.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:32 smithi028 ceph-mon[31564]: from='client.? 172.21.15.59:0/3137044890' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:35:33.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:32 smithi037 ceph-mon[36609]: from='client.? 172.21.15.59:0/3137044890' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:35:33.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:32 smithi059 ceph-mon[36684]: from='client.? 172.21.15.59:0/3137044890' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:35:34.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:33 smithi028 ceph-mon[31564]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:34.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:33 smithi037 ceph-mon[36609]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:34.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:33 smithi059 ceph-mon[36684]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:36.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:35 smithi028 ceph-mon[31564]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:36.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:35 smithi037 ceph-mon[36609]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:36.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:35 smithi059 ceph-mon[36684]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:38.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:37 smithi028 ceph-mon[31564]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:38.063 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:37 smithi059 ceph-mon[36684]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:38.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:37 smithi037 ceph-mon[36609]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:39.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:38 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-06T08:35:39.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:38 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:39.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:38 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-06T08:35:39.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:38 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:39.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:38 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-06T08:35:39.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:38 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:39.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:39 smithi059 ceph-mon[36684]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:39.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:39 smithi059 ceph-mon[36684]: Deploying daemon osd.5 on smithi059 2024-06-06T08:35:40.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:39 smithi037 ceph-mon[36609]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:40.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:39 smithi037 ceph-mon[36609]: Deploying daemon osd.5 on smithi059 2024-06-06T08:35:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:39 smithi028 ceph-mon[31564]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:40.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:39 smithi028 ceph-mon[31564]: Deploying daemon osd.5 on smithi059 2024-06-06T08:35:41.991 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:41 smithi059 ceph-mon[36684]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:41 smithi037 ceph-mon[36609]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:42.093 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:41 smithi028 ceph-mon[31564]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:44.053 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:43 smithi059 ceph-mon[36684]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:44.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:43 smithi037 ceph-mon[36609]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:44.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:43 smithi028 ceph-mon[31564]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:45.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:45.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:45.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:45 smithi028 ceph-mon[31564]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:45.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:45.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:45.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:45.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:45 smithi037 ceph-mon[36609]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:45.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:45.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:45.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:45.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:45 smithi059 ceph-mon[36684]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:45.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:47.524 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:47 smithi059 ceph-mon[36684]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:47.524 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:47.524 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:47.524 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:47.524 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:47.524 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:47.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:47 smithi028 ceph-mon[31564]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:47.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:47.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:47.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:47.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:47.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:47.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:47 smithi037 ceph-mon[36609]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:47.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:47.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:47.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:47.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:47.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:47.857 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 5 on host 'smithi059' 2024-06-06T08:35:47.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.857+0000 7f23337fe700 1 -- 172.21.15.59:0/989189854 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f23440628d0 con 0x7f232c0a2d20 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.859+0000 7f2348c65700 1 -- 172.21.15.59:0/989189854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f232c0a2d20 msgr2=0x7f232c0a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.859+0000 7f2348c65700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f232c0a2d20 0x7f232c0a51e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2334003890 tx=0x7f2334005fd0 comp rx=0 tx=0).stop 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.859+0000 7f2348c65700 1 -- 172.21.15.59:0/989189854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344104090 msgr2=0x7f234419fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.859+0000 7f2348c65700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344104090 0x7f234419fd80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f233c007f10 tx=0x7f233c00d3b0 comp rx=0 tx=0).stop 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.860+0000 7f2348c65700 1 -- 172.21.15.59:0/989189854 shutdown_connections 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.860+0000 7f2348c65700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f232c0a2d20 0x7f232c0a51e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.860+0000 7f2348c65700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344104090 0x7f234419fd80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.860+0000 7f2348c65700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23441024f0 0x7f23441987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.860+0000 7f2348c65700 1 --2- 172.21.15.59:0/989189854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23441036f0 0x7f2344198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.860+0000 7f2348c65700 1 -- 172.21.15.59:0/989189854 >> 172.21.15.59:0/989189854 conn(0x7f23440fda90 msgr2=0x7f2344106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.860+0000 7f2348c65700 1 -- 172.21.15.59:0/989189854 shutdown_connections 2024-06-06T08:35:47.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:35:47.860+0000 7f2348c65700 1 -- 172.21.15.59:0/989189854 wait complete. 2024-06-06T08:35:48.429 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:48 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:48.429 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:48 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:48.429 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:48 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:48.429 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:48 smithi059 ceph-mon[36684]: from='osd.5 [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T08:35:48.429 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:48 smithi059 ceph-mon[36684]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T08:35:48.457 DEBUG:teuthology.orchestra.run.smithi059:osd.5> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.5.service 2024-06-06T08:35:48.459 INFO:tasks.cephadm:Deploying osd.6 on smithi028 with /dev/vg_nvme/lv_2... 2024-06-06T08:35:48.459 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-06T08:35:48.539 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:48 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:48.539 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:48 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:48.539 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:48 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:48.539 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:48 smithi028 ceph-mon[31564]: from='osd.5 [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T08:35:48.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:48 smithi028 ceph-mon[31564]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T08:35:48.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:48 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:35:48.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:48 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:48.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:48 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:48.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:48 smithi037 ceph-mon[36609]: from='osd.5 [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T08:35:48.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:48 smithi037 ceph-mon[36609]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T08:35:48.925 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:35:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:49 smithi059 ceph-mon[36684]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:49 smithi059 ceph-mon[36684]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-06T08:35:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:49 smithi059 ceph-mon[36684]: from='osd.5 [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:35:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:49 smithi059 ceph-mon[36684]: osdmap e36: 6 total, 5 up, 6 in 2024-06-06T08:35:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:50.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:49 smithi059 ceph-mon[36684]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:35:50.101 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:35:49 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:35:49.849+0000 7ff8c9e83700 -1 osd.5 0 waiting for initial osdmap 2024-06-06T08:35:50.101 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:35:49 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:35:49.860+0000 7ff8c5c76700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T08:35:50.118 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:49 smithi028 ceph-mon[31564]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:50.118 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:49 smithi028 ceph-mon[31564]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-06T08:35:50.118 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:49 smithi028 ceph-mon[31564]: from='osd.5 [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:35:50.118 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:49 smithi028 ceph-mon[31564]: osdmap e36: 6 total, 5 up, 6 in 2024-06-06T08:35:50.119 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:50.119 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:49 smithi028 ceph-mon[31564]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:35:50.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:49 smithi037 ceph-mon[36609]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:50.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:49 smithi037 ceph-mon[36609]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-06T08:35:50.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:49 smithi037 ceph-mon[36609]: from='osd.5 [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:35:50.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:49 smithi037 ceph-mon[36609]: osdmap e36: 6 total, 5 up, 6 in 2024-06-06T08:35:50.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:49 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:50.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:49 smithi037 ceph-mon[36609]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:35:51.026 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:50 smithi059 ceph-mon[36684]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:35:51.027 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:50 smithi059 ceph-mon[36684]: osdmap e37: 6 total, 5 up, 6 in 2024-06-06T08:35:51.027 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:50 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:51.027 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:50 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:51.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:50 smithi028 ceph-mon[31564]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:35:51.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:50 smithi028 ceph-mon[31564]: osdmap e37: 6 total, 5 up, 6 in 2024-06-06T08:35:51.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:50 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:51.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:50 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:51.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:50 smithi037 ceph-mon[36609]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:35:51.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:50 smithi037 ceph-mon[36609]: osdmap e37: 6 total, 5 up, 6 in 2024-06-06T08:35:51.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:50 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:51.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:50 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:52.066 INFO:teuthology.orchestra.run.smithi028.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-06T08:35:52.066 INFO:teuthology.orchestra.run.smithi028.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-06T08:35:52.066 INFO:teuthology.orchestra.run.smithi028.stderr: stderr: 10+0 records in 2024-06-06T08:35:52.066 INFO:teuthology.orchestra.run.smithi028.stderr:10+0 records out 2024-06-06T08:35:52.066 INFO:teuthology.orchestra.run.smithi028.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0521247 s, 201 MB/s 2024-06-06T08:35:52.066 INFO:teuthology.orchestra.run.smithi028.stderr:--> Zapping successful for: 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: osd.5 [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282] boot 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: osdmap e38: 6 total, 6 up, 6 in 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.067 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:52.068 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:52.068 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:35:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:35:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: osd.5 [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282] boot 2024-06-06T08:35:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: osdmap e38: 6 total, 6 up, 6 in 2024-06-06T08:35:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:52.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:35:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:35:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-06T08:35:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: osd.5 [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282] boot 2024-06-06T08:35:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: osdmap e38: 6 total, 6 up, 6 in 2024-06-06T08:35:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T08:35:52.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:52.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:35:52.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:52.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:35:52.351 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:35:52.984 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi028:vg_nvme/lv_2 2024-06-06T08:35:53.146 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:52 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi059 2024-06-06T08:35:53.146 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:52 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi059 to 8546M 2024-06-06T08:35:53.146 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:52 smithi028 ceph-mon[31564]: osdmap e39: 6 total, 6 up, 6 in 2024-06-06T08:35:53.258 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:52 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi059 2024-06-06T08:35:53.258 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:52 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi059 to 8546M 2024-06-06T08:35:53.258 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:52 smithi059 ceph-mon[36684]: osdmap e39: 6 total, 6 up, 6 in 2024-06-06T08:35:53.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:52 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi059 2024-06-06T08:35:53.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:52 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi059 to 8546M 2024-06-06T08:35:53.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:52 smithi037 ceph-mon[36609]: osdmap e39: 6 total, 6 up, 6 in 2024-06-06T08:35:53.422 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:35:54.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:53 smithi028 ceph-mon[31564]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:35:54.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:53 smithi028 ceph-mon[31564]: osdmap e40: 6 total, 6 up, 6 in 2024-06-06T08:35:54.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:53 smithi028 ceph-mon[31564]: osdmap e41: 6 total, 6 up, 6 in 2024-06-06T08:35:54.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:53 smithi037 ceph-mon[36609]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:35:54.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:53 smithi037 ceph-mon[36609]: osdmap e40: 6 total, 6 up, 6 in 2024-06-06T08:35:54.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:53 smithi037 ceph-mon[36609]: osdmap e41: 6 total, 6 up, 6 in 2024-06-06T08:35:54.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:53 smithi059 ceph-mon[36684]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:35:54.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:53 smithi059 ceph-mon[36684]: osdmap e40: 6 total, 6 up, 6 in 2024-06-06T08:35:54.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:53 smithi059 ceph-mon[36684]: osdmap e41: 6 total, 6 up, 6 in 2024-06-06T08:35:55.480 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:55 smithi028 ceph-mon[31564]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:35:55.480 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:55 smithi028 ceph-mon[31564]: osdmap e42: 6 total, 6 up, 6 in 2024-06-06T08:35:55.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:55 smithi037 ceph-mon[36609]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:35:55.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:55 smithi037 ceph-mon[36609]: osdmap e42: 6 total, 6 up, 6 in 2024-06-06T08:35:55.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:55 smithi059 ceph-mon[36684]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:35:55.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:55 smithi059 ceph-mon[36684]: osdmap e42: 6 total, 6 up, 6 in 2024-06-06T08:35:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.659+0000 7f2582800700 1 -- 172.21.15.28:0/3289361124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257c102500 msgr2=0x7f257c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.659+0000 7f2582800700 1 --2- 172.21.15.28:0/3289361124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257c102500 0x7f257c102920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f256c009fc0 tx=0x7f256c00b330 comp rx=0 tx=0).stop 2024-06-06T08:35:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.659+0000 7f2582800700 1 -- 172.21.15.28:0/3289361124 shutdown_connections 2024-06-06T08:35:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.659+0000 7f2582800700 1 --2- 172.21.15.28:0/3289361124 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f257c1040a0 0x7f257c10a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.659+0000 7f2582800700 1 --2- 172.21.15.28:0/3289361124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257c102500 0x7f257c102920 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.659+0000 7f2582800700 1 --2- 172.21.15.28:0/3289361124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f257c103700 0x7f257c103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.659+0000 7f2582800700 1 -- 172.21.15.28:0/3289361124 >> 172.21.15.28:0/3289361124 conn(0x7f257c0fda60 msgr2=0x7f257c0ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:35:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.659+0000 7f2582800700 1 -- 172.21.15.28:0/3289361124 shutdown_connections 2024-06-06T08:35:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.659+0000 7f2582800700 1 -- 172.21.15.28:0/3289361124 wait complete. 2024-06-06T08:35:55.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.661+0000 7f2582800700 1 Processor -- start 2024-06-06T08:35:55.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.661+0000 7f2582800700 1 -- start start 2024-06-06T08:35:55.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.661+0000 7f2582800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257c102500 0x7f257c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:55.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.661+0000 7f2582800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f257c103700 0x7f257c19af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:55.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.661+0000 7f2582800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f257c1040a0 0x7f257c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:55.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.661+0000 7f2582800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f257c10e120 con 0x7f257c1040a0 2024-06-06T08:35:55.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.661+0000 7f2582800700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f257c10dfa0 con 0x7f257c102500 2024-06-06T08:35:55.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.661+0000 7f2582800700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f257c10e2a0 con 0x7f257c103700 2024-06-06T08:35:55.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257b400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257c102500 0x7f257c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:35:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f257c1040a0 0x7f257c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:35:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257b400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257c102500 0x7f257c19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:34258/0 (socket says 172.21.15.28:34258) 2024-06-06T08:35:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f2572a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f257c103700 0x7f257c19af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:35:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257b400700 1 -- 172.21.15.28:0/1249313250 learned_addr learned my addr 172.21.15.28:0/1249313250 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:35:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f257c1040a0 0x7f257c1a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36696/0 (socket says 172.21.15.28:36696) 2024-06-06T08:35:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257b400700 1 -- 172.21.15.28:0/1249313250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f257c103700 msgr2=0x7f257c19af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257b400700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f257c103700 0x7f257c19af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257b400700 1 -- 172.21.15.28:0/1249313250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f257c1040a0 msgr2=0x7f257c1a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:35:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257b400700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f257c1040a0 0x7f257c1a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:35:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257b400700 1 -- 172.21.15.28:0/1249313250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257c1a2630 con 0x7f257c102500 2024-06-06T08:35:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257be00700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f257c1040a0 0x7f257c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:35:55.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.662+0000 7f257b400700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257c102500 0x7f257c19a9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f256c007c50 tx=0x7f256c007c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:35:55.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.663+0000 7f2578c00700 1 -- 172.21.15.28:0/1249313250 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c021020 con 0x7f257c102500 2024-06-06T08:35:55.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.663+0000 7f2578c00700 1 -- 172.21.15.28:0/1249313250 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f256c01d950 con 0x7f257c102500 2024-06-06T08:35:55.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.663+0000 7f2582800700 1 -- 172.21.15.28:0/1249313250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f257c1a28c0 con 0x7f257c102500 2024-06-06T08:35:55.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.663+0000 7f2578c00700 1 -- 172.21.15.28:0/1249313250 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c005290 con 0x7f257c102500 2024-06-06T08:35:55.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.663+0000 7f2582800700 1 -- 172.21.15.28:0/1249313250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f257c1a2d70 con 0x7f257c102500 2024-06-06T08:35:55.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.664+0000 7f2582800700 1 -- 172.21.15.28:0/1249313250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f257c069180 con 0x7f257c102500 2024-06-06T08:35:55.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.666+0000 7f2578c00700 1 -- 172.21.15.28:0/1249313250 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f256c024020 con 0x7f257c102500 2024-06-06T08:35:55.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.667+0000 7f2578c00700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f25600a2c20 0x7f25600a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:35:55.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.668+0000 7f2578c00700 1 -- 172.21.15.28:0/1249313250 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4533+0+0 (secure 0 0 0) 0x7f256c00f020 con 0x7f257c102500 2024-06-06T08:35:55.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.668+0000 7f2572a00700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f25600a2c20 0x7f25600a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:35:55.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.668+0000 7f2572a00700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f25600a2c20 0x7f25600a50e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2564009750 tx=0x7f2564009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:35:55.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.672+0000 7f2578c00700 1 -- 172.21.15.28:0/1249313250 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f256c09d1c0 con 0x7f257c102500 2024-06-06T08:35:55.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:35:55.911+0000 7f2582800700 1 -- 172.21.15.28:0/1249313250 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f257c075de0 con 0x7f25600a2c20 2024-06-06T08:35:56.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:35:56.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:35:56.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:56.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:35:56.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:35:56.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:56.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:35:56.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:35:56.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:35:57.239 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:57 smithi028 ceph-mon[31564]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:35:57.239 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:57 smithi028 ceph-mon[31564]: pgmap v160: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:35:57.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:57 smithi037 ceph-mon[36609]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:35:57.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:57 smithi037 ceph-mon[36609]: pgmap v160: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:35:57.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:57 smithi059 ceph-mon[36684]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:35:57.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:57 smithi059 ceph-mon[36684]: pgmap v160: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:35:59.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:35:59 smithi028 ceph-mon[31564]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:35:59.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:35:59 smithi037 ceph-mon[36609]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:35:59.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:35:59 smithi059 ceph-mon[36684]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:36:00.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:00 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/3299415469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d57d0ba-8e37-4ac2-87e8-40b20b24fc53"}]: dispatch 2024-06-06T08:36:00.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:00 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/3299415469' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d57d0ba-8e37-4ac2-87e8-40b20b24fc53"}]': finished 2024-06-06T08:36:00.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:00 smithi028 ceph-mon[31564]: osdmap e43: 7 total, 6 up, 7 in 2024-06-06T08:36:00.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:00 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:00.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:00 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/3299415469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d57d0ba-8e37-4ac2-87e8-40b20b24fc53"}]: dispatch 2024-06-06T08:36:00.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:00 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/3299415469' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d57d0ba-8e37-4ac2-87e8-40b20b24fc53"}]': finished 2024-06-06T08:36:00.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:00 smithi037 ceph-mon[36609]: osdmap e43: 7 total, 6 up, 7 in 2024-06-06T08:36:00.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:00 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:00.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:00 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/3299415469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d57d0ba-8e37-4ac2-87e8-40b20b24fc53"}]: dispatch 2024-06-06T08:36:00.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:00 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/3299415469' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d57d0ba-8e37-4ac2-87e8-40b20b24fc53"}]': finished 2024-06-06T08:36:00.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:00 smithi059 ceph-mon[36684]: osdmap e43: 7 total, 6 up, 7 in 2024-06-06T08:36:00.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:00 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:01.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:01 smithi028 ceph-mon[31564]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-06-06T08:36:01.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:01 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/372894161' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:36:01.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:01 smithi037 ceph-mon[36609]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-06-06T08:36:01.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:01 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/372894161' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:36:01.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:01 smithi059 ceph-mon[36684]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-06-06T08:36:01.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:01 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/372894161' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:36:03.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:03 smithi028 ceph-mon[31564]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T08:36:03.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:03 smithi037 ceph-mon[36609]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T08:36:03.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:03 smithi059 ceph-mon[36684]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T08:36:05.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:05 smithi028 ceph-mon[31564]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T08:36:05.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:05 smithi037 ceph-mon[36609]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T08:36:05.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:05 smithi059 ceph-mon[36684]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T08:36:07.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:07 smithi028 ceph-mon[31564]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T08:36:07.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:07 smithi037 ceph-mon[36609]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T08:36:07.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:07 smithi059 ceph-mon[36684]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T08:36:09.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:09 smithi028 ceph-mon[31564]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:09.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:09 smithi037 ceph-mon[36609]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:09.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:09 smithi059 ceph-mon[36684]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:10.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-06T08:36:10.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:10.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:10 smithi028 ceph-mon[31564]: Deploying daemon osd.6 on smithi028 2024-06-06T08:36:10.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:10 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-06T08:36:10.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:10 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:10.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:10 smithi037 ceph-mon[36609]: Deploying daemon osd.6 on smithi028 2024-06-06T08:36:10.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:10 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-06T08:36:10.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:10 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:10.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:10 smithi059 ceph-mon[36684]: Deploying daemon osd.6 on smithi028 2024-06-06T08:36:11.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:11 smithi028 ceph-mon[31564]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:11.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:11 smithi037 ceph-mon[36609]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:11.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:11 smithi059 ceph-mon[36684]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:13.493 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:13 smithi028 ceph-mon[31564]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:13.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:13 smithi037 ceph-mon[36609]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:13.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:13 smithi059 ceph-mon[36684]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:15.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:15 smithi028 ceph-mon[31564]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:15.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:15 smithi037 ceph-mon[36609]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:15.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:15 smithi059 ceph-mon[36684]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:17.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:17 smithi028 ceph-mon[31564]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:17.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:17 smithi037 ceph-mon[36609]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:17.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:17 smithi059 ceph-mon[36684]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:19.498 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:19 smithi028 ceph-mon[31564]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:19.498 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:19.498 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:19.498 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:19.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:19 smithi037 ceph-mon[36609]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:19.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:19.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:19.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:19.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:19 smithi059 ceph-mon[36684]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:19.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:19.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:19.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:21.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:21 smithi028 ceph-mon[31564]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:21.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:21 smithi037 ceph-mon[36609]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:21.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:21 smithi059 ceph-mon[36684]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:22.505 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:22 smithi028 ceph-mon[31564]: from='osd.6 [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T08:36:22.505 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:22 smithi028 ceph-mon[31564]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T08:36:22.505 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:22.505 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:22.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:22 smithi037 ceph-mon[36609]: from='osd.6 [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T08:36:22.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:22 smithi037 ceph-mon[36609]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T08:36:22.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:22.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:22.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:22 smithi059 ceph-mon[36684]: from='osd.6 [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T08:36:22.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:22 smithi059 ceph-mon[36684]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T08:36:22.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:22.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:23.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.069+0000 7f2578c00700 1 -- 172.21.15.28:0/1249313250 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f257c075de0 con 0x7f25600a2c20 2024-06-06T08:36:23.070 INFO:teuthology.orchestra.run.smithi028.stdout:Created osd(s) 6 on host 'smithi028' 2024-06-06T08:36:23.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.073+0000 7f2582800700 1 -- 172.21.15.28:0/1249313250 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f25600a2c20 msgr2=0x7f25600a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:36:23.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.073+0000 7f2582800700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f25600a2c20 0x7f25600a50e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2564009750 tx=0x7f2564009310 comp rx=0 tx=0).stop 2024-06-06T08:36:23.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.073+0000 7f2582800700 1 -- 172.21.15.28:0/1249313250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257c102500 msgr2=0x7f257c19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:36:23.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.073+0000 7f2582800700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257c102500 0x7f257c19a9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f256c007c50 tx=0x7f256c007c80 comp rx=0 tx=0).stop 2024-06-06T08:36:23.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.073+0000 7f2582800700 1 -- 172.21.15.28:0/1249313250 shutdown_connections 2024-06-06T08:36:23.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.073+0000 7f2582800700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f25600a2c20 0x7f25600a50e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:23.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.073+0000 7f2582800700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f257c1040a0 0x7f257c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:23.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.073+0000 7f2582800700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257c102500 0x7f257c19a9d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:23.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.073+0000 7f2582800700 1 --2- 172.21.15.28:0/1249313250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f257c103700 0x7f257c19af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:23.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.073+0000 7f2582800700 1 -- 172.21.15.28:0/1249313250 >> 172.21.15.28:0/1249313250 conn(0x7f257c0fda60 msgr2=0x7f257c0746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:36:23.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.073+0000 7f2582800700 1 -- 172.21.15.28:0/1249313250 shutdown_connections 2024-06-06T08:36:23.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:36:23.074+0000 7f2582800700 1 -- 172.21.15.28:0/1249313250 wait complete. 2024-06-06T08:36:23.516 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:23 smithi028 ceph-mon[31564]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:23.516 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:23 smithi028 ceph-mon[31564]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-06T08:36:23.516 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:23 smithi028 ceph-mon[31564]: osdmap e44: 7 total, 6 up, 7 in 2024-06-06T08:36:23.516 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:23.516 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:23 smithi028 ceph-mon[31564]: from='osd.6 [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:36:23.516 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:23 smithi028 ceph-mon[31564]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:36:23.516 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:23.517 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:23.517 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:23 smithi059 ceph-mon[36684]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:23.517 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:23 smithi059 ceph-mon[36684]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-06T08:36:23.517 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:23 smithi059 ceph-mon[36684]: osdmap e44: 7 total, 6 up, 7 in 2024-06-06T08:36:23.517 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:23.517 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:23 smithi059 ceph-mon[36684]: from='osd.6 [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:36:23.517 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:23 smithi059 ceph-mon[36684]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:36:23.517 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:23.517 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:23.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:23 smithi037 ceph-mon[36609]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:23.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:23 smithi037 ceph-mon[36609]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-06T08:36:23.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:23 smithi037 ceph-mon[36609]: osdmap e44: 7 total, 6 up, 7 in 2024-06-06T08:36:23.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:23.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:23 smithi037 ceph-mon[36609]: from='osd.6 [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:36:23.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:23 smithi037 ceph-mon[36609]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:36:23.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:23.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:23.930 DEBUG:teuthology.orchestra.run.smithi028:osd.6> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.6.service 2024-06-06T08:36:23.935 INFO:tasks.cephadm:Deploying osd.7 on smithi037 with /dev/vg_nvme/lv_2... 2024-06-06T08:36:23.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-06T08:36:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:36:24.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:24 smithi028 ceph-mon[31564]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:36:24.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:24 smithi028 ceph-mon[31564]: osdmap e45: 7 total, 6 up, 7 in 2024-06-06T08:36:24.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:24.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:24.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:24 smithi028 ceph-mon[31564]: from='osd.6 ' entity='osd.6' 2024-06-06T08:36:24.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:24 smithi037 ceph-mon[36609]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:36:24.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:24 smithi037 ceph-mon[36609]: osdmap e45: 7 total, 6 up, 7 in 2024-06-06T08:36:24.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:24.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:24.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:24 smithi037 ceph-mon[36609]: from='osd.6 ' entity='osd.6' 2024-06-06T08:36:24.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:24 smithi059 ceph-mon[36684]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:36:24.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:24 smithi059 ceph-mon[36684]: osdmap e45: 7 total, 6 up, 7 in 2024-06-06T08:36:24.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:24.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:24.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:24 smithi059 ceph-mon[36684]: from='osd.6 ' entity='osd.6' 2024-06-06T08:36:25.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:25 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:36:25.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:25 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:36:25.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:25 smithi028 ceph-mon[31564]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:25.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:25.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:25 smithi028 ceph-mon[31564]: osd.6 [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886] boot 2024-06-06T08:36:25.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:25 smithi028 ceph-mon[31564]: osdmap e46: 7 total, 7 up, 7 in 2024-06-06T08:36:25.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:25.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:25 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:36:25.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:25 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:36:25.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:25 smithi037 ceph-mon[36609]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:25.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:25.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:25 smithi037 ceph-mon[36609]: osd.6 [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886] boot 2024-06-06T08:36:25.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:25 smithi037 ceph-mon[36609]: osdmap e46: 7 total, 7 up, 7 in 2024-06-06T08:36:25.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:25.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:25 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:36:25.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:25 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:36:25.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:25 smithi059 ceph-mon[36684]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-06-06T08:36:25.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:25.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:25 smithi059 ceph-mon[36684]: osd.6 [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886] boot 2024-06-06T08:36:25.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:25 smithi059 ceph-mon[36684]: osdmap e46: 7 total, 7 up, 7 in 2024-06-06T08:36:25.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T08:36:26.548 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-06T08:36:26.548 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-06T08:36:26.548 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2024-06-06T08:36:26.548 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2024-06-06T08:36:26.548 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011416 s, 919 MB/s 2024-06-06T08:36:26.548 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2024-06-06T08:36:27.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:26 smithi028 ceph-mon[31564]: osdmap e47: 7 total, 7 up, 7 in 2024-06-06T08:36:27.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:26 smithi028 ceph-mon[31564]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:27.293 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:26 smithi037 ceph-mon[36609]: osdmap e47: 7 total, 7 up, 7 in 2024-06-06T08:36:27.293 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:26 smithi037 ceph-mon[36609]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:27.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_2 2024-06-06T08:36:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:26 smithi059 ceph-mon[36684]: osdmap e47: 7 total, 7 up, 7 in 2024-06-06T08:36:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:26 smithi059 ceph-mon[36684]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:27.564 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:36:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.230+0000 7fc7a392e700 1 -- 172.21.15.37:0/1023089794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c10a3f0 msgr2=0x7fc79c10c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:36:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.230+0000 7fc7a392e700 1 --2- 172.21.15.37:0/1023089794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c10a3f0 0x7fc79c10c860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc79400b0a0 tx=0x7fc79400b3b0 comp rx=0 tx=0).stop 2024-06-06T08:36:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.230+0000 7fc7a392e700 1 -- 172.21.15.37:0/1023089794 shutdown_connections 2024-06-06T08:36:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.230+0000 7fc7a392e700 1 --2- 172.21.15.37:0/1023089794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c10a3f0 0x7fc79c10c860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.230+0000 7fc7a392e700 1 --2- 172.21.15.37:0/1023089794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc79c076440 0x7fc79c0748a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.230+0000 7fc7a392e700 1 --2- 172.21.15.37:0/1023089794 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc79c074e70 0x7fc79c0752f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.230+0000 7fc7a392e700 1 -- 172.21.15.37:0/1023089794 >> 172.21.15.37:0/1023089794 conn(0x7fc79c0fda90 msgr2=0x7fc79c0ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:36:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.230+0000 7fc7a392e700 1 -- 172.21.15.37:0/1023089794 shutdown_connections 2024-06-06T08:36:29.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.230+0000 7fc7a392e700 1 -- 172.21.15.37:0/1023089794 wait complete. 2024-06-06T08:36:29.231 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:29 smithi037 ceph-mon[36609]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:29.231 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:29 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a392e700 1 Processor -- start 2024-06-06T08:36:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a392e700 1 -- start start 2024-06-06T08:36:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a392e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc79c074e70 0x7fc79c19a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:36:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a392e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c076440 0x7fc79c19ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:36:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a392e700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc79c10a3f0 0x7fc79c1a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:36:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a392e700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c110380 con 0x7fc79c10a3f0 2024-06-06T08:36:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a392e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c110200 con 0x7fc79c076440 2024-06-06T08:36:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a392e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c110500 con 0x7fc79c074e70 2024-06-06T08:36:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a0ec9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c076440 0x7fc79c19ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a0ec9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c076440 0x7fc79c19ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34514/0 (socket says 172.21.15.37:34514) 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a0ec9700 1 -- 172.21.15.37:0/4072033247 learned_addr learned my addr 172.21.15.37:0/4072033247 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.231+0000 7fc7a16ca700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc79c074e70 0x7fc79c19a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.232+0000 7fc7a0ec9700 1 -- 172.21.15.37:0/4072033247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc79c074e70 msgr2=0x7fc79c19a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.232+0000 7fc7a0ec9700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc79c074e70 0x7fc79c19a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.232+0000 7fc7a0ec9700 1 -- 172.21.15.37:0/4072033247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc79c10a3f0 msgr2=0x7fc79c1a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.232+0000 7fc7a0ec9700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc79c10a3f0 0x7fc79c1a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.232+0000 7fc7a0ec9700 1 -- 172.21.15.37:0/4072033247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79c1a25a0 con 0x7fc79c076440 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.232+0000 7fc7a0ec9700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c076440 0x7fc79c19ae80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00b530 tx=0x7fc78c00b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.232+0000 7fc7927fc700 1 -- 172.21.15.37:0/4072033247 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c015020 con 0x7fc79c076440 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.232+0000 7fc7a392e700 1 -- 172.21.15.37:0/4072033247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79c1a2890 con 0x7fc79c076440 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.232+0000 7fc7927fc700 1 -- 172.21.15.37:0/4072033247 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc78c011d10 con 0x7fc79c076440 2024-06-06T08:36:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.232+0000 7fc7927fc700 1 -- 172.21.15.37:0/4072033247 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c00f2e0 con 0x7fc79c076440 2024-06-06T08:36:29.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.232+0000 7fc7a392e700 1 -- 172.21.15.37:0/4072033247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79c1a2dd0 con 0x7fc79c076440 2024-06-06T08:36:29.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.233+0000 7fc7a392e700 1 -- 172.21.15.37:0/4072033247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79c069180 con 0x7fc79c076440 2024-06-06T08:36:29.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.234+0000 7fc7927fc700 1 -- 172.21.15.37:0/4072033247 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc78c018020 con 0x7fc79c076440 2024-06-06T08:36:29.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.235+0000 7fc7927fc700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc7880a2c20 0x7fc7880a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:36:29.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.235+0000 7fc7927fc700 1 -- 172.21.15.37:0/4072033247 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7fc78c0cdb80 con 0x7fc79c076440 2024-06-06T08:36:29.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.235+0000 7fc7a16ca700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc7880a2c20 0x7fc7880a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:36:29.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.237+0000 7fc7a16ca700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc7880a2c20 0x7fc7880a50e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc798005950 tx=0x7fc7980058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:36:29.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.239+0000 7fc7927fc700 1 -- 172.21.15.37:0/4072033247 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc78c01f020 con 0x7fc79c076440 2024-06-06T08:36:29.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:29.457+0000 7fc7a392e700 1 -- 172.21.15.37:0/4072033247 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc79c0628d0 con 0x7fc7880a2c20 2024-06-06T08:36:29.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:29 smithi028 ceph-mon[31564]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:29.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:29 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:29.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:29 smithi059 ceph-mon[36684]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:29.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:29 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.396 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi028 2024-06-06T08:36:30.414 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.414 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:30.414 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:30.414 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:30.414 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi028 to 5698M 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:30.415 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi028 2024-06-06T08:36:30.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:30.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:30.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi028 to 5698M 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:30.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi028 2024-06-06T08:36:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi028 to 5698M 2024-06-06T08:36:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:30.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:30.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:36:30.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:36:30.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:36:30.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:30.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:30.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:30.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:30.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:31.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:31 smithi028 ceph-mon[31564]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:31.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:31 smithi037 ceph-mon[36609]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:31.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:31 smithi059 ceph-mon[36684]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:32 smithi028 ceph-mon[31564]: from='client.? 172.21.15.37:0/1451756822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43f3c2c8-752d-4a70-99dd-2c14aeefa137"}]: dispatch 2024-06-06T08:36:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:32 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43f3c2c8-752d-4a70-99dd-2c14aeefa137"}]: dispatch 2024-06-06T08:36:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:32 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43f3c2c8-752d-4a70-99dd-2c14aeefa137"}]': finished 2024-06-06T08:36:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:32 smithi028 ceph-mon[31564]: osdmap e48: 8 total, 7 up, 8 in 2024-06-06T08:36:32.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:32 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:32.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:32 smithi037 ceph-mon[36609]: from='client.? 172.21.15.37:0/1451756822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43f3c2c8-752d-4a70-99dd-2c14aeefa137"}]: dispatch 2024-06-06T08:36:32.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:32 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43f3c2c8-752d-4a70-99dd-2c14aeefa137"}]: dispatch 2024-06-06T08:36:32.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:32 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43f3c2c8-752d-4a70-99dd-2c14aeefa137"}]': finished 2024-06-06T08:36:32.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:32 smithi037 ceph-mon[36609]: osdmap e48: 8 total, 7 up, 8 in 2024-06-06T08:36:32.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:32 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:32.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:32 smithi059 ceph-mon[36684]: from='client.? 172.21.15.37:0/1451756822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43f3c2c8-752d-4a70-99dd-2c14aeefa137"}]: dispatch 2024-06-06T08:36:32.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:32 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43f3c2c8-752d-4a70-99dd-2c14aeefa137"}]: dispatch 2024-06-06T08:36:32.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:32 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43f3c2c8-752d-4a70-99dd-2c14aeefa137"}]': finished 2024-06-06T08:36:32.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:32 smithi059 ceph-mon[36684]: osdmap e48: 8 total, 7 up, 8 in 2024-06-06T08:36:32.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:32 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:33.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:33 smithi028 ceph-mon[31564]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:33.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:33 smithi028 ceph-mon[31564]: from='client.? 172.21.15.37:0/4239703943' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:36:33.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:33 smithi037 ceph-mon[36609]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:33.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:33 smithi037 ceph-mon[36609]: from='client.? 172.21.15.37:0/4239703943' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:36:33.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:33 smithi059 ceph-mon[36684]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:33.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:33 smithi059 ceph-mon[36684]: from='client.? 172.21.15.37:0/4239703943' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:36:35.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:35 smithi037 ceph-mon[36609]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:35.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:35 smithi059 ceph-mon[36684]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:36.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:35 smithi028 ceph-mon[31564]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:37.699 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:37 smithi037 ceph-mon[36609]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:37.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:37 smithi059 ceph-mon[36684]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:38.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:37 smithi028 ceph-mon[31564]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:39.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:39 smithi037 ceph-mon[36609]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:39.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:39 smithi059 ceph-mon[36684]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:40.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:39 smithi028 ceph-mon[31564]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:40.780 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-06T08:36:40.780 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:40.780 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:40 smithi037 ceph-mon[36609]: Deploying daemon osd.7 on smithi037 2024-06-06T08:36:40.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-06T08:36:40.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:40.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:40 smithi059 ceph-mon[36684]: Deploying daemon osd.7 on smithi037 2024-06-06T08:36:41.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-06T08:36:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:40 smithi028 ceph-mon[31564]: Deploying daemon osd.7 on smithi037 2024-06-06T08:36:41.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:41 smithi037 ceph-mon[36609]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:41.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:41 smithi059 ceph-mon[36684]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:42.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:41 smithi028 ceph-mon[31564]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:43.843 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:43 smithi028 ceph-mon[31564]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:43.847 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:43 smithi037 ceph-mon[36609]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:43.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:43 smithi059 ceph-mon[36684]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:45.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:45 smithi037 ceph-mon[36609]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:45.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:45 smithi059 ceph-mon[36684]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:46.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:45 smithi028 ceph-mon[31564]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:46.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:46 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:46.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:46 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:46.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:46 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:47.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:46 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:47.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:46 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:47.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:46 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:47.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:46 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:47.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:46 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:47.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:46 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:48.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:47 smithi028 ceph-mon[31564]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:48.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:47 smithi037 ceph-mon[36609]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:48.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:47 smithi059 ceph-mon[36684]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:49.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:49 smithi037 ceph-mon[36609]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:49.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:49 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:49.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:49 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:49.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:49 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:49.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:49 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:49.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:49 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:49.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:49 smithi037 ceph-mon[36609]: from='osd.7 [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T08:36:49.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:49 smithi037 ceph-mon[36609]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T08:36:49.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.946+0000 7fc7927fc700 1 -- 172.21.15.37:0/4072033247 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc79c0628d0 con 0x7fc7880a2c20 2024-06-06T08:36:49.945 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 7 on host 'smithi037' 2024-06-06T08:36:49.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 -- 172.21.15.37:0/4072033247 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc7880a2c20 msgr2=0x7fc7880a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:36:49.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc7880a2c20 0x7fc7880a50e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc798005950 tx=0x7fc7980058e0 comp rx=0 tx=0).stop 2024-06-06T08:36:49.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 -- 172.21.15.37:0/4072033247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c076440 msgr2=0x7fc79c19ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:36:49.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c076440 0x7fc79c19ae80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00b530 tx=0x7fc78c00b8f0 comp rx=0 tx=0).stop 2024-06-06T08:36:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 -- 172.21.15.37:0/4072033247 shutdown_connections 2024-06-06T08:36:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc7880a2c20 0x7fc7880a50e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc79c10a3f0 0x7fc79c1a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc79c074e70 0x7fc79c19a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 --2- 172.21.15.37:0/4072033247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c076440 0x7fc79c19ae80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 -- 172.21.15.37:0/4072033247 >> 172.21.15.37:0/4072033247 conn(0x7fc79c0fda90 msgr2=0x7fc79c106340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:36:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 -- 172.21.15.37:0/4072033247 shutdown_connections 2024-06-06T08:36:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:36:49.948+0000 7fc7a392e700 1 -- 172.21.15.37:0/4072033247 wait complete. 2024-06-06T08:36:50.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:49 smithi028 ceph-mon[31564]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:50.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:50.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:50.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:50.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:50.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:50.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:49 smithi028 ceph-mon[31564]: from='osd.7 [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T08:36:50.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:49 smithi028 ceph-mon[31564]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T08:36:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:49 smithi059 ceph-mon[36684]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:49 smithi059 ceph-mon[36684]: from='osd.7 [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T08:36:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:49 smithi059 ceph-mon[36684]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T08:36:50.624 DEBUG:teuthology.orchestra.run.smithi037:osd.7> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.7.service 2024-06-06T08:36:50.627 INFO:tasks.cephadm:Deploying osd.8 on smithi059 with /dev/vg_nvme/lv_2... 2024-06-06T08:36:50.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-06T08:36:50.883 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:36:51.132 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:50 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:51.133 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:50 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:51.133 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:50 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:51.133 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:50 smithi037 ceph-mon[36609]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-06T08:36:51.133 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:50 smithi037 ceph-mon[36609]: from='osd.7 [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:36:51.133 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:50 smithi037 ceph-mon[36609]: osdmap e49: 8 total, 7 up, 8 in 2024-06-06T08:36:51.133 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:50 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:51.133 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:50 smithi037 ceph-mon[36609]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:36:51.133 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:36:50 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:36:50.972+0000 7f5054586700 -1 osd.7 0 waiting for initial osdmap 2024-06-06T08:36:51.133 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:36:50 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:36:50.981+0000 7f5050379700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T08:36:51.227 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:50 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:51.228 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:50 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:51.228 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:50 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:51.228 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:50 smithi059 ceph-mon[36684]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-06T08:36:51.228 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:50 smithi059 ceph-mon[36684]: from='osd.7 [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:36:51.228 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:50 smithi059 ceph-mon[36684]: osdmap e49: 8 total, 7 up, 8 in 2024-06-06T08:36:51.228 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:50 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:51.228 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:50 smithi059 ceph-mon[36684]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:36:51.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:50 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:51.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:50 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:51.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:50 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:36:51.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:50 smithi028 ceph-mon[31564]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-06T08:36:51.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:50 smithi028 ceph-mon[31564]: from='osd.7 [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:36:51.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:50 smithi028 ceph-mon[31564]: osdmap e49: 8 total, 7 up, 8 in 2024-06-06T08:36:51.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:50 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:51.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:50 smithi028 ceph-mon[31564]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:36:52.020 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:51 smithi059 ceph-mon[36684]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:52.020 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:51 smithi059 ceph-mon[36684]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:36:52.020 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:51 smithi059 ceph-mon[36684]: osdmap e50: 8 total, 7 up, 8 in 2024-06-06T08:36:52.021 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:52.021 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:52.194 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:51 smithi037 ceph-mon[36609]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:52.194 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:51 smithi037 ceph-mon[36609]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:36:52.194 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:51 smithi037 ceph-mon[36609]: osdmap e50: 8 total, 7 up, 8 in 2024-06-06T08:36:52.194 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:52.194 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:52.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:51 smithi028 ceph-mon[31564]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:52.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:51 smithi028 ceph-mon[31564]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:36:52.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:51 smithi028 ceph-mon[31564]: osdmap e50: 8 total, 7 up, 8 in 2024-06-06T08:36:52.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:52.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:52.992 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-06T08:36:52.992 INFO:teuthology.orchestra.run.smithi059.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-06T08:36:52.992 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10+0 records in 2024-06-06T08:36:52.992 INFO:teuthology.orchestra.run.smithi059.stderr:10+0 records out 2024-06-06T08:36:52.992 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113658 s, 923 MB/s 2024-06-06T08:36:52.992 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping successful for: 2024-06-06T08:36:53.286 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:52 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:36:53.286 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:52 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:36:53.286 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:52 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:53.286 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:52 smithi059 ceph-mon[36684]: osd.7 [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860] boot 2024-06-06T08:36:53.286 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:52 smithi059 ceph-mon[36684]: osdmap e51: 8 total, 8 up, 8 in 2024-06-06T08:36:53.286 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:52 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:53.286 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:52 smithi059 ceph-mon[36684]: pgmap v197: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:53.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:52 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:36:53.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:52 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:36:53.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:52 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:53.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:52 smithi028 ceph-mon[31564]: osd.7 [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860] boot 2024-06-06T08:36:53.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:52 smithi028 ceph-mon[31564]: osdmap e51: 8 total, 8 up, 8 in 2024-06-06T08:36:53.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:52 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:53.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:52 smithi028 ceph-mon[31564]: pgmap v197: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:53.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:52 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:36:53.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:52 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:36:53.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:52 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:53.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:52 smithi037 ceph-mon[36609]: osd.7 [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860] boot 2024-06-06T08:36:53.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:52 smithi037 ceph-mon[36609]: osdmap e51: 8 total, 8 up, 8 in 2024-06-06T08:36:53.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:52 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T08:36:53.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:52 smithi037 ceph-mon[36609]: pgmap v197: 1 pgs: 1 unknown; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-06T08:36:53.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_2 2024-06-06T08:36:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:36:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-06-06T08:36:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: osdmap e52: 8 total, 8 up, 8 in 2024-06-06T08:36:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi037 2024-06-06T08:36:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi037 to 5697M 2024-06-06T08:36:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:54.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:54.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:54.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:54.190 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-06-06T08:36:54.190 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: osdmap e52: 8 total, 8 up, 8 in 2024-06-06T08:36:54.190 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi037 2024-06-06T08:36:54.190 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:54.190 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:54.190 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:54.190 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:54.191 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:54.191 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi037 to 5697M 2024-06-06T08:36:54.191 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:54.191 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:54.191 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:54.191 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:54.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-06-06T08:36:54.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: osdmap e52: 8 total, 8 up, 8 in 2024-06-06T08:36:54.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi037 2024-06-06T08:36:54.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:54.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:54.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:54.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:54.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:36:54.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi037 to 5697M 2024-06-06T08:36:54.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:54.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:54.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:36:54.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:36:55.216 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:54 smithi059 ceph-mon[36684]: osdmap e53: 8 total, 8 up, 8 in 2024-06-06T08:36:55.216 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:54 smithi059 ceph-mon[36684]: pgmap v200: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:36:55.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:54 smithi028 ceph-mon[31564]: osdmap e53: 8 total, 8 up, 8 in 2024-06-06T08:36:55.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:54 smithi028 ceph-mon[31564]: pgmap v200: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:36:55.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:54 smithi037 ceph-mon[36609]: osdmap e53: 8 total, 8 up, 8 in 2024-06-06T08:36:55.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:54 smithi037 ceph-mon[36609]: pgmap v200: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:36:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.441+0000 7fd068022700 1 -- 172.21.15.59:0/2198971660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0601013f0 msgr2=0x7fd060101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:36:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.441+0000 7fd068022700 1 --2- 172.21.15.59:0/2198971660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0601013f0 0x7fd060101810 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd05000b0a0 tx=0x7fd05000b3b0 comp rx=0 tx=0).stop 2024-06-06T08:36:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.441+0000 7fd068022700 1 -- 172.21.15.59:0/2198971660 shutdown_connections 2024-06-06T08:36:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.441+0000 7fd068022700 1 --2- 172.21.15.59:0/2198971660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd060102f90 0x7fd060109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.441+0000 7fd068022700 1 --2- 172.21.15.59:0/2198971660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0601013f0 0x7fd060101810 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.441+0000 7fd068022700 1 --2- 172.21.15.59:0/2198971660 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0601025f0 0x7fd060102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.441+0000 7fd068022700 1 -- 172.21.15.59:0/2198971660 >> 172.21.15.59:0/2198971660 conn(0x7fd0600fc990 msgr2=0x7fd0600fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.441+0000 7fd068022700 1 -- 172.21.15.59:0/2198971660 shutdown_connections 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.441+0000 7fd068022700 1 -- 172.21.15.59:0/2198971660 wait complete. 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd068022700 1 Processor -- start 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd068022700 1 -- start start 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd068022700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0601013f0 0x7fd060105520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd068022700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0601025f0 0x7fd060103b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd068022700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd060102f90 0x7fd0601040b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd068022700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd06010d050 con 0x7fd0601025f0 2024-06-06T08:36:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd068022700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd06010ced0 con 0x7fd0601013f0 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd068022700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd06010d1d0 con 0x7fd060102f90 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd0665bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd060102f90 0x7fd0601040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd0665bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd060102f90 0x7fd0601040b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59938/0 (socket says 172.21.15.59:59938) 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd0665bf700 1 -- 172.21.15.59:0/254294554 learned_addr learned my addr 172.21.15.59:0/254294554 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd065dbe700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0601013f0 0x7fd060105520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd0665bf700 1 -- 172.21.15.59:0/254294554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0601013f0 msgr2=0x7fd060105520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd0665bf700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0601013f0 0x7fd060105520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd0665bf700 1 -- 172.21.15.59:0/254294554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0601025f0 msgr2=0x7fd060103b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd0665bf700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0601025f0 0x7fd060103b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd0665bf700 1 -- 172.21.15.59:0/254294554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd060104960 con 0x7fd060102f90 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.442+0000 7fd0665bf700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd060102f90 0x7fd0601040b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd05800d980 tx=0x7fd05800dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:36:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.443+0000 7fd05effd700 1 -- 172.21.15.59:0/254294554 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058017070 con 0x7fd060102f90 2024-06-06T08:36:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.443+0000 7fd068022700 1 -- 172.21.15.59:0/254294554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0601a29a0 con 0x7fd060102f90 2024-06-06T08:36:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.443+0000 7fd05effd700 1 -- 172.21.15.59:0/254294554 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd058009e20 con 0x7fd060102f90 2024-06-06T08:36:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.443+0000 7fd05effd700 1 -- 172.21.15.59:0/254294554 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058005440 con 0x7fd060102f90 2024-06-06T08:36:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.443+0000 7fd068022700 1 -- 172.21.15.59:0/254294554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0601a2f30 con 0x7fd060102f90 2024-06-06T08:36:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.444+0000 7fd068022700 1 -- 172.21.15.59:0/254294554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd060069180 con 0x7fd060102f90 2024-06-06T08:36:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.445+0000 7fd05effd700 1 -- 172.21.15.59:0/254294554 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd0580055e0 con 0x7fd060102f90 2024-06-06T08:36:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.445+0000 7fd05effd700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0480a2ca0 0x7fd0480a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:36:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.446+0000 7fd05effd700 1 -- 172.21.15.59:0/254294554 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5397+0+0 (secure 0 0 0) 0x7fd0580ce440 con 0x7fd060102f90 2024-06-06T08:36:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.446+0000 7fd065dbe700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0480a2ca0 0x7fd0480a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:36:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.447+0000 7fd065dbe700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0480a2ca0 0x7fd0480a5160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd050009be0 tx=0x7fd0500061f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:36:55.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.450+0000 7fd05effd700 1 -- 172.21.15.59:0/254294554 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd058020020 con 0x7fd060102f90 2024-06-06T08:36:55.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:36:55.669+0000 7fd068022700 1 -- 172.21.15.59:0/254294554 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd06006a880 con 0x7fd0480a2ca0 2024-06-06T08:36:56.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:56 smithi028 ceph-mon[31564]: osdmap e54: 8 total, 8 up, 8 in 2024-06-06T08:36:56.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:56 smithi028 ceph-mon[31564]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:36:56.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:36:56.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:36:56.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:56 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:56.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:56 smithi037 ceph-mon[36609]: osdmap e54: 8 total, 8 up, 8 in 2024-06-06T08:36:56.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:56 smithi037 ceph-mon[36609]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:36:56.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:36:56.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:36:56.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:56 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:56.334 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:56 smithi059 ceph-mon[36684]: osdmap e54: 8 total, 8 up, 8 in 2024-06-06T08:36:56.334 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:56 smithi059 ceph-mon[36684]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:36:56.334 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:36:56.334 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:36:56.334 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:56 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:36:57.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:57 smithi028 ceph-mon[31564]: osdmap e55: 8 total, 8 up, 8 in 2024-06-06T08:36:57.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:57 smithi028 ceph-mon[31564]: pgmap v203: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:36:57.310 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:57 smithi059 ceph-mon[36684]: osdmap e55: 8 total, 8 up, 8 in 2024-06-06T08:36:57.311 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:57 smithi059 ceph-mon[36684]: pgmap v203: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:36:57.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:57 smithi037 ceph-mon[36609]: osdmap e55: 8 total, 8 up, 8 in 2024-06-06T08:36:57.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:57 smithi037 ceph-mon[36609]: pgmap v203: 1 pgs: 1 unknown; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:36:58.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:58 smithi028 ceph-mon[31564]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-06-06T08:36:58.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:58 smithi028 ceph-mon[31564]: Cluster is now healthy 2024-06-06T08:36:58.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:58 smithi037 ceph-mon[36609]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-06-06T08:36:58.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:58 smithi037 ceph-mon[36609]: Cluster is now healthy 2024-06-06T08:36:58.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:58 smithi059 ceph-mon[36684]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-06-06T08:36:58.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:58 smithi059 ceph-mon[36684]: Cluster is now healthy 2024-06-06T08:36:59.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:59 smithi028 ceph-mon[31564]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:36:59.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:59 smithi028 ceph-mon[31564]: from='client.? 172.21.15.59:0/4051153098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ffc07d7-ca79-419d-88a4-2b53d07ffae3"}]: dispatch 2024-06-06T08:36:59.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:59 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ffc07d7-ca79-419d-88a4-2b53d07ffae3"}]: dispatch 2024-06-06T08:36:59.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:59 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ffc07d7-ca79-419d-88a4-2b53d07ffae3"}]': finished 2024-06-06T08:36:59.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:59 smithi028 ceph-mon[31564]: osdmap e56: 9 total, 8 up, 9 in 2024-06-06T08:36:59.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:36:59.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:36:59 smithi028 ceph-mon[31564]: from='client.? 172.21.15.59:0/3960355670' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:36:59.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:59 smithi037 ceph-mon[36609]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:36:59.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:59 smithi037 ceph-mon[36609]: from='client.? 172.21.15.59:0/4051153098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ffc07d7-ca79-419d-88a4-2b53d07ffae3"}]: dispatch 2024-06-06T08:36:59.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:59 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ffc07d7-ca79-419d-88a4-2b53d07ffae3"}]: dispatch 2024-06-06T08:36:59.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:59 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ffc07d7-ca79-419d-88a4-2b53d07ffae3"}]': finished 2024-06-06T08:36:59.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:59 smithi037 ceph-mon[36609]: osdmap e56: 9 total, 8 up, 9 in 2024-06-06T08:36:59.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:36:59.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:36:59 smithi037 ceph-mon[36609]: from='client.? 172.21.15.59:0/3960355670' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:36:59.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:59 smithi059 ceph-mon[36684]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:36:59.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:59 smithi059 ceph-mon[36684]: from='client.? 172.21.15.59:0/4051153098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ffc07d7-ca79-419d-88a4-2b53d07ffae3"}]: dispatch 2024-06-06T08:36:59.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:59 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ffc07d7-ca79-419d-88a4-2b53d07ffae3"}]: dispatch 2024-06-06T08:36:59.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:59 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ffc07d7-ca79-419d-88a4-2b53d07ffae3"}]': finished 2024-06-06T08:36:59.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:59 smithi059 ceph-mon[36684]: osdmap e56: 9 total, 8 up, 9 in 2024-06-06T08:36:59.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:36:59.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:36:59 smithi059 ceph-mon[36684]: from='client.? 172.21.15.59:0/3960355670' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:37:01.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:01 smithi028 ceph-mon[31564]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:01.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:01 smithi037 ceph-mon[36609]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:01.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:01 smithi059 ceph-mon[36684]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:03.522 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:03 smithi059 ceph-mon[36684]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:03.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:03 smithi028 ceph-mon[31564]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:03.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:03 smithi037 ceph-mon[36609]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:05.417 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:05 smithi059 ceph-mon[36684]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:05.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:05 smithi028 ceph-mon[31564]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:05.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:05 smithi037 ceph-mon[36609]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:06.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-06T08:37:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:06 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:06.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:06 smithi028 ceph-mon[31564]: Deploying daemon osd.8 on smithi059 2024-06-06T08:37:06.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-06T08:37:06.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:06 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:06.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:06 smithi037 ceph-mon[36609]: Deploying daemon osd.8 on smithi059 2024-06-06T08:37:06.564 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-06T08:37:06.564 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:06 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:06.564 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:06 smithi059 ceph-mon[36684]: Deploying daemon osd.8 on smithi059 2024-06-06T08:37:07.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:07 smithi028 ceph-mon[31564]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:07.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:07 smithi037 ceph-mon[36609]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:07.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:07 smithi059 ceph-mon[36684]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:09.494 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:09 smithi059 ceph-mon[36684]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:09.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:09 smithi037 ceph-mon[36609]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:09.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:09 smithi028 ceph-mon[31564]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:11.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:11 smithi037 ceph-mon[36609]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:11 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:11.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:11 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:11.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:11 smithi059 ceph-mon[36684]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:11.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:11 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:11.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:11 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:11.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:11 smithi028 ceph-mon[31564]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:11.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:11 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:11.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:11 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:12.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:12 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:12.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:12 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:12.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:12 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:13.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:13 smithi059 ceph-mon[36684]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:13.692 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:13 smithi028 ceph-mon[31564]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:13.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:13 smithi037 ceph-mon[36609]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:15.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.056+0000 7fd05effd700 1 -- 172.21.15.59:0/254294554 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd06006a880 con 0x7fd0480a2ca0 2024-06-06T08:37:15.055 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 8 on host 'smithi059' 2024-06-06T08:37:15.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 -- 172.21.15.59:0/254294554 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0480a2ca0 msgr2=0x7fd0480a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:37:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0480a2ca0 0x7fd0480a5160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd050009be0 tx=0x7fd0500061f0 comp rx=0 tx=0).stop 2024-06-06T08:37:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 -- 172.21.15.59:0/254294554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd060102f90 msgr2=0x7fd0601040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:37:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd060102f90 0x7fd0601040b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd05800d980 tx=0x7fd05800dd40 comp rx=0 tx=0).stop 2024-06-06T08:37:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 -- 172.21.15.59:0/254294554 shutdown_connections 2024-06-06T08:37:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0480a2ca0 0x7fd0480a5160 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd060102f90 0x7fd0601040b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0601013f0 0x7fd060105520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 --2- 172.21.15.59:0/254294554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0601025f0 0x7fd060103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:15.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 -- 172.21.15.59:0/254294554 >> 172.21.15.59:0/254294554 conn(0x7fd0600fc990 msgr2=0x7fd06006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:37:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 -- 172.21.15.59:0/254294554 shutdown_connections 2024-06-06T08:37:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:37:15.058+0000 7fd068022700 1 -- 172.21.15.59:0/254294554 wait complete. 2024-06-06T08:37:15.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:15.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:15.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:15 smithi059 ceph-mon[36684]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:15.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:15.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:15.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:15.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:15 smithi028 ceph-mon[31564]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:15.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:15.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:15.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:15.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:15 smithi037 ceph-mon[36609]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:15.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:15.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:15.720 DEBUG:teuthology.orchestra.run.smithi059:osd.8> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.8.service 2024-06-06T08:37:15.722 INFO:tasks.cephadm:Deploying osd.9 on smithi028 with /dev/vg_nvme/lv_1... 2024-06-06T08:37:15.722 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-06T08:37:16.185 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:37:16.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:16 smithi059 ceph-mon[36684]: from='osd.8 [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T08:37:16.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:16 smithi059 ceph-mon[36684]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T08:37:16.518 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:16 smithi028 ceph-mon[31564]: from='osd.8 [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T08:37:16.518 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:16 smithi028 ceph-mon[31564]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T08:37:16.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:16 smithi037 ceph-mon[36609]: from='osd.8 [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T08:37:16.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:16 smithi037 ceph-mon[36609]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T08:37:17.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:17 smithi028 ceph-mon[31564]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:17.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:17 smithi028 ceph-mon[31564]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-06T08:37:17.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:17 smithi028 ceph-mon[31564]: from='osd.8 [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:37:17.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:17 smithi028 ceph-mon[31564]: osdmap e57: 9 total, 8 up, 9 in 2024-06-06T08:37:17.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:17 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:37:17.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:17 smithi028 ceph-mon[31564]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:37:17.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:17 smithi037 ceph-mon[36609]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:17.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:17 smithi037 ceph-mon[36609]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-06T08:37:17.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:17 smithi037 ceph-mon[36609]: from='osd.8 [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:37:17.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:17 smithi037 ceph-mon[36609]: osdmap e57: 9 total, 8 up, 9 in 2024-06-06T08:37:17.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:17 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:37:17.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:17 smithi037 ceph-mon[36609]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:37:17.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:17 smithi059 ceph-mon[36684]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:17.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:17 smithi059 ceph-mon[36684]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-06T08:37:17.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:17 smithi059 ceph-mon[36684]: from='osd.8 [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:37:17.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:17 smithi059 ceph-mon[36684]: osdmap e57: 9 total, 8 up, 9 in 2024-06-06T08:37:17.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:17 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:37:17.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:17 smithi059 ceph-mon[36684]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:37:18.017 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:37:17 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:37:17.617+0000 7f99df133700 -1 osd.8 0 waiting for initial osdmap 2024-06-06T08:37:18.017 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:37:17 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:37:17.629+0000 7f99d671d700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T08:37:18.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:18 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:37:18.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:18 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:37:18.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:18 smithi059 ceph-mon[36684]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:37:18.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:18 smithi059 ceph-mon[36684]: osdmap e58: 9 total, 8 up, 9 in 2024-06-06T08:37:18.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:18 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:37:18.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:18 smithi059 ceph-mon[36684]: from='osd.8 ' entity='osd.8' 2024-06-06T08:37:18.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:18 smithi059 ceph-mon[36684]: osd.8 [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223] boot 2024-06-06T08:37:18.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:18 smithi059 ceph-mon[36684]: osdmap e59: 9 total, 9 up, 9 in 2024-06-06T08:37:18.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:18 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:37:18.354 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:18 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:37:18.354 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:18 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:37:18.354 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:18 smithi028 ceph-mon[31564]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:37:18.354 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:18 smithi028 ceph-mon[31564]: osdmap e58: 9 total, 8 up, 9 in 2024-06-06T08:37:18.355 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:18 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:37:18.355 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:18 smithi028 ceph-mon[31564]: from='osd.8 ' entity='osd.8' 2024-06-06T08:37:18.355 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:18 smithi028 ceph-mon[31564]: osd.8 [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223] boot 2024-06-06T08:37:18.355 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:18 smithi028 ceph-mon[31564]: osdmap e59: 9 total, 9 up, 9 in 2024-06-06T08:37:18.355 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:18 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:37:18.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:18 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:37:18.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:18 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:37:18.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:18 smithi037 ceph-mon[36609]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:37:18.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:18 smithi037 ceph-mon[36609]: osdmap e58: 9 total, 8 up, 9 in 2024-06-06T08:37:18.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:18 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:37:18.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:18 smithi037 ceph-mon[36609]: from='osd.8 ' entity='osd.8' 2024-06-06T08:37:18.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:18 smithi037 ceph-mon[36609]: osd.8 [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223] boot 2024-06-06T08:37:18.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:18 smithi037 ceph-mon[36609]: osdmap e59: 9 total, 9 up, 9 in 2024-06-06T08:37:18.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:18 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T08:37:19.237 INFO:teuthology.orchestra.run.smithi028.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-06T08:37:19.237 INFO:teuthology.orchestra.run.smithi028.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-06T08:37:19.237 INFO:teuthology.orchestra.run.smithi028.stderr: stderr: 10+0 records in 2024-06-06T08:37:19.237 INFO:teuthology.orchestra.run.smithi028.stderr:10+0 records out 2024-06-06T08:37:19.237 INFO:teuthology.orchestra.run.smithi028.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0369514 s, 284 MB/s 2024-06-06T08:37:19.237 INFO:teuthology.orchestra.run.smithi028.stderr:--> Zapping successful for: 2024-06-06T08:37:19.991 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:19.991 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi059 2024-06-06T08:37:19.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:19.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:19.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:19.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:19.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:19.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi059 to 5697M 2024-06-06T08:37:19.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:19.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:19.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:19.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:19.992 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:19 smithi028 ceph-mon[31564]: osdmap e60: 9 total, 9 up, 9 in 2024-06-06T08:37:20.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:20.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi059 2024-06-06T08:37:20.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:20.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:20.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:20.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:20.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:20.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi059 to 5697M 2024-06-06T08:37:20.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:20.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:20.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:20.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:20.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:19 smithi037 ceph-mon[36609]: osdmap e60: 9 total, 9 up, 9 in 2024-06-06T08:37:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-06-06T08:37:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi059 2024-06-06T08:37:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi059 to 5697M 2024-06-06T08:37:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:20.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:20.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:20.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:20.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:19 smithi059 ceph-mon[36684]: osdmap e60: 9 total, 9 up, 9 in 2024-06-06T08:37:20.148 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi028:vg_nvme/lv_1 2024-06-06T08:37:20.615 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:37:21.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:21 smithi028 ceph-mon[31564]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:21.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:21 smithi028 ceph-mon[31564]: osdmap e61: 9 total, 9 up, 9 in 2024-06-06T08:37:21.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:21 smithi037 ceph-mon[36609]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:21.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:21 smithi037 ceph-mon[36609]: osdmap e61: 9 total, 9 up, 9 in 2024-06-06T08:37:21.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:21 smithi059 ceph-mon[36684]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:21.601 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:21 smithi059 ceph-mon[36684]: osdmap e61: 9 total, 9 up, 9 in 2024-06-06T08:37:22.502 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:22 smithi028 ceph-mon[31564]: osdmap e62: 9 total, 9 up, 9 in 2024-06-06T08:37:22.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:22 smithi037 ceph-mon[36609]: osdmap e62: 9 total, 9 up, 9 in 2024-06-06T08:37:22.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:22 smithi059 ceph-mon[36684]: osdmap e62: 9 total, 9 up, 9 in 2024-06-06T08:37:22.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.844+0000 7f8c37c00700 1 -- 172.21.15.28:0/3879990738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c30074e90 msgr2=0x7f8c30075310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:37:22.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.844+0000 7f8c37c00700 1 --2- 172.21.15.28:0/3879990738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c30074e90 0x7f8c30075310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009990 tx=0x7f8c20009ca0 comp rx=0 tx=0).stop 2024-06-06T08:37:22.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.844+0000 7f8c37c00700 1 -- 172.21.15.28:0/3879990738 shutdown_connections 2024-06-06T08:37:22.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.844+0000 7f8c37c00700 1 --2- 172.21.15.28:0/3879990738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c3010a3d0 0x7f8c3010c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:22.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.845+0000 7f8c37c00700 1 --2- 172.21.15.28:0/3879990738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c30076460 0x7f8c300748c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:22.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.845+0000 7f8c37c00700 1 --2- 172.21.15.28:0/3879990738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c30074e90 0x7f8c30075310 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:22.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.845+0000 7f8c37c00700 1 -- 172.21.15.28:0/3879990738 >> 172.21.15.28:0/3879990738 conn(0x7f8c300fda90 msgr2=0x7f8c300ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:37:22.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.845+0000 7f8c37c00700 1 -- 172.21.15.28:0/3879990738 shutdown_connections 2024-06-06T08:37:22.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.845+0000 7f8c37c00700 1 -- 172.21.15.28:0/3879990738 wait complete. 2024-06-06T08:37:22.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.847+0000 7f8c37c00700 1 Processor -- start 2024-06-06T08:37:22.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.847+0000 7f8c37c00700 1 -- start start 2024-06-06T08:37:22.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.848+0000 7f8c37c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c30074e90 0x7f8c3019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:37:22.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.848+0000 7f8c37c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c30076460 0x7f8c3019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:37:22.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.848+0000 7f8c37c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c3010a3d0 0x7f8c301a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:37:22.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.848+0000 7f8c37c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301102c0 con 0x7f8c30074e90 2024-06-06T08:37:22.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.848+0000 7f8c37c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30110140 con 0x7f8c3010a3d0 2024-06-06T08:37:22.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.848+0000 7f8c37c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30110440 con 0x7f8c30076460 2024-06-06T08:37:22.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.848+0000 7f8c35200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c30074e90 0x7f8c3019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:37:22.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.848+0000 7f8c35200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c30074e90 0x7f8c3019a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60412/0 (socket says 172.21.15.28:60412) 2024-06-06T08:37:22.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.848+0000 7f8c35200700 1 -- 172.21.15.28:0/2981944700 learned_addr learned my addr 172.21.15.28:0/2981944700 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:37:22.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.848+0000 7f8c2fe00700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c30076460 0x7f8c3019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:37:22.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.848+0000 7f8c35c00700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c3010a3d0 0x7f8c301a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:37:22.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.849+0000 7f8c35200700 1 -- 172.21.15.28:0/2981944700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c30076460 msgr2=0x7f8c3019ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:37:22.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.849+0000 7f8c35200700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c30076460 0x7f8c3019ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:22.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.849+0000 7f8c35200700 1 -- 172.21.15.28:0/2981944700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c3010a3d0 msgr2=0x7f8c301a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:37:22.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.849+0000 7f8c35200700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c3010a3d0 0x7f8c301a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:22.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.849+0000 7f8c35200700 1 -- 172.21.15.28:0/2981944700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c301a2560 con 0x7f8c30074e90 2024-06-06T08:37:22.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.849+0000 7f8c2fe00700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c30076460 0x7f8c3019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:37:22.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.849+0000 7f8c35200700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c30074e90 0x7f8c3019a900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400e9f0 tx=0x7f8c2400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:37:22.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.849+0000 7f8c2d600700 1 -- 172.21.15.28:0/2981944700 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400cbd0 con 0x7f8c30074e90 2024-06-06T08:37:22.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.850+0000 7f8c2d600700 1 -- 172.21.15.28:0/2981944700 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c2400ee90 con 0x7f8c30074e90 2024-06-06T08:37:22.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.850+0000 7f8c37c00700 1 -- 172.21.15.28:0/2981944700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c301a2850 con 0x7f8c30074e90 2024-06-06T08:37:22.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.850+0000 7f8c2d600700 1 -- 172.21.15.28:0/2981944700 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c240056c0 con 0x7f8c30074e90 2024-06-06T08:37:22.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.850+0000 7f8c37c00700 1 -- 172.21.15.28:0/2981944700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c301a2d40 con 0x7f8c30074e90 2024-06-06T08:37:22.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.851+0000 7f8c37c00700 1 -- 172.21.15.28:0/2981944700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c30069180 con 0x7f8c30074e90 2024-06-06T08:37:22.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.853+0000 7f8c2d600700 1 -- 172.21.15.28:0/2981944700 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8c24004750 con 0x7f8c30074e90 2024-06-06T08:37:22.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.854+0000 7f8c2d600700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8c180a2c20 0x7f8c180a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:37:22.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.854+0000 7f8c2d600700 1 -- 172.21.15.28:0/2981944700 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5829+0+0 (secure 0 0 0) 0x7f8c240ce9a0 con 0x7f8c30074e90 2024-06-06T08:37:22.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.855+0000 7f8c2fe00700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8c180a2c20 0x7f8c180a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:37:22.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.855+0000 7f8c2fe00700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8c180a2c20 0x7f8c180a50e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000b2e0 tx=0x7f8c2000b880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:37:22.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:22.860+0000 7f8c2d600700 1 -- 172.21.15.28:0/2981944700 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8c2409c210 con 0x7f8c30074e90 2024-06-06T08:37:23.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:23.104+0000 7f8c37c00700 1 -- 172.21.15.28:0/2981944700 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f8c300628d0 con 0x7f8c180a2c20 2024-06-06T08:37:23.501 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:23 smithi059 ceph-mon[36684]: pgmap v223: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:23.501 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:23 smithi059 ceph-mon[36684]: osdmap e63: 9 total, 9 up, 9 in 2024-06-06T08:37:23.501 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:37:23.501 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:37:23.501 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:23.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:23 smithi028 ceph-mon[31564]: pgmap v223: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:23.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:23 smithi028 ceph-mon[31564]: osdmap e63: 9 total, 9 up, 9 in 2024-06-06T08:37:23.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:37:23.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:37:23.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:23.566 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:23 smithi037 ceph-mon[36609]: pgmap v223: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:23.566 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:23 smithi037 ceph-mon[36609]: osdmap e63: 9 total, 9 up, 9 in 2024-06-06T08:37:23.566 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:37:23.566 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:37:23.566 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:24.448 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:24 smithi028 ceph-mon[31564]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:37:24.516 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:24 smithi059 ceph-mon[36684]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:37:24.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:24 smithi037 ceph-mon[36609]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:37:25.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:25 smithi028 ceph-mon[31564]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-06-06T08:37:25.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:25 smithi037 ceph-mon[36609]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-06-06T08:37:25.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:25 smithi059 ceph-mon[36684]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-06-06T08:37:27.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:27 smithi028 ceph-mon[31564]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:37:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:27 smithi037 ceph-mon[36609]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:37:27.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:27 smithi059 ceph-mon[36684]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:37:28.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:28 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/329174412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e014fc7-1ca3-4d6c-acdd-95ca59541310"}]: dispatch 2024-06-06T08:37:28.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:28 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/329174412' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e014fc7-1ca3-4d6c-acdd-95ca59541310"}]': finished 2024-06-06T08:37:28.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:28 smithi028 ceph-mon[31564]: osdmap e64: 10 total, 9 up, 10 in 2024-06-06T08:37:28.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:28.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:28 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/329174412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e014fc7-1ca3-4d6c-acdd-95ca59541310"}]: dispatch 2024-06-06T08:37:28.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:28 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/329174412' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e014fc7-1ca3-4d6c-acdd-95ca59541310"}]': finished 2024-06-06T08:37:28.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:28 smithi037 ceph-mon[36609]: osdmap e64: 10 total, 9 up, 10 in 2024-06-06T08:37:28.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:28 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:28.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:28 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/329174412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e014fc7-1ca3-4d6c-acdd-95ca59541310"}]: dispatch 2024-06-06T08:37:28.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:28 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/329174412' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e014fc7-1ca3-4d6c-acdd-95ca59541310"}]': finished 2024-06-06T08:37:28.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:28 smithi059 ceph-mon[36684]: osdmap e64: 10 total, 9 up, 10 in 2024-06-06T08:37:28.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:28 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:29.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:29 smithi028 ceph-mon[31564]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-06-06T08:37:29.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:29 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2416448102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:37:29.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:29 smithi037 ceph-mon[36609]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-06-06T08:37:29.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:29 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2416448102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:37:29.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:29 smithi059 ceph-mon[36684]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-06-06T08:37:29.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:29 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2416448102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:37:31.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:31 smithi028 ceph-mon[31564]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T08:37:31.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:31 smithi037 ceph-mon[36609]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T08:37:31.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:31 smithi059 ceph-mon[36684]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T08:37:33.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:33 smithi028 ceph-mon[31564]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T08:37:33.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:33 smithi037 ceph-mon[36609]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T08:37:33.603 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:33 smithi059 ceph-mon[36684]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T08:37:35.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:35 smithi028 ceph-mon[31564]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:35.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:35 smithi037 ceph-mon[36609]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:35.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:35 smithi059 ceph-mon[36684]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:37.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:37 smithi028 ceph-mon[31564]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:37.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:37 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-06T08:37:37.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:37 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:37.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:37 smithi037 ceph-mon[36609]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:37.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:37 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-06T08:37:37.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:37 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:37.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:37 smithi059 ceph-mon[36684]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:37.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:37 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-06T08:37:37.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:37 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:38.400 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:38 smithi028 ceph-mon[31564]: Deploying daemon osd.9 on smithi028 2024-06-06T08:37:38.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:38 smithi037 ceph-mon[36609]: Deploying daemon osd.9 on smithi028 2024-06-06T08:37:38.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:38 smithi059 ceph-mon[36684]: Deploying daemon osd.9 on smithi028 2024-06-06T08:37:39.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:39 smithi028 ceph-mon[31564]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:39.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:39 smithi037 ceph-mon[36609]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:39.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:39 smithi059 ceph-mon[36684]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:41.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:41 smithi028 ceph-mon[31564]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:41.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:41 smithi037 ceph-mon[36609]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:41.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:41 smithi059 ceph-mon[36684]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:43.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:43 smithi028 ceph-mon[31564]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:43.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:43 smithi037 ceph-mon[36609]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:43.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:43 smithi059 ceph-mon[36684]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:45.497 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:45 smithi028 ceph-mon[31564]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:45.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:45 smithi037 ceph-mon[36609]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:45.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:45 smithi059 ceph-mon[36684]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:46.975 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:46 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:46.976 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:46 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:46.976 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:46 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:47.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:46 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:47.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:46 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:47.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:46 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:47.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:46 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:47.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:46 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:47.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:46 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:48.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:47 smithi028 ceph-mon[31564]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:48.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:47 smithi037 ceph-mon[36609]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:48.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:47 smithi059 ceph-mon[36684]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:49.824 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:49 smithi028 ceph-mon[31564]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:49.824 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:49.824 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:49 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:49.824 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:49 smithi028 ceph-mon[31564]: from='osd.9 [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T08:37:49.824 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:49 smithi028 ceph-mon[31564]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T08:37:50.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:49 smithi037 ceph-mon[36609]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:50.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:49 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:50.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:49 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:50.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:49 smithi037 ceph-mon[36609]: from='osd.9 [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T08:37:50.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:49 smithi037 ceph-mon[36609]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T08:37:50.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:49 smithi059 ceph-mon[36684]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:49 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:49 smithi059 ceph-mon[36684]: from='osd.9 [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T08:37:50.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:49 smithi059 ceph-mon[36684]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T08:37:50.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.709+0000 7f8c2d600700 1 -- 172.21.15.28:0/2981944700 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8c300628d0 con 0x7f8c180a2c20 2024-06-06T08:37:50.709 INFO:teuthology.orchestra.run.smithi028.stdout:Created osd(s) 9 on host 'smithi028' 2024-06-06T08:37:50.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.712+0000 7f8c37c00700 1 -- 172.21.15.28:0/2981944700 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8c180a2c20 msgr2=0x7f8c180a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:37:50.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.712+0000 7f8c37c00700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8c180a2c20 0x7f8c180a50e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000b2e0 tx=0x7f8c2000b880 comp rx=0 tx=0).stop 2024-06-06T08:37:50.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.712+0000 7f8c37c00700 1 -- 172.21.15.28:0/2981944700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c30074e90 msgr2=0x7f8c3019a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:37:50.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.712+0000 7f8c37c00700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c30074e90 0x7f8c3019a900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400e9f0 tx=0x7f8c2400ed00 comp rx=0 tx=0).stop 2024-06-06T08:37:50.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.712+0000 7f8c37c00700 1 -- 172.21.15.28:0/2981944700 shutdown_connections 2024-06-06T08:37:50.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.712+0000 7f8c37c00700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8c180a2c20 0x7f8c180a50e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:50.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.712+0000 7f8c37c00700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c3010a3d0 0x7f8c301a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:50.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.712+0000 7f8c37c00700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c30074e90 0x7f8c3019a900 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:50.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.712+0000 7f8c37c00700 1 --2- 172.21.15.28:0/2981944700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c30076460 0x7f8c3019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:50.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.712+0000 7f8c37c00700 1 -- 172.21.15.28:0/2981944700 >> 172.21.15.28:0/2981944700 conn(0x7f8c300fda90 msgr2=0x7f8c30106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:37:50.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.713+0000 7f8c37c00700 1 -- 172.21.15.28:0/2981944700 shutdown_connections 2024-06-06T08:37:50.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:37:50.713+0000 7f8c37c00700 1 -- 172.21.15.28:0/2981944700 wait complete. 2024-06-06T08:37:51.524 DEBUG:teuthology.orchestra.run.smithi028:osd.9> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.9.service 2024-06-06T08:37:51.528 INFO:tasks.cephadm:Deploying osd.10 on smithi037 with /dev/vg_nvme/lv_1... 2024-06-06T08:37:51.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-06T08:37:51.784 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:37:51.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:51 smithi028 ceph-mon[31564]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:51.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:51 smithi028 ceph-mon[31564]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-06T08:37:51.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:51 smithi028 ceph-mon[31564]: from='osd.9 [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:37:51.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:51 smithi028 ceph-mon[31564]: osdmap e65: 10 total, 9 up, 10 in 2024-06-06T08:37:51.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:51.793 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:51 smithi028 ceph-mon[31564]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:37:51.793 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:51.793 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:51.793 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:37:51 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:37:51.635+0000 7efc91a00700 -1 osd.9 0 waiting for initial osdmap 2024-06-06T08:37:51.794 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:37:51 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:37:51.652+0000 7efc8c800700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T08:37:51.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:51 smithi037 ceph-mon[36609]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:51.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:51 smithi037 ceph-mon[36609]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-06T08:37:51.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:51 smithi037 ceph-mon[36609]: from='osd.9 [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:37:51.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:51 smithi037 ceph-mon[36609]: osdmap e65: 10 total, 9 up, 10 in 2024-06-06T08:37:51.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:51.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:51 smithi037 ceph-mon[36609]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:37:51.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:51.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:52.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:51 smithi059 ceph-mon[36684]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:52.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:51 smithi059 ceph-mon[36684]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-06T08:37:52.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:51 smithi059 ceph-mon[36684]: from='osd.9 [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:37:52.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:51 smithi059 ceph-mon[36684]: osdmap e65: 10 total, 9 up, 10 in 2024-06-06T08:37:52.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:52.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:51 smithi059 ceph-mon[36684]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]: dispatch 2024-06-06T08:37:52.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:52.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:52.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:52 smithi028 ceph-mon[31564]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:37:52.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:52 smithi028 ceph-mon[31564]: osdmap e66: 10 total, 9 up, 10 in 2024-06-06T08:37:52.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:52 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:52.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:52 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:52.958 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:52 smithi037 ceph-mon[36609]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:37:52.958 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:52 smithi037 ceph-mon[36609]: osdmap e66: 10 total, 9 up, 10 in 2024-06-06T08:37:52.958 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:52 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:52.958 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:52 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:53.001 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:52 smithi059 ceph-mon[36684]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi028", "root=default"]}]': finished 2024-06-06T08:37:53.001 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:52 smithi059 ceph-mon[36684]: osdmap e66: 10 total, 9 up, 10 in 2024-06-06T08:37:53.001 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:52 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:53.001 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:52 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:53 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:37:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:53 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:37:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:53 smithi028 ceph-mon[31564]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:53 smithi028 ceph-mon[31564]: osd.9 [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355] boot 2024-06-06T08:37:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:53 smithi028 ceph-mon[31564]: osdmap e67: 10 total, 10 up, 10 in 2024-06-06T08:37:54.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:54.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:53 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:37:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:53 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:37:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:53 smithi037 ceph-mon[36609]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:53 smithi037 ceph-mon[36609]: osd.9 [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355] boot 2024-06-06T08:37:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:53 smithi037 ceph-mon[36609]: osdmap e67: 10 total, 10 up, 10 in 2024-06-06T08:37:54.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:53 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:37:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:53 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:37:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:53 smithi059 ceph-mon[36684]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-06-06T08:37:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:53 smithi059 ceph-mon[36684]: osd.9 [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355] boot 2024-06-06T08:37:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:53 smithi059 ceph-mon[36684]: osdmap e67: 10 total, 10 up, 10 in 2024-06-06T08:37:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T08:37:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-06T08:37:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-06T08:37:54.224 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2024-06-06T08:37:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2024-06-06T08:37:54.224 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122561 s, 856 MB/s 2024-06-06T08:37:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2024-06-06T08:37:54.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:54 smithi037 ceph-mon[36609]: osdmap e68: 10 total, 10 up, 10 in 2024-06-06T08:37:54.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_1 2024-06-06T08:37:55.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:54 smithi028 ceph-mon[31564]: osdmap e68: 10 total, 10 up, 10 in 2024-06-06T08:37:55.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:54 smithi059 ceph-mon[36684]: osdmap e68: 10 total, 10 up, 10 in 2024-06-06T08:37:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:37:55.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:55 smithi028 ceph-mon[31564]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:37:56.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:55 smithi037 ceph-mon[36609]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:37:56.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:55 smithi059 ceph-mon[36684]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:37:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.036+0000 7f039fc14700 1 -- 172.21.15.37:0/2569246245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0398102f70 msgr2=0x7f0398105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:37:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.036+0000 7f039fc14700 1 --2- 172.21.15.37:0/2569246245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0398102f70 0x7f0398105360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0394009990 tx=0x7f0394009ca0 comp rx=0 tx=0).stop 2024-06-06T08:37:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.036+0000 7f039fc14700 1 -- 172.21.15.37:0/2569246245 shutdown_connections 2024-06-06T08:37:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.036+0000 7f039fc14700 1 --2- 172.21.15.37:0/2569246245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03981081d0 0x7f039810a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.036+0000 7f039fc14700 1 --2- 172.21.15.37:0/2569246245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0398102f70 0x7f0398105360 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:57.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.036+0000 7f039fc14700 1 --2- 172.21.15.37:0/2569246245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03981058a0 0x7f0398107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:57.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.036+0000 7f039fc14700 1 -- 172.21.15.37:0/2569246245 >> 172.21.15.37:0/2569246245 conn(0x7f03980fc980 msgr2=0x7f03980fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:37:57.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.036+0000 7f039fc14700 1 -- 172.21.15.37:0/2569246245 shutdown_connections 2024-06-06T08:37:57.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.036+0000 7f039fc14700 1 -- 172.21.15.37:0/2569246245 wait complete. 2024-06-06T08:37:57.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039fc14700 1 Processor -- start 2024-06-06T08:37:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039fc14700 1 -- start start 2024-06-06T08:37:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039fc14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0398102f70 0x7f03981028d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:37:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039fc14700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03981058a0 0x7f0398100f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:37:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039fc14700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03981081d0 0x7f0398101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:37:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039fc14700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f039810e130 con 0x7f03981058a0 2024-06-06T08:37:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039fc14700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f039810dfb0 con 0x7f03981081d0 2024-06-06T08:37:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039fc14700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f039810e2b0 con 0x7f0398102f70 2024-06-06T08:37:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039e1b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03981081d0 0x7f0398101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:37:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039e1b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03981081d0 0x7f0398101460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47234/0 (socket says 172.21.15.37:47234) 2024-06-06T08:37:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039e1b1700 1 -- 172.21.15.37:0/2112341945 learned_addr learned my addr 172.21.15.37:0/2112341945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-06-06T08:37:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.037+0000 7f039d9b0700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0398102f70 0x7f03981028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f039e1b1700 1 -- 172.21.15.37:0/2112341945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0398102f70 msgr2=0x7f03981028d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f039e1b1700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0398102f70 0x7f03981028d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f039e1b1700 1 -- 172.21.15.37:0/2112341945 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03981058a0 msgr2=0x7f0398100f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f039e1b1700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03981058a0 0x7f0398100f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f039e1b1700 1 -- 172.21.15.37:0/2112341945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0398101d10 con 0x7f03981081d0 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f039d9b0700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0398102f70 0x7f03981028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f039e1b1700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03981081d0 0x7f0398101460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f039000b9e0 tx=0x7f039000bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f038effd700 1 -- 172.21.15.37:0/2112341945 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0390019070 con 0x7f03981081d0 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f038effd700 1 -- 172.21.15.37:0/2112341945 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0390014440 con 0x7f03981081d0 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f039fc14700 1 -- 172.21.15.37:0/2112341945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03981a28d0 con 0x7f03981081d0 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f038effd700 1 -- 172.21.15.37:0/2112341945 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03900125a0 con 0x7f03981081d0 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.038+0000 7f039fc14700 1 -- 172.21.15.37:0/2112341945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03981a2d90 con 0x7f03981081d0 2024-06-06T08:37:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.039+0000 7f039fc14700 1 -- 172.21.15.37:0/2112341945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0398069180 con 0x7f03981081d0 2024-06-06T08:37:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.040+0000 7f038effd700 1 -- 172.21.15.37:0/2112341945 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f039001c070 con 0x7f03981081d0 2024-06-06T08:37:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.041+0000 7f038effd700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f03840a2c20 0x7f03840a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:37:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.041+0000 7f038effd700 1 -- 172.21.15.37:0/2112341945 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7f03900cdc70 con 0x7f03981081d0 2024-06-06T08:37:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.041+0000 7f039d9b0700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f03840a2c20 0x7f03840a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:37:57.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.042+0000 7f039d9b0700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f03840a2c20 0x7f03840a50e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f039400b5c0 tx=0x7f0394005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:37:57.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.046+0000 7f038effd700 1 -- 172.21.15.37:0/2112341945 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f039009b3d0 con 0x7f03981081d0 2024-06-06T08:37:57.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:37:57.263+0000 7f039fc14700 1 -- 172.21.15.37:0/2112341945 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f03980628d0 con 0x7f03840a2c20 2024-06-06T08:37:57.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:37:57.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi028 2024-06-06T08:37:57.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi028 to 4273M 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:57.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:57.793 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.793 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:37:57.793 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:37:57.793 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:57.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:37:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi028 2024-06-06T08:37:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi028 to 4273M 2024-06-06T08:37:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:57.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:57.815 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.815 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:57.815 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:57.815 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:57.815 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.815 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:37:57.815 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:37:57.815 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:57.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:37:57.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi028 2024-06-06T08:37:57.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:37:57.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi028 to 4273M 2024-06-06T08:37:57.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:57.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:57.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:37:57.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:57.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:37:57.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:37:57.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:37:57.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:37:57.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:37:58.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:58 smithi028 ceph-mon[31564]: from='client.24380 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:37:58.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:58 smithi037 ceph-mon[36609]: from='client.24380 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:37:58.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:58 smithi059 ceph-mon[36684]: from='client.24380 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:37:59.562 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:37:59 smithi037 ceph-mon[36609]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:37:59.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:37:59 smithi028 ceph-mon[31564]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:37:59.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:37:59 smithi059 ceph-mon[36684]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:00.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:00 smithi028 ceph-mon[31564]: from='client.? 172.21.15.37:0/1720573480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc418661-5e89-4241-b14b-241a2be432f6"}]: dispatch 2024-06-06T08:38:00.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:00 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc418661-5e89-4241-b14b-241a2be432f6"}]: dispatch 2024-06-06T08:38:00.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:00 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc418661-5e89-4241-b14b-241a2be432f6"}]': finished 2024-06-06T08:38:00.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:00 smithi028 ceph-mon[31564]: osdmap e69: 11 total, 10 up, 11 in 2024-06-06T08:38:00.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:00 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:00.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:00 smithi037 ceph-mon[36609]: from='client.? 172.21.15.37:0/1720573480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc418661-5e89-4241-b14b-241a2be432f6"}]: dispatch 2024-06-06T08:38:00.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:00 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc418661-5e89-4241-b14b-241a2be432f6"}]: dispatch 2024-06-06T08:38:00.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:00 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc418661-5e89-4241-b14b-241a2be432f6"}]': finished 2024-06-06T08:38:00.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:00 smithi037 ceph-mon[36609]: osdmap e69: 11 total, 10 up, 11 in 2024-06-06T08:38:00.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:00 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:00.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:00 smithi059 ceph-mon[36684]: from='client.? 172.21.15.37:0/1720573480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc418661-5e89-4241-b14b-241a2be432f6"}]: dispatch 2024-06-06T08:38:00.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:00 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc418661-5e89-4241-b14b-241a2be432f6"}]: dispatch 2024-06-06T08:38:00.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:00 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc418661-5e89-4241-b14b-241a2be432f6"}]': finished 2024-06-06T08:38:00.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:00 smithi059 ceph-mon[36684]: osdmap e69: 11 total, 10 up, 11 in 2024-06-06T08:38:00.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:00 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:01.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:01 smithi037 ceph-mon[36609]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:01.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:01 smithi037 ceph-mon[36609]: from='client.? 172.21.15.37:0/2561346369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:38:01.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:01 smithi059 ceph-mon[36684]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:01.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:01 smithi059 ceph-mon[36684]: from='client.? 172.21.15.37:0/2561346369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:38:02.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:01 smithi028 ceph-mon[31564]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:02.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:01 smithi028 ceph-mon[31564]: from='client.? 172.21.15.37:0/2561346369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:38:03.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:03 smithi037 ceph-mon[36609]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:03.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:03 smithi059 ceph-mon[36684]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:04.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:03 smithi028 ceph-mon[31564]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:05.582 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:05 smithi037 ceph-mon[36609]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:05.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:05 smithi059 ceph-mon[36684]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:06.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:05 smithi028 ceph-mon[31564]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:07.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:07 smithi037 ceph-mon[36609]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:07.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:07 smithi059 ceph-mon[36684]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:08.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:07 smithi028 ceph-mon[31564]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:08.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:08 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-06T08:38:08.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:08 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:08.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:08 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-06T08:38:08.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:08 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:09.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:08 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-06T08:38:09.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:08 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:09.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:09 smithi059 ceph-mon[36684]: Deploying daemon osd.10 on smithi037 2024-06-06T08:38:09.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:09 smithi059 ceph-mon[36684]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:09.860 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:09 smithi037 ceph-mon[36609]: Deploying daemon osd.10 on smithi037 2024-06-06T08:38:09.860 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:09 smithi037 ceph-mon[36609]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:10.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:09 smithi028 ceph-mon[31564]: Deploying daemon osd.10 on smithi037 2024-06-06T08:38:10.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:09 smithi028 ceph-mon[31564]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:11.759 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:11 smithi037 ceph-mon[36609]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:11.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:11 smithi059 ceph-mon[36684]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:12.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:11 smithi028 ceph-mon[31564]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:13.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:13 smithi037 ceph-mon[36609]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:13.843 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:13 smithi028 ceph-mon[31564]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:13.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:13 smithi059 ceph-mon[36684]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:14.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:14 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:14.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:14 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:14.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:14 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:14.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:14 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:14.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:14 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:14.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:14 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:14.879 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:14 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:14.879 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:14 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:14.879 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:14 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:16.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:15 smithi028 ceph-mon[31564]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:16.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:15 smithi037 ceph-mon[36609]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:16.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:15 smithi059 ceph-mon[36684]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:17.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.807+0000 7f038effd700 1 -- 172.21.15.37:0/2112341945 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f03980628d0 con 0x7f03840a2c20 2024-06-06T08:38:17.805 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 10 on host 'smithi037' 2024-06-06T08:38:17.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 -- 172.21.15.37:0/2112341945 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f03840a2c20 msgr2=0x7f03840a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:17.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f03840a2c20 0x7f03840a50e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f039400b5c0 tx=0x7f0394005fb0 comp rx=0 tx=0).stop 2024-06-06T08:38:17.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 -- 172.21.15.37:0/2112341945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03981081d0 msgr2=0x7f0398101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:17.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03981081d0 0x7f0398101460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f039000b9e0 tx=0x7f039000bda0 comp rx=0 tx=0).stop 2024-06-06T08:38:17.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 -- 172.21.15.37:0/2112341945 shutdown_connections 2024-06-06T08:38:17.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f03840a2c20 0x7f03840a50e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:17.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03981081d0 0x7f0398101460 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:17.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0398102f70 0x7f03981028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:17.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 --2- 172.21.15.37:0/2112341945 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03981058a0 0x7f0398100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:17.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 -- 172.21.15.37:0/2112341945 >> 172.21.15.37:0/2112341945 conn(0x7f03980fc980 msgr2=0x7f03981038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:38:17.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 -- 172.21.15.37:0/2112341945 shutdown_connections 2024-06-06T08:38:17.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-06-06T08:38:17.809+0000 7f039fc14700 1 -- 172.21.15.37:0/2112341945 wait complete. 2024-06-06T08:38:18.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:17 smithi037 ceph-mon[36609]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:18.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:17 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:17 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:17 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:18.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:17 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:18.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:17 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:17 smithi037 ceph-mon[36609]: from='osd.10 [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T08:38:18.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:17 smithi037 ceph-mon[36609]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T08:38:18.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:17 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:17 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:17 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:18.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:17 smithi059 ceph-mon[36684]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:18.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:17 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:17 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:17 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:18.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:17 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:18.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:17 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:17 smithi059 ceph-mon[36684]: from='osd.10 [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T08:38:18.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:17 smithi059 ceph-mon[36684]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T08:38:18.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:17 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:17 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:17 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:18.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:17 smithi028 ceph-mon[31564]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:18.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:17 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:17 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:17 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:18.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:17 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:18.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:17 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:17 smithi028 ceph-mon[31564]: from='osd.10 [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T08:38:18.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:17 smithi028 ceph-mon[31564]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T08:38:18.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:17 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:17 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:18.292 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:17 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:18.512 DEBUG:teuthology.orchestra.run.smithi037:osd.10> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.10.service 2024-06-06T08:38:18.514 INFO:tasks.cephadm:Deploying osd.11 on smithi059 with /dev/vg_nvme/lv_1... 2024-06-06T08:38:18.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-06T08:38:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:38:19.185 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:19 smithi059 ceph-mon[36684]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-06T08:38:19.185 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:19 smithi059 ceph-mon[36684]: from='osd.10 [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:38:19.185 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:19 smithi059 ceph-mon[36684]: osdmap e70: 11 total, 10 up, 11 in 2024-06-06T08:38:19.186 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:19 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:19.186 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:19 smithi059 ceph-mon[36684]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:38:19.186 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:19 smithi059 ceph-mon[36684]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:19.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:19 smithi037 ceph-mon[36609]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-06T08:38:19.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:19 smithi037 ceph-mon[36609]: from='osd.10 [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:38:19.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:19 smithi037 ceph-mon[36609]: osdmap e70: 11 total, 10 up, 11 in 2024-06-06T08:38:19.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:19 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:19.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:19 smithi037 ceph-mon[36609]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:38:19.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:19 smithi037 ceph-mon[36609]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:19.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:38:19 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:38:19.043+0000 7fd033bd5700 -1 osd.10 0 waiting for initial osdmap 2024-06-06T08:38:19.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:38:19 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:38:19.057+0000 7fd02f9c8700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T08:38:19.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:19 smithi028 ceph-mon[31564]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-06T08:38:19.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:19 smithi028 ceph-mon[31564]: from='osd.10 [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:38:19.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:19 smithi028 ceph-mon[31564]: osdmap e70: 11 total, 10 up, 11 in 2024-06-06T08:38:19.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:19 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:19.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:19 smithi028 ceph-mon[31564]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-06-06T08:38:19.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:19 smithi028 ceph-mon[31564]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-06-06T08:38:20.208 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:20 smithi059 ceph-mon[36684]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:38:20.209 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:20 smithi059 ceph-mon[36684]: osdmap e71: 11 total, 10 up, 11 in 2024-06-06T08:38:20.209 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:20 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:20.209 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:20 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:20.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:20 smithi037 ceph-mon[36609]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:38:20.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:20 smithi037 ceph-mon[36609]: osdmap e71: 11 total, 10 up, 11 in 2024-06-06T08:38:20.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:20 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:20.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:20 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:20.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:20 smithi028 ceph-mon[31564]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-06-06T08:38:20.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:20 smithi028 ceph-mon[31564]: osdmap e71: 11 total, 10 up, 11 in 2024-06-06T08:38:20.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:20 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:20.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:20 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:20.796 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-06T08:38:20.796 INFO:teuthology.orchestra.run.smithi059.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-06T08:38:20.796 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10+0 records in 2024-06-06T08:38:20.796 INFO:teuthology.orchestra.run.smithi059.stderr:10+0 records out 2024-06-06T08:38:20.796 INFO:teuthology.orchestra.run.smithi059.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109711 s, 956 MB/s 2024-06-06T08:38:20.796 INFO:teuthology.orchestra.run.smithi059.stderr:--> Zapping successful for: 2024-06-06T08:38:21.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:21 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:38:21.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:21 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:38:21.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:21 smithi037 ceph-mon[36609]: osd.10 [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372] boot 2024-06-06T08:38:21.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:21 smithi037 ceph-mon[36609]: osdmap e72: 11 total, 11 up, 11 in 2024-06-06T08:38:21.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:21.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:21 smithi037 ceph-mon[36609]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:21.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:21 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:38:21.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:21 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:38:21.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:21 smithi059 ceph-mon[36684]: osd.10 [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372] boot 2024-06-06T08:38:21.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:21 smithi059 ceph-mon[36684]: osdmap e72: 11 total, 11 up, 11 in 2024-06-06T08:38:21.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:21.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:21 smithi059 ceph-mon[36684]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:21.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_1 2024-06-06T08:38:21.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:21 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:38:21.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:21 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:38:21.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:21 smithi028 ceph-mon[31564]: osd.10 [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372] boot 2024-06-06T08:38:21.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:21 smithi028 ceph-mon[31564]: osdmap e72: 11 total, 11 up, 11 in 2024-06-06T08:38:21.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T08:38:21.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:21 smithi028 ceph-mon[31564]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:21.728 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:38:22.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: osdmap e73: 11 total, 11 up, 11 in 2024-06-06T08:38:22.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi037 2024-06-06T08:38:22.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi037 to 4273M 2024-06-06T08:38:22.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:22.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:22.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:22 smithi037 ceph-mon[36609]: osdmap e74: 11 total, 11 up, 11 in 2024-06-06T08:38:22.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: osdmap e73: 11 total, 11 up, 11 in 2024-06-06T08:38:22.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi037 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi037 to 4273M 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:22 smithi059 ceph-mon[36684]: osdmap e74: 11 total, 11 up, 11 in 2024-06-06T08:38:22.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: osdmap e73: 11 total, 11 up, 11 in 2024-06-06T08:38:22.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi037 2024-06-06T08:38:22.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:22.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi037 to 4273M 2024-06-06T08:38:22.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:22.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:22.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:22.542 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:22 smithi028 ceph-mon[31564]: osdmap e74: 11 total, 11 up, 11 in 2024-06-06T08:38:23.197 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:23 smithi059 ceph-mon[36684]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.414+0000 7f5f826d3700 1 -- 172.21.15.59:0/2784663210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7c102510 msgr2=0x7f5f7c102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.414+0000 7f5f826d3700 1 --2- 172.21.15.59:0/2784663210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7c102510 0x7f5f7c102930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009990 tx=0x7f5f64009ca0 comp rx=0 tx=0).stop 2024-06-06T08:38:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.414+0000 7f5f826d3700 1 -- 172.21.15.59:0/2784663210 shutdown_connections 2024-06-06T08:38:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.414+0000 7f5f826d3700 1 --2- 172.21.15.59:0/2784663210 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f7c1040b0 0x7f5f7c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.414+0000 7f5f826d3700 1 --2- 172.21.15.59:0/2784663210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7c102510 0x7f5f7c102930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.414+0000 7f5f826d3700 1 --2- 172.21.15.59:0/2784663210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7c103710 0x7f5f7c103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.414+0000 7f5f826d3700 1 -- 172.21.15.59:0/2784663210 >> 172.21.15.59:0/2784663210 conn(0x7f5f7c0fdab0 msgr2=0x7f5f7c0ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:38:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.414+0000 7f5f826d3700 1 -- 172.21.15.59:0/2784663210 shutdown_connections 2024-06-06T08:38:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.414+0000 7f5f826d3700 1 -- 172.21.15.59:0/2784663210 wait complete. 2024-06-06T08:38:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.415+0000 7f5f826d3700 1 Processor -- start 2024-06-06T08:38:23.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.415+0000 7f5f826d3700 1 -- start start 2024-06-06T08:38:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.415+0000 7f5f826d3700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f7c102510 0x7f5f7c076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.415+0000 7f5f826d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7c103710 0x7f5f7c074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.415+0000 7f5f826d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7c1040b0 0x7f5f7c074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.415+0000 7f5f826d3700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c10e1d0 con 0x7f5f7c102510 2024-06-06T08:38:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.415+0000 7f5f826d3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c10e050 con 0x7f5f7c103710 2024-06-06T08:38:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.415+0000 7f5f826d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c10e350 con 0x7f5f7c1040b0 2024-06-06T08:38:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.415+0000 7f5f80c70700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7c1040b0 0x7f5f7c074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:23.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.415+0000 7f5f80c70700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7c1040b0 0x7f5f7c074dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35478/0 (socket says 172.21.15.59:35478) 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.415+0000 7f5f80c70700 1 -- 172.21.15.59:0/3141926511 learned_addr learned my addr 172.21.15.59:0/3141926511 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f7b7fe700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7c103710 0x7f5f7c074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f80c70700 1 -- 172.21.15.59:0/3141926511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7c103710 msgr2=0x7f5f7c074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f80c70700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7c103710 0x7f5f7c074880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f80c70700 1 -- 172.21.15.59:0/3141926511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f7c102510 msgr2=0x7f5f7c076230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f80c70700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f7c102510 0x7f5f7c076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f80c70700 1 -- 172.21.15.59:0/3141926511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c075670 con 0x7f5f7c1040b0 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f80c70700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7c1040b0 0x7f5f7c074dc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400b970 tx=0x7f5f7400bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f797fa700 1 -- 172.21.15.59:0/3141926511 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f74019070 con 0x7f5f7c1040b0 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f797fa700 1 -- 172.21.15.59:0/3141926511 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f7400ce10 con 0x7f5f7c1040b0 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f797fa700 1 -- 172.21.15.59:0/3141926511 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f74007370 con 0x7f5f7c1040b0 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f826d3700 1 -- 172.21.15.59:0/3141926511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7c1a2970 con 0x7f5f7c1040b0 2024-06-06T08:38:23.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.416+0000 7f5f826d3700 1 -- 172.21.15.59:0/3141926511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7c1a2f30 con 0x7f5f7c1040b0 2024-06-06T08:38:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.417+0000 7f5f826d3700 1 -- 172.21.15.59:0/3141926511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7c069180 con 0x7f5f7c1040b0 2024-06-06T08:38:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.418+0000 7f5f797fa700 1 -- 172.21.15.59:0/3141926511 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5f7401c070 con 0x7f5f7c1040b0 2024-06-06T08:38:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.419+0000 7f5f797fa700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5f680a2ca0 0x7f5f680a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.419+0000 7f5f797fa700 1 -- 172.21.15.59:0/3141926511 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6694+0+0 (secure 0 0 0) 0x7f5f740cdd90 con 0x7f5f7c1040b0 2024-06-06T08:38:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.419+0000 7f5f7bfff700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5f680a2ca0 0x7f5f680a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:23.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.420+0000 7f5f7bfff700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5f680a2ca0 0x7f5f680a5160 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5f640098e0 tx=0x7f5f64005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:38:23.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.424+0000 7f5f797fa700 1 -- 172.21.15.59:0/3141926511 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5f7409b2a0 con 0x7f5f7c1040b0 2024-06-06T08:38:23.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:23 smithi028 ceph-mon[31564]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:23.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:23 smithi037 ceph-mon[36609]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:23.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:23.642+0000 7f5f826d3700 1 -- 172.21.15.59:0/3141926511 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5f7c0628d0 con 0x7f5f680a2ca0 2024-06-06T08:38:24.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:24 smithi059 ceph-mon[36684]: osdmap e75: 11 total, 11 up, 11 in 2024-06-06T08:38:24.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:24 smithi059 ceph-mon[36684]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:38:24.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:38:24.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:38:24.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:24.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:24 smithi028 ceph-mon[31564]: osdmap e75: 11 total, 11 up, 11 in 2024-06-06T08:38:24.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:24 smithi028 ceph-mon[31564]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:38:24.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:38:24.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:38:24.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:24.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:24 smithi037 ceph-mon[36609]: osdmap e75: 11 total, 11 up, 11 in 2024-06-06T08:38:24.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:24 smithi037 ceph-mon[36609]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:38:24.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T08:38:24.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T08:38:24.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:25.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:25 smithi059 ceph-mon[36684]: osdmap e76: 11 total, 11 up, 11 in 2024-06-06T08:38:25.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:25 smithi059 ceph-mon[36684]: pgmap v268: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-06T08:38:25.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:25 smithi028 ceph-mon[31564]: osdmap e76: 11 total, 11 up, 11 in 2024-06-06T08:38:25.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:25 smithi028 ceph-mon[31564]: pgmap v268: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-06T08:38:25.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:25 smithi037 ceph-mon[36609]: osdmap e76: 11 total, 11 up, 11 in 2024-06-06T08:38:25.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:25 smithi037 ceph-mon[36609]: pgmap v268: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-06T08:38:27.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:27 smithi028 ceph-mon[31564]: pgmap v269: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-06-06T08:38:27.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:27 smithi028 ceph-mon[31564]: from='client.? 172.21.15.59:0/2603578758' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e54d81ee-1461-4229-a1c0-c6e750dd66ed"}]: dispatch 2024-06-06T08:38:27.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:27 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e54d81ee-1461-4229-a1c0-c6e750dd66ed"}]: dispatch 2024-06-06T08:38:27.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:27 smithi028 ceph-mon[31564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e54d81ee-1461-4229-a1c0-c6e750dd66ed"}]': finished 2024-06-06T08:38:27.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:27 smithi028 ceph-mon[31564]: osdmap e77: 12 total, 11 up, 12 in 2024-06-06T08:38:27.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:27.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:27 smithi028 ceph-mon[31564]: from='client.? 172.21.15.59:0/643897781' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:38:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:27 smithi037 ceph-mon[36609]: pgmap v269: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-06-06T08:38:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:27 smithi037 ceph-mon[36609]: from='client.? 172.21.15.59:0/2603578758' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e54d81ee-1461-4229-a1c0-c6e750dd66ed"}]: dispatch 2024-06-06T08:38:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:27 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e54d81ee-1461-4229-a1c0-c6e750dd66ed"}]: dispatch 2024-06-06T08:38:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:27 smithi037 ceph-mon[36609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e54d81ee-1461-4229-a1c0-c6e750dd66ed"}]': finished 2024-06-06T08:38:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:27 smithi037 ceph-mon[36609]: osdmap e77: 12 total, 11 up, 12 in 2024-06-06T08:38:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:27 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:27 smithi037 ceph-mon[36609]: from='client.? 172.21.15.59:0/643897781' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:38:27.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:27 smithi059 ceph-mon[36684]: pgmap v269: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-06-06T08:38:27.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:27 smithi059 ceph-mon[36684]: from='client.? 172.21.15.59:0/2603578758' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e54d81ee-1461-4229-a1c0-c6e750dd66ed"}]: dispatch 2024-06-06T08:38:27.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:27 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e54d81ee-1461-4229-a1c0-c6e750dd66ed"}]: dispatch 2024-06-06T08:38:27.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:27 smithi059 ceph-mon[36684]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e54d81ee-1461-4229-a1c0-c6e750dd66ed"}]': finished 2024-06-06T08:38:27.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:27 smithi059 ceph-mon[36684]: osdmap e77: 12 total, 11 up, 12 in 2024-06-06T08:38:27.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:27 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:27.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:27 smithi059 ceph-mon[36684]: from='client.? 172.21.15.59:0/643897781' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T08:38:29.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:29 smithi028 ceph-mon[31564]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:38:29.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:29 smithi037 ceph-mon[36609]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:38:29.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:29 smithi059 ceph-mon[36684]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T08:38:31.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:31 smithi028 ceph-mon[31564]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:31.562 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:31 smithi059 ceph-mon[36684]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:31.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:31 smithi037 ceph-mon[36609]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:33.345 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:33 smithi059 ceph-mon[36684]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:33.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:33 smithi028 ceph-mon[31564]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:33.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:33 smithi037 ceph-mon[36609]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:34.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-06T08:38:34.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:34 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:34.545 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-06T08:38:34.546 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:34 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:34.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-06T08:38:34.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:34 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:35.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:35 smithi028 ceph-mon[31564]: Deploying daemon osd.11 on smithi059 2024-06-06T08:38:35.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:35 smithi028 ceph-mon[31564]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:35.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:35 smithi037 ceph-mon[36609]: Deploying daemon osd.11 on smithi059 2024-06-06T08:38:35.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:35 smithi037 ceph-mon[36609]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:35.577 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:35 smithi059 ceph-mon[36684]: Deploying daemon osd.11 on smithi059 2024-06-06T08:38:35.577 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:35 smithi059 ceph-mon[36684]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:37.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:37 smithi028 ceph-mon[31564]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:37.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:37 smithi037 ceph-mon[36609]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:37.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:37 smithi059 ceph-mon[36684]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:39.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:39 smithi028 ceph-mon[31564]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:39.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:39 smithi037 ceph-mon[36609]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:39.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:39 smithi059 ceph-mon[36684]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:40.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:40.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:40.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:40.543 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:40.543 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:40.543 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:40.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:40.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:40.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:41.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:41 smithi059 ceph-mon[36684]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:42.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:41 smithi028 ceph-mon[31564]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:42.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:41 smithi037 ceph-mon[36609]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:43.486 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 11 on host 'smithi059' 2024-06-06T08:38:43.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.487+0000 7f5f797fa700 1 -- 172.21.15.59:0/3141926511 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5f7c0628d0 con 0x7f5f680a2ca0 2024-06-06T08:38:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 -- 172.21.15.59:0/3141926511 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5f680a2ca0 msgr2=0x7f5f680a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5f680a2ca0 0x7f5f680a5160 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5f640098e0 tx=0x7f5f64005fb0 comp rx=0 tx=0).stop 2024-06-06T08:38:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 -- 172.21.15.59:0/3141926511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7c1040b0 msgr2=0x7f5f7c074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:43.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7c1040b0 0x7f5f7c074dc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400b970 tx=0x7f5f7400bc80 comp rx=0 tx=0).stop 2024-06-06T08:38:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 -- 172.21.15.59:0/3141926511 shutdown_connections 2024-06-06T08:38:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5f680a2ca0 0x7f5f680a5160 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f7c1040b0 0x7f5f7c074dc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f7c102510 0x7f5f7c076230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 --2- 172.21.15.59:0/3141926511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7c103710 0x7f5f7c074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 -- 172.21.15.59:0/3141926511 >> 172.21.15.59:0/3141926511 conn(0x7f5f7c0fdab0 msgr2=0x7f5f7c106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:38:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 -- 172.21.15.59:0/3141926511 shutdown_connections 2024-06-06T08:38:43.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:43.490+0000 7f5f826d3700 1 -- 172.21.15.59:0/3141926511 wait complete. 2024-06-06T08:38:44.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:43 smithi037 ceph-mon[36609]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:44.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:44.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:44.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:43 smithi037 ceph-mon[36609]: from='osd.11 [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T08:38:44.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:43 smithi037 ceph-mon[36609]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T08:38:44.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:44.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:43 smithi059 ceph-mon[36684]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:44.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:44.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:44.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.081 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:43 smithi059 ceph-mon[36684]: from='osd.11 [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T08:38:44.082 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:43 smithi059 ceph-mon[36684]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T08:38:44.082 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.082 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:44.082 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.108 DEBUG:teuthology.orchestra.run.smithi059:osd.11> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.11.service 2024-06-06T08:38:44.111 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-06-06T08:38:44.112 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-06T08:38:44.206 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:43 smithi028 ceph-mon[31564]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:44.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:44.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:44.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:43 smithi028 ceph-mon[31564]: from='osd.11 [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T08:38:44.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:43 smithi028 ceph-mon[31564]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T08:38:44.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:44.208 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:44.582 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:38:45.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:44 smithi028 ceph-mon[31564]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-06T08:38:45.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:44 smithi028 ceph-mon[31564]: osdmap e78: 12 total, 11 up, 12 in 2024-06-06T08:38:45.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:44 smithi028 ceph-mon[31564]: from='osd.11 [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:38:45.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:44 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:45.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:44 smithi028 ceph-mon[31564]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:38:45.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:44 smithi059 ceph-mon[36684]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-06T08:38:45.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:44 smithi059 ceph-mon[36684]: osdmap e78: 12 total, 11 up, 12 in 2024-06-06T08:38:45.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:44 smithi059 ceph-mon[36684]: from='osd.11 [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:38:45.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:44 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:45.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:44 smithi059 ceph-mon[36684]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:38:45.100 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:38:44 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:38:44.850+0000 7f248f43d700 -1 osd.11 0 waiting for initial osdmap 2024-06-06T08:38:45.100 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:38:44 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:38:44.869+0000 7f248b230700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T08:38:45.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:44 smithi037 ceph-mon[36609]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-06T08:38:45.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:44 smithi037 ceph-mon[36609]: osdmap e78: 12 total, 11 up, 12 in 2024-06-06T08:38:45.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:44 smithi037 ceph-mon[36609]: from='osd.11 [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:38:45.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:44 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:45.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:44 smithi037 ceph-mon[36609]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-06-06T08:38:46.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:45 smithi028 ceph-mon[31564]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:46.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:45 smithi028 ceph-mon[31564]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:38:46.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:45 smithi028 ceph-mon[31564]: osdmap e79: 12 total, 11 up, 12 in 2024-06-06T08:38:46.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:46.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:46.202 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:45 smithi037 ceph-mon[36609]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:46.202 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:45 smithi037 ceph-mon[36609]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:38:46.202 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:45 smithi037 ceph-mon[36609]: osdmap e79: 12 total, 11 up, 12 in 2024-06-06T08:38:46.202 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:46.203 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:46.324 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:45 smithi059 ceph-mon[36684]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:46.324 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:45 smithi059 ceph-mon[36684]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-06-06T08:38:46.324 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:45 smithi059 ceph-mon[36684]: osdmap e79: 12 total, 11 up, 12 in 2024-06-06T08:38:46.324 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:46.324 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:47.014 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:46 smithi059 ceph-mon[36684]: purged_snaps scrub starts 2024-06-06T08:38:47.014 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:46 smithi059 ceph-mon[36684]: purged_snaps scrub ok 2024-06-06T08:38:47.014 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:46 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:47.014 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:46 smithi059 ceph-mon[36684]: osd.11 [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798] boot 2024-06-06T08:38:47.014 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:46 smithi059 ceph-mon[36684]: osdmap e80: 12 total, 12 up, 12 in 2024-06-06T08:38:47.014 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:46 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:47.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.020+0000 7f8a4f200700 1 -- 172.21.15.28:0/3833292443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a48103700 msgr2=0x7f8a48103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:47.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.020+0000 7f8a4f200700 1 --2- 172.21.15.28:0/3833292443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a48103700 0x7f8a48103b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009920 tx=0x7f8a30009c30 comp rx=0 tx=0).stop 2024-06-06T08:38:47.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.020+0000 7f8a4f200700 1 -- 172.21.15.28:0/3833292443 shutdown_connections 2024-06-06T08:38:47.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.020+0000 7f8a4f200700 1 --2- 172.21.15.28:0/3833292443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a481040a0 0x7f8a4810a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:47.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.020+0000 7f8a4f200700 1 --2- 172.21.15.28:0/3833292443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48102500 0x7f8a48102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:47.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.020+0000 7f8a4f200700 1 --2- 172.21.15.28:0/3833292443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a48103700 0x7f8a48103b60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:47.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.020+0000 7f8a4f200700 1 -- 172.21.15.28:0/3833292443 >> 172.21.15.28:0/3833292443 conn(0x7f8a480fda60 msgr2=0x7f8a480ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:38:47.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.020+0000 7f8a4f200700 1 -- 172.21.15.28:0/3833292443 shutdown_connections 2024-06-06T08:38:47.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.020+0000 7f8a4f200700 1 -- 172.21.15.28:0/3833292443 wait complete. 2024-06-06T08:38:47.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.021+0000 7f8a4f200700 1 Processor -- start 2024-06-06T08:38:47.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.021+0000 7f8a4f200700 1 -- start start 2024-06-06T08:38:47.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.022+0000 7f8a4f200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48102500 0x7f8a4819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:47.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.022+0000 7f8a4f200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48103700 0x7f8a4819afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:47.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.022+0000 7f8a4f200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a481040a0 0x7f8a481a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:47.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.022+0000 7f8a4f200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4810e130 con 0x7f8a48103700 2024-06-06T08:38:47.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.022+0000 7f8a4f200700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4810dfb0 con 0x7f8a481040a0 2024-06-06T08:38:47.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.022+0000 7f8a4f200700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4810e2b0 con 0x7f8a48102500 2024-06-06T08:38:47.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.022+0000 7f8a47e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48102500 0x7f8a4819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:47.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.022+0000 7f8a47e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48102500 0x7f8a4819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:39128/0 (socket says 172.21.15.28:39128) 2024-06-06T08:38:47.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.022+0000 7f8a47e00700 1 -- 172.21.15.28:0/320281081 learned_addr learned my addr 172.21.15.28:0/320281081 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:38:47.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.022+0000 7f8a3f400700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48103700 0x7f8a4819afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:47.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.022+0000 7f8a4d200700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a481040a0 0x7f8a481a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:47.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.023+0000 7f8a47e00700 1 -- 172.21.15.28:0/320281081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a481040a0 msgr2=0x7f8a481a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:47.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.023+0000 7f8a47e00700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a481040a0 0x7f8a481a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:47.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.023+0000 7f8a47e00700 1 -- 172.21.15.28:0/320281081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48103700 msgr2=0x7f8a4819afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:47.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.023+0000 7f8a47e00700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48103700 0x7f8a4819afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:47.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.023+0000 7f8a47e00700 1 -- 172.21.15.28:0/320281081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a481a2630 con 0x7f8a48102500 2024-06-06T08:38:47.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.023+0000 7f8a47e00700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48102500 0x7f8a4819aa70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800efc0 tx=0x7f8a3800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:38:47.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.023+0000 7f8a45600700 1 -- 172.21.15.28:0/320281081 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38003a00 con 0x7f8a48102500 2024-06-06T08:38:47.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.023+0000 7f8a45600700 1 -- 172.21.15.28:0/320281081 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a38003ba0 con 0x7f8a48102500 2024-06-06T08:38:47.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.023+0000 7f8a4f200700 1 -- 172.21.15.28:0/320281081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a481a2920 con 0x7f8a48102500 2024-06-06T08:38:47.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.023+0000 7f8a45600700 1 -- 172.21.15.28:0/320281081 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38004790 con 0x7f8a48102500 2024-06-06T08:38:47.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.023+0000 7f8a4f200700 1 -- 172.21.15.28:0/320281081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a481a2e10 con 0x7f8a48102500 2024-06-06T08:38:47.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.025+0000 7f8a4f200700 1 -- 172.21.15.28:0/320281081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a48069180 con 0x7f8a48102500 2024-06-06T08:38:47.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.027+0000 7f8a45600700 1 -- 172.21.15.28:0/320281081 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8a38012050 con 0x7f8a48102500 2024-06-06T08:38:47.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.028+0000 7f8a45600700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8a2c0a2c20 0x7f8a2c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:47.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.028+0000 7f8a45600700 1 -- 172.21.15.28:0/320281081 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f8a380cede0 con 0x7f8a48102500 2024-06-06T08:38:47.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.029+0000 7f8a3f400700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8a2c0a2c20 0x7f8a2c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:47.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.029+0000 7f8a3f400700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8a2c0a2c20 0x7f8a2c0a50e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000fca0 tx=0x7f8a30019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:38:47.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.031+0000 7f8a45600700 1 -- 172.21.15.28:0/320281081 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8a38010040 con 0x7f8a48102500 2024-06-06T08:38:47.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:46 smithi037 ceph-mon[36609]: purged_snaps scrub starts 2024-06-06T08:38:47.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:46 smithi037 ceph-mon[36609]: purged_snaps scrub ok 2024-06-06T08:38:47.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:46 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:47.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:46 smithi037 ceph-mon[36609]: osd.11 [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798] boot 2024-06-06T08:38:47.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:46 smithi037 ceph-mon[36609]: osdmap e80: 12 total, 12 up, 12 in 2024-06-06T08:38:47.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:46 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:47.169 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:46 smithi028 ceph-mon[31564]: purged_snaps scrub starts 2024-06-06T08:38:47.169 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:46 smithi028 ceph-mon[31564]: purged_snaps scrub ok 2024-06-06T08:38:47.169 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:46 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:47.170 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:46 smithi028 ceph-mon[31564]: osd.11 [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798] boot 2024-06-06T08:38:47.170 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:46 smithi028 ceph-mon[31564]: osdmap e80: 12 total, 12 up, 12 in 2024-06-06T08:38:47.170 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:46 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T08:38:47.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.304+0000 7f8a4f200700 1 -- 172.21.15.28:0/320281081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8a481a3200 con 0x7f8a48102500 2024-06-06T08:38:47.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.305+0000 7f8a45600700 1 -- 172.21.15.28:0/320281081 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f8a3809c140 con 0x7f8a48102500 2024-06-06T08:38:47.305 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:38:47.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.308+0000 7f8a4f200700 1 -- 172.21.15.28:0/320281081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8a2c0a2c20 msgr2=0x7f8a2c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:47.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.308+0000 7f8a4f200700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8a2c0a2c20 0x7f8a2c0a50e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000fca0 tx=0x7f8a30019040 comp rx=0 tx=0).stop 2024-06-06T08:38:47.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.308+0000 7f8a4f200700 1 -- 172.21.15.28:0/320281081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48102500 msgr2=0x7f8a4819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:47.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.308+0000 7f8a4f200700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48102500 0x7f8a4819aa70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800efc0 tx=0x7f8a3800c3a0 comp rx=0 tx=0).stop 2024-06-06T08:38:47.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.309+0000 7f8a4f200700 1 -- 172.21.15.28:0/320281081 shutdown_connections 2024-06-06T08:38:47.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.309+0000 7f8a4f200700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8a2c0a2c20 0x7f8a2c0a50e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:47.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.309+0000 7f8a4f200700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a481040a0 0x7f8a481a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:47.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.309+0000 7f8a4f200700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48102500 0x7f8a4819aa70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:47.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.309+0000 7f8a4f200700 1 --2- 172.21.15.28:0/320281081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48103700 0x7f8a4819afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:47.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.309+0000 7f8a4f200700 1 -- 172.21.15.28:0/320281081 >> 172.21.15.28:0/320281081 conn(0x7f8a480fda60 msgr2=0x7f8a480746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:38:47.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.309+0000 7f8a4f200700 1 -- 172.21.15.28:0/320281081 shutdown_connections 2024-06-06T08:38:47.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:47.309+0000 7f8a4f200700 1 -- 172.21.15.28:0/320281081 wait complete. 2024-06-06T08:38:48.116 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1717663125,"num_in_osds":12,"osd_in_since":1717663106,"num_remapped_pgs":0} 2024-06-06T08:38:48.116 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T08:38:48.186 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:48.186 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: osdmap e81: 12 total, 12 up, 12 in 2024-06-06T08:38:48.186 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.186 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.186 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.186 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.186 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.186 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.186 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.187 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:48.187 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:48.187 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.187 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:47 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/320281081' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T08:38:48.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:48.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: osdmap e81: 12 total, 12 up, 12 in 2024-06-06T08:38:48.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:48.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:48.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:47 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/320281081' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T08:38:48.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-06-06T08:38:48.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: osdmap e81: 12 total, 12 up, 12 in 2024-06-06T08:38:48.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T08:38:48.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:38:48.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:38:48.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:48.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:47 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/320281081' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T08:38:48.593 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:38:49.005 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:48 smithi028 ceph-mon[31564]: Detected new or changed devices on smithi059 2024-06-06T08:38:49.005 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:48 smithi028 ceph-mon[31564]: Adjusting osd_memory_target on smithi059 to 4273M 2024-06-06T08:38:49.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:48 smithi037 ceph-mon[36609]: Detected new or changed devices on smithi059 2024-06-06T08:38:49.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:48 smithi037 ceph-mon[36609]: Adjusting osd_memory_target on smithi059 to 4273M 2024-06-06T08:38:49.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:48 smithi059 ceph-mon[36684]: Detected new or changed devices on smithi059 2024-06-06T08:38:49.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:48 smithi059 ceph-mon[36684]: Adjusting osd_memory_target on smithi059 to 4273M 2024-06-06T08:38:50.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:49 smithi028 ceph-mon[31564]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:50.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:49 smithi037 ceph-mon[36609]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:50.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:49 smithi059 ceph-mon[36684]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:50.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.897+0000 7ff130000700 1 -- 172.21.15.28:0/3298727269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff12806ab60 msgr2=0x7ff12806afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:50.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.897+0000 7ff130000700 1 --2- 172.21.15.28:0/3298727269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff12806ab60 0x7ff12806afe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff114009990 tx=0x7ff114009ca0 comp rx=0 tx=0).stop 2024-06-06T08:38:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.897+0000 7ff130000700 1 -- 172.21.15.28:0/3298727269 shutdown_connections 2024-06-06T08:38:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.897+0000 7ff130000700 1 --2- 172.21.15.28:0/3298727269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff12806b520 0x7ff12810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.897+0000 7ff130000700 1 --2- 172.21.15.28:0/3298727269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff128108520 0x7ff128108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.897+0000 7ff130000700 1 --2- 172.21.15.28:0/3298727269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff12806ab60 0x7ff12806afe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.897+0000 7ff130000700 1 -- 172.21.15.28:0/3298727269 >> 172.21.15.28:0/3298727269 conn(0x7ff128078340 msgr2=0x7ff128078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:38:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.897+0000 7ff130000700 1 -- 172.21.15.28:0/3298727269 shutdown_connections 2024-06-06T08:38:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.897+0000 7ff130000700 1 -- 172.21.15.28:0/3298727269 wait complete. 2024-06-06T08:38:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.899+0000 7ff130000700 1 Processor -- start 2024-06-06T08:38:50.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.899+0000 7ff130000700 1 -- start start 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.899+0000 7ff130000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff12806ab60 0x7ff12819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.899+0000 7ff130000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff12806b520 0x7ff12819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.899+0000 7ff130000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff128108520 0x7ff128198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.899+0000 7ff130000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff1281127f0 con 0x7ff12806b520 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.899+0000 7ff130000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff128112670 con 0x7ff128108520 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.899+0000 7ff130000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff128112970 con 0x7ff12806ab60 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.900+0000 7ff12d600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff12806ab60 0x7ff12819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.900+0000 7ff12cc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff12806b520 0x7ff12819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.900+0000 7ff12d600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff12806ab60 0x7ff12819ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:39142/0 (socket says 172.21.15.28:39142) 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.900+0000 7ff12d600700 1 -- 172.21.15.28:0/1618445109 learned_addr learned my addr 172.21.15.28:0/1618445109 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.900+0000 7ff12e000700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff128108520 0x7ff128198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.900+0000 7ff12d600700 1 -- 172.21.15.28:0/1618445109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff128108520 msgr2=0x7ff128198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.900+0000 7ff12d600700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff128108520 0x7ff128198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.900+0000 7ff12d600700 1 -- 172.21.15.28:0/1618445109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff12806b520 msgr2=0x7ff12819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.900+0000 7ff12d600700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff12806b520 0x7ff12819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.900+0000 7ff12d600700 1 -- 172.21.15.28:0/1618445109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1281993f0 con 0x7ff12806ab60 2024-06-06T08:38:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.901+0000 7ff12d600700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff12806ab60 0x7ff12819ea40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00ef10 tx=0x7ff11c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:38:50.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.901+0000 7ff126000700 1 -- 172.21.15.28:0/1618445109 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00c9c0 con 0x7ff12806ab60 2024-06-06T08:38:50.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.901+0000 7ff126000700 1 -- 172.21.15.28:0/1618445109 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff11c019070 con 0x7ff12806ab60 2024-06-06T08:38:50.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.901+0000 7ff126000700 1 -- 172.21.15.28:0/1618445109 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c007e60 con 0x7ff12806ab60 2024-06-06T08:38:50.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.901+0000 7ff130000700 1 -- 172.21.15.28:0/1618445109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff128199680 con 0x7ff12806ab60 2024-06-06T08:38:50.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.901+0000 7ff130000700 1 -- 172.21.15.28:0/1618445109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1281a57f0 con 0x7ff12806ab60 2024-06-06T08:38:50.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.902+0000 7ff130000700 1 -- 172.21.15.28:0/1618445109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12806a410 con 0x7ff12806ab60 2024-06-06T08:38:50.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.904+0000 7ff126000700 1 -- 172.21.15.28:0/1618445109 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff11c012050 con 0x7ff12806ab60 2024-06-06T08:38:50.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.905+0000 7ff126000700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff1100a2ca0 0x7ff1100a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:50.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.906+0000 7ff126000700 1 -- 172.21.15.28:0/1618445109 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff11c0ced70 con 0x7ff12806ab60 2024-06-06T08:38:50.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.906+0000 7ff12cc00700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff1100a2ca0 0x7ff1100a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:50.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.906+0000 7ff12cc00700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff1100a2ca0 0x7ff1100a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff12819a260 tx=0x7ff11400b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:38:50.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:50.908+0000 7ff126000700 1 -- 172.21.15.28:0/1618445109 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff11c010040 con 0x7ff12806ab60 2024-06-06T08:38:51.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.138+0000 7ff130000700 1 -- 172.21.15.28:0/1618445109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff12802dca0 con 0x7ff12806ab60 2024-06-06T08:38:51.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.140+0000 7ff126000700 1 -- 172.21.15.28:0/1618445109 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18324 (secure 0 0 0) 0x7ff11c09c0d0 con 0x7ff12806ab60 2024-06-06T08:38:51.139 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:38:51.140 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":81,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","created":"2024-06-06T08:30:30.991501+0000","modified":"2024-06-06T08:38:46.867437+0000","last_up_change":"2024-06-06T08:38:45.850887+0000","last_in_change":"2024-06-06T08:38:26.532528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T08:34:26.800168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7edaffea-7613-4d20-b9b8-108a17af8f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6803","nonce":2001709636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6805","nonce":2001709636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6809","nonce":2001709636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6807","nonce":2001709636}]},"public_addr":"172.21.15.28:6803/2001709636","cluster_addr":"172.21.15.28:6805/2001709636","heartbeat_back_addr":"172.21.15.28:6809/2001709636","heartbeat_front_addr":"172.21.15.28:6807/2001709636","state":["exists","up"]},{"osd":1,"uuid":"17eb7536-c2a4-4f8b-bec4-b1abb5125836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6801","nonce":593429648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6803","nonce":593429648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6807","nonce":593429648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6805","nonce":593429648}]},"public_addr":"172.21.15.37:6801/593429648","cluster_addr":"172.21.15.37:6803/593429648","heartbeat_back_addr":"172.21.15.37:6807/593429648","heartbeat_front_addr":"172.21.15.37:6805/593429648","state":["exists","up"]},{"osd":2,"uuid":"3ea64fd8-13f4-4d53-933b-07055ec72701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6801","nonce":88678886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6803","nonce":88678886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6807","nonce":88678886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6805","nonce":88678886}]},"public_addr":"172.21.15.59:6801/88678886","cluster_addr":"172.21.15.59:6803/88678886","heartbeat_back_addr":"172.21.15.59:6807/88678886","heartbeat_front_addr":"172.21.15.59:6805/88678886","state":["exists","up"]},{"osd":3,"uuid":"8be9cdb5-12a9-438e-b8cd-ce65988b0ac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6811","nonce":484290430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6813","nonce":484290430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6817","nonce":484290430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6815","nonce":484290430}]},"public_addr":"172.21.15.28:6811/484290430","cluster_addr":"172.21.15.28:6813/484290430","heartbeat_back_addr":"172.21.15.28:6817/484290430","heartbeat_front_addr":"172.21.15.28:6815/484290430","state":["exists","up"]},{"osd":4,"uuid":"ddea397d-d7b1-46f3-9a13-dd318cade055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6809","nonce":3596500266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6811","nonce":3596500266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6815","nonce":3596500266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6813","nonce":3596500266}]},"public_addr":"172.21.15.37:6809/3596500266","cluster_addr":"172.21.15.37:6811/3596500266","heartbeat_back_addr":"172.21.15.37:6815/3596500266","heartbeat_front_addr":"172.21.15.37:6813/3596500266","state":["exists","up"]},{"osd":5,"uuid":"ee19857b-b047-4d15-8b17-257b6e4966a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6809","nonce":3037648282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6811","nonce":3037648282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6815","nonce":3037648282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6813","nonce":3037648282}]},"public_addr":"172.21.15.59:6809/3037648282","cluster_addr":"172.21.15.59:6811/3037648282","heartbeat_back_addr":"172.21.15.59:6815/3037648282","heartbeat_front_addr":"172.21.15.59:6813/3037648282","state":["exists","up"]},{"osd":6,"uuid":"1d57d0ba-8e37-4ac2-87e8-40b20b24fc53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6819","nonce":3794924886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6821","nonce":3794924886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6825","nonce":3794924886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6823","nonce":3794924886}]},"public_addr":"172.21.15.28:6819/3794924886","cluster_addr":"172.21.15.28:6821/3794924886","heartbeat_back_addr":"172.21.15.28:6825/3794924886","heartbeat_front_addr":"172.21.15.28:6823/3794924886","state":["exists","up"]},{"osd":7,"uuid":"43f3c2c8-752d-4a70-99dd-2c14aeefa137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6817","nonce":724042860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6819","nonce":724042860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6823","nonce":724042860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6821","nonce":724042860}]},"public_addr":"172.21.15.37:6817/724042860","cluster_addr":"172.21.15.37:6819/724042860","heartbeat_back_addr":"172.21.15.37:6823/724042860","heartbeat_front_addr":"172.21.15.37:6821/724042860","state":["exists","up"]},{"osd":8,"uuid":"3ffc07d7-ca79-419d-88a4-2b53d07ffae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6817","nonce":1240363223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6819","nonce":1240363223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6823","nonce":1240363223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6821","nonce":1240363223}]},"public_addr":"172.21.15.59:6817/1240363223","cluster_addr":"172.21.15.59:6819/1240363223","heartbeat_back_addr":"172.21.15.59:6823/1240363223","heartbeat_front_addr":"172.21.15.59:6821/1240363223","state":["exists","up"]},{"osd":9,"uuid":"4e014fc7-1ca3-4d6c-acdd-95ca59541310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6827","nonce":2555848355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6829","nonce":2555848355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6833","nonce":2555848355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6831","nonce":2555848355}]},"public_addr":"172.21.15.28:6827/2555848355","cluster_addr":"172.21.15.28:6829/2555848355","heartbeat_back_addr":"172.21.15.28:6833/2555848355","heartbeat_front_addr":"172.21.15.28:6831/2555848355","state":["exists","up"]},{"osd":10,"uuid":"fc418661-5e89-4241-b14b-241a2be432f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6825","nonce":176857372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6827","nonce":176857372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6831","nonce":176857372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6829","nonce":176857372}]},"public_addr":"172.21.15.37:6825/176857372","cluster_addr":"172.21.15.37:6827/176857372","heartbeat_back_addr":"172.21.15.37:6831/176857372","heartbeat_front_addr":"172.21.15.37:6829/176857372","state":["exists","up"]},{"osd":11,"uuid":"e54d81ee-1461-4229-a1c0-c6e750dd66ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6825","nonce":2675673798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6827","nonce":2675673798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6831","nonce":2675673798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6829","nonce":2675673798}]},"public_addr":"172.21.15.59:6825/2675673798","cluster_addr":"172.21.15.59:6827/2675673798","heartbeat_back_addr":"172.21.15.59:6831/2675673798","heartbeat_front_addr":"172.21.15.59:6829/2675673798","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:33.904270+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:58.988528+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:22.997033+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:57.171455+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:23.594371+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:48.928423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:22.957203+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:50.599655+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:16.166981+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:50.755673+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:18.677280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:44.432598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/4230567915":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/2860387445":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/886961600":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/3217551014":"2024-06-07T08:31:40.064884+0000","172.21.15.28:0/1629731223":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/219831273":"2024-06-07T08:31:04.770627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T08:38:51.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 -- 172.21.15.28:0/1618445109 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff1100a2ca0 msgr2=0x7ff1100a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:51.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff1100a2ca0 0x7ff1100a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff12819a260 tx=0x7ff11400b280 comp rx=0 tx=0).stop 2024-06-06T08:38:51.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 -- 172.21.15.28:0/1618445109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff12806ab60 msgr2=0x7ff12819ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:51.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff12806ab60 0x7ff12819ea40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00ef10 tx=0x7ff11c00c3a0 comp rx=0 tx=0).stop 2024-06-06T08:38:51.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 -- 172.21.15.28:0/1618445109 shutdown_connections 2024-06-06T08:38:51.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff1100a2ca0 0x7ff1100a5160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:51.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff128108520 0x7ff128198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:51.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff12806ab60 0x7ff12819ea40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:51.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 --2- 172.21.15.28:0/1618445109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff12806b520 0x7ff12819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:51.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 -- 172.21.15.28:0/1618445109 >> 172.21.15.28:0/1618445109 conn(0x7ff128078340 msgr2=0x7ff128100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:38:51.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 -- 172.21.15.28:0/1618445109 shutdown_connections 2024-06-06T08:38:51.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:51.143+0000 7ff130000700 1 -- 172.21.15.28:0/1618445109 wait complete. 2024-06-06T08:38:51.886 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-06T08:34:26.800168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-06T08:38:51.887 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-06-06T08:38:52.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:51 smithi028 ceph-mon[31564]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:52.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:51 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1618445109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:38:52.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:51 smithi037 ceph-mon[36609]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:52.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:51 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1618445109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:38:52.347 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:38:52.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:51 smithi059 ceph-mon[36684]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:52.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:51 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1618445109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:38:54.152 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:53 smithi059 ceph-mon[36684]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:54.186 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:53 smithi028 ceph-mon[31564]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:54.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:53 smithi037 ceph-mon[36609]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.520+0000 7fcda7200700 1 -- 172.21.15.28:0/102633616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda81076f0 msgr2=0x7fcda810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.520+0000 7fcda7200700 1 --2- 172.21.15.28:0/102633616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda81076f0 0x7fcda810f2c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcda000b0d0 tx=0x7fcda000b3e0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.520+0000 7fcda7200700 1 -- 172.21.15.28:0/102633616 shutdown_connections 2024-06-06T08:38:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.521+0000 7fcda7200700 1 --2- 172.21.15.28:0/102633616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda81076f0 0x7fcda810f2c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.521+0000 7fcda7200700 1 --2- 172.21.15.28:0/102633616 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcda8102610 0x7fcda81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.521+0000 7fcda7200700 1 --2- 172.21.15.28:0/102633616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcda8102fc0 0x7fcda8107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.521+0000 7fcda7200700 1 -- 172.21.15.28:0/102633616 >> 172.21.15.28:0/102633616 conn(0x7fcda80fdea0 msgr2=0x7fcda81002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:38:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.521+0000 7fcda7200700 1 -- 172.21.15.28:0/102633616 shutdown_connections 2024-06-06T08:38:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.521+0000 7fcda7200700 1 -- 172.21.15.28:0/102633616 wait complete. 2024-06-06T08:38:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.522+0000 7fcda7200700 1 Processor -- start 2024-06-06T08:38:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.522+0000 7fcda7200700 1 -- start start 2024-06-06T08:38:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.523+0000 7fcda7200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda8102610 0x7fcda81a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.523+0000 7fcda7200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcda8102fc0 0x7fcda81a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:54.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.523+0000 7fcda7200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcda81076f0 0x7fcda819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:54.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.523+0000 7fcda7200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcda81126e0 con 0x7fcda81076f0 2024-06-06T08:38:54.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.523+0000 7fcda7200700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcda8112560 con 0x7fcda8102fc0 2024-06-06T08:38:54.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.523+0000 7fcda7200700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcda8112860 con 0x7fcda8102610 2024-06-06T08:38:54.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.523+0000 7fcda5e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda8102610 0x7fcda81a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:54.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.523+0000 7fcda5e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda8102610 0x7fcda81a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:39162/0 (socket says 172.21.15.28:39162) 2024-06-06T08:38:54.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.523+0000 7fcda5e00700 1 -- 172.21.15.28:0/1567912173 learned_addr learned my addr 172.21.15.28:0/1567912173 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:38:54.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.523+0000 7fcda6800700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcda81076f0 0x7fcda819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:54.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.524+0000 7fcd9fe00700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcda8102fc0 0x7fcda81a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:54.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.524+0000 7fcda5e00700 1 -- 172.21.15.28:0/1567912173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcda8102fc0 msgr2=0x7fcda81a0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:54.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.524+0000 7fcda5e00700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcda8102fc0 0x7fcda81a0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.524+0000 7fcda5e00700 1 -- 172.21.15.28:0/1567912173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcda81076f0 msgr2=0x7fcda819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:54.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.524+0000 7fcda5e00700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcda81076f0 0x7fcda819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.524+0000 7fcda5e00700 1 -- 172.21.15.28:0/1567912173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda819b410 con 0x7fcda8102610 2024-06-06T08:38:54.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.524+0000 7fcda5e00700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda8102610 0x7fcda81a0a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800e9a0 tx=0x7fcd9800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:38:54.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.524+0000 7fcd9ea00700 1 -- 172.21.15.28:0/1567912173 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800ca10 con 0x7fcda8102610 2024-06-06T08:38:54.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.525+0000 7fcd9ea00700 1 -- 172.21.15.28:0/1567912173 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd9800cbb0 con 0x7fcda8102610 2024-06-06T08:38:54.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.525+0000 7fcda7200700 1 -- 172.21.15.28:0/1567912173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda819b700 con 0x7fcda8102610 2024-06-06T08:38:54.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.525+0000 7fcd9ea00700 1 -- 172.21.15.28:0/1567912173 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98018680 con 0x7fcda8102610 2024-06-06T08:38:54.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.525+0000 7fcda7200700 1 -- 172.21.15.28:0/1567912173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda81a79e0 con 0x7fcda8102610 2024-06-06T08:38:54.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.526+0000 7fcda7200700 1 -- 172.21.15.28:0/1567912173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda8103af0 con 0x7fcda8102610 2024-06-06T08:38:54.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.528+0000 7fcd9ea00700 1 -- 172.21.15.28:0/1567912173 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcd98010430 con 0x7fcda8102610 2024-06-06T08:38:54.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.529+0000 7fcd9ea00700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd8c0a2ca0 0x7fcd8c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:54.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.529+0000 7fcd9ea00700 1 -- 172.21.15.28:0/1567912173 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fcd980cedc0 con 0x7fcda8102610 2024-06-06T08:38:54.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.529+0000 7fcd9fe00700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd8c0a2ca0 0x7fcd8c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:54.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.530+0000 7fcd9fe00700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd8c0a2ca0 0x7fcd8c0a5160 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcda819c280 tx=0x7fcd900073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:38:54.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.533+0000 7fcd9ea00700 1 -- 172.21.15.28:0/1567912173 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcd9809c120 con 0x7fcda8102610 2024-06-06T08:38:54.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.763+0000 7fcda7200700 1 -- 172.21.15.28:0/1567912173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcda819bff0 con 0x7fcda8102610 2024-06-06T08:38:54.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.764+0000 7fcd9ea00700 1 -- 172.21.15.28:0/1567912173 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fcd9809ba20 con 0x7fcda8102610 2024-06-06T08:38:54.763 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-06-06T08:38:54.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 -- 172.21.15.28:0/1567912173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd8c0a2ca0 msgr2=0x7fcd8c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:54.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd8c0a2ca0 0x7fcd8c0a5160 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcda819c280 tx=0x7fcd900073d0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 -- 172.21.15.28:0/1567912173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda8102610 msgr2=0x7fcda81a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:54.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda8102610 0x7fcda81a0a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800e9a0 tx=0x7fcd9800ecb0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 -- 172.21.15.28:0/1567912173 shutdown_connections 2024-06-06T08:38:54.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd8c0a2ca0 0x7fcd8c0a5160 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcda81076f0 0x7fcda819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda8102610 0x7fcda81a0a60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 --2- 172.21.15.28:0/1567912173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcda8102fc0 0x7fcda81a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:54.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 -- 172.21.15.28:0/1567912173 >> 172.21.15.28:0/1567912173 conn(0x7fcda80fdea0 msgr2=0x7fcda810d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:38:54.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 -- 172.21.15.28:0/1567912173 shutdown_connections 2024-06-06T08:38:54.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:38:54.767+0000 7fcda7200700 1 -- 172.21.15.28:0/1567912173 wait complete. 2024-06-06T08:38:55.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:54 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1567912173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T08:38:55.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:54 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1567912173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T08:38:55.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:54 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1567912173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T08:38:55.531 INFO:tasks.cephadm:Adding mds.a on smithi028 2024-06-06T08:38:55.531 INFO:tasks.cephadm:Adding mds.d on smithi028 2024-06-06T08:38:55.531 INFO:tasks.cephadm:Adding mds.g on smithi028 2024-06-06T08:38:55.531 INFO:tasks.cephadm:Adding mds.j on smithi028 2024-06-06T08:38:55.531 INFO:tasks.cephadm:Adding mds.b on smithi037 2024-06-06T08:38:55.531 INFO:tasks.cephadm:Adding mds.e on smithi037 2024-06-06T08:38:55.531 INFO:tasks.cephadm:Adding mds.h on smithi037 2024-06-06T08:38:55.532 INFO:tasks.cephadm:Adding mds.k on smithi037 2024-06-06T08:38:55.532 INFO:tasks.cephadm:Adding mds.c on smithi059 2024-06-06T08:38:55.532 INFO:tasks.cephadm:Adding mds.f on smithi059 2024-06-06T08:38:55.532 INFO:tasks.cephadm:Adding mds.i on smithi059 2024-06-06T08:38:55.532 INFO:tasks.cephadm:Adding mds.l on smithi059 2024-06-06T08:38:55.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph orch apply mds all '12;smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi037=b;smithi037=e;smithi037=h;smithi037=k;smithi059=c;smithi059=f;smithi059=i;smithi059=l' 2024-06-06T08:38:55.777 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:38:56.159 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:55 smithi059 ceph-mon[36684]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:56.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:55 smithi028 ceph-mon[31564]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:56.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:55 smithi037 ceph-mon[36609]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.468+0000 7f9eb2076700 1 -- 172.21.15.59:0/1779872747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac1058b0 msgr2=0x7f9eac107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.468+0000 7f9eb2076700 1 --2- 172.21.15.59:0/1779872747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac1058b0 0x7f9eac107ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009990 tx=0x7f9ea0009ca0 comp rx=0 tx=0).stop 2024-06-06T08:38:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.468+0000 7f9eb2076700 1 -- 172.21.15.59:0/1779872747 shutdown_connections 2024-06-06T08:38:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.468+0000 7f9eb2076700 1 --2- 172.21.15.59:0/1779872747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eac1081e0 0x7f9eac10a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.468+0000 7f9eb2076700 1 --2- 172.21.15.59:0/1779872747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eac102f80 0x7f9eac105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.468+0000 7f9eb2076700 1 --2- 172.21.15.59:0/1779872747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac1058b0 0x7f9eac107ca0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.468+0000 7f9eb2076700 1 -- 172.21.15.59:0/1779872747 >> 172.21.15.59:0/1779872747 conn(0x7f9eac0fc990 msgr2=0x7f9eac0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:38:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.468+0000 7f9eb2076700 1 -- 172.21.15.59:0/1779872747 shutdown_connections 2024-06-06T08:38:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.468+0000 7f9eb2076700 1 -- 172.21.15.59:0/1779872747 wait complete. 2024-06-06T08:38:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eb2076700 1 Processor -- start 2024-06-06T08:38:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eb2076700 1 -- start start 2024-06-06T08:38:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eb2076700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eac102f80 0x7f9eac1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eb2076700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac1058b0 0x7f9eac198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eb2076700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eac1081e0 0x7f9eac19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eb2076700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac10e1c0 con 0x7f9eac102f80 2024-06-06T08:38:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eb2076700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac10e040 con 0x7f9eac1081e0 2024-06-06T08:38:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eb2076700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac10e340 con 0x7f9eac1058b0 2024-06-06T08:38:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eaaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac1058b0 0x7f9eac198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eaaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac1058b0 0x7f9eac198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59008/0 (socket says 172.21.15.59:59008) 2024-06-06T08:38:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eaaffd700 1 -- 172.21.15.59:0/326641536 learned_addr learned my addr 172.21.15.59:0/326641536 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eaaffd700 1 -- 172.21.15.59:0/326641536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eac1081e0 msgr2=0x7f9eac19fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.469+0000 7f9eabfff700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eac1081e0 0x7f9eac19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.470+0000 7f9eaaffd700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eac1081e0 0x7f9eac19fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.470+0000 7f9eaaffd700 1 -- 172.21.15.59:0/326641536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eac102f80 msgr2=0x7f9eac1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.470+0000 7f9eaaffd700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eac102f80 0x7f9eac1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.470+0000 7f9eaaffd700 1 -- 172.21.15.59:0/326641536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac1a0500 con 0x7f9eac1058b0 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.470+0000 7f9eabfff700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eac1081e0 0x7f9eac19fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.470+0000 7f9eaaffd700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac1058b0 0x7f9eac198de0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00098e0 tx=0x7f9ea0004580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.470+0000 7f9ea8ff9700 1 -- 172.21.15.59:0/326641536 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0027070 con 0x7f9eac1058b0 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.470+0000 7f9ea8ff9700 1 -- 172.21.15.59:0/326641536 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ea0004150 con 0x7f9eac1058b0 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.470+0000 7f9eb2076700 1 -- 172.21.15.59:0/326641536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eac1a0790 con 0x7f9eac1058b0 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.470+0000 7f9ea8ff9700 1 -- 172.21.15.59:0/326641536 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000f460 con 0x7f9eac1058b0 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.470+0000 7f9eb2076700 1 -- 172.21.15.59:0/326641536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eac1a0c60 con 0x7f9eac1058b0 2024-06-06T08:38:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.471+0000 7f9eb2076700 1 -- 172.21.15.59:0/326641536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eac069180 con 0x7f9eac1058b0 2024-06-06T08:38:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.472+0000 7f9ea8ff9700 1 -- 172.21.15.59:0/326641536 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9ea002a070 con 0x7f9eac1058b0 2024-06-06T08:38:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.473+0000 7f9ea8ff9700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9e940a2ca0 0x7f9e940a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:38:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.473+0000 7f9ea8ff9700 1 -- 172.21.15.59:0/326641536 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f9ea00cfbe0 con 0x7f9eac1058b0 2024-06-06T08:38:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.473+0000 7f9eab7fe700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9e940a2ca0 0x7f9e940a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:38:57.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.474+0000 7f9eab7fe700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9e940a2ca0 0x7f9e940a5160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0097b0 tx=0x7f9e9c006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:38:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.477+0000 7f9ea8ff9700 1 -- 172.21.15.59:0/326641536 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9ea0013070 con 0x7f9eac1058b0 2024-06-06T08:38:57.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.693+0000 7f9eb2076700 1 -- 172.21.15.59:0/326641536 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi037=b;smithi037=e;smithi037=h;smithi037=k;smithi059=c;smithi059=f;smithi059=i;smithi059=l", "target": ["mon-mgr", ""]}) -- 0x7f9eac062b90 con 0x7f9e940a2ca0 2024-06-06T08:38:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.710+0000 7f9ea8ff9700 1 -- 172.21.15.59:0/326641536 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f9eac062b90 con 0x7f9e940a2ca0 2024-06-06T08:38:57.709 INFO:teuthology.orchestra.run.smithi059.stdout:Scheduled mds.all update... 2024-06-06T08:38:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 -- 172.21.15.59:0/326641536 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9e940a2ca0 msgr2=0x7f9e940a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9e940a2ca0 0x7f9e940a5160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0097b0 tx=0x7f9e9c006d20 comp rx=0 tx=0).stop 2024-06-06T08:38:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 -- 172.21.15.59:0/326641536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac1058b0 msgr2=0x7f9eac198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:38:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac1058b0 0x7f9eac198de0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00098e0 tx=0x7f9ea0004580 comp rx=0 tx=0).stop 2024-06-06T08:38:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 -- 172.21.15.59:0/326641536 shutdown_connections 2024-06-06T08:38:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9e940a2ca0 0x7f9e940a5160 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eac1081e0 0x7f9eac19fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eac102f80 0x7f9eac1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:57.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 --2- 172.21.15.59:0/326641536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eac1058b0 0x7f9eac198de0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:38:57.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 -- 172.21.15.59:0/326641536 >> 172.21.15.59:0/326641536 conn(0x7f9eac0fc990 msgr2=0x7f9eac103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:38:57.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 -- 172.21.15.59:0/326641536 shutdown_connections 2024-06-06T08:38:57.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-06-06T08:38:57.712+0000 7f9eb2076700 1 -- 172.21.15.59:0/326641536 wait complete. 2024-06-06T08:38:58.265 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:57 smithi028 ceph-mon[31564]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:58.265 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:58.265 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:58.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:57 smithi037 ceph-mon[36609]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:58.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:58.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:58.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:57 smithi059 ceph-mon[36684]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:38:58.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:38:58.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:38:58.391 DEBUG:teuthology.orchestra.run.smithi028:mds.a> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.a.service 2024-06-06T08:38:58.399 DEBUG:teuthology.orchestra.run.smithi028:mds.d> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.d.service 2024-06-06T08:38:58.444 DEBUG:teuthology.orchestra.run.smithi028:mds.g> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.g.service 2024-06-06T08:38:58.488 DEBUG:teuthology.orchestra.run.smithi028:mds.j> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.j.service 2024-06-06T08:38:58.533 DEBUG:teuthology.orchestra.run.smithi037:mds.b> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.b.service 2024-06-06T08:38:58.536 DEBUG:teuthology.orchestra.run.smithi037:mds.e> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.e.service 2024-06-06T08:38:58.579 DEBUG:teuthology.orchestra.run.smithi037:mds.h> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.h.service 2024-06-06T08:38:58.621 DEBUG:teuthology.orchestra.run.smithi037:mds.k> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.k.service 2024-06-06T08:38:58.664 DEBUG:teuthology.orchestra.run.smithi059:mds.c> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.c.service 2024-06-06T08:38:58.666 DEBUG:teuthology.orchestra.run.smithi059:mds.f> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.f.service 2024-06-06T08:38:58.709 DEBUG:teuthology.orchestra.run.smithi059:mds.i> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.i.service 2024-06-06T08:38:58.753 DEBUG:teuthology.orchestra.run.smithi059:mds.l> sudo journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.l.service 2024-06-06T08:38:58.795 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-06-06T08:38:58.796 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:38:59.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:58 smithi059 ceph-mon[36684]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi037=b;smithi037=e;smithi037=h;smithi037=k;smithi059=c;smithi059=f;smithi059=i;smithi059=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:38:59.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:58 smithi059 ceph-mon[36684]: Saving service mds.all spec with placement smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi037=b;smithi037=e;smithi037=h;smithi037=k;smithi059=c;smithi059=f;smithi059=i;smithi059=l;count:12 2024-06-06T08:38:59.253 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:38:59.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:58 smithi028 ceph-mon[31564]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi037=b;smithi037=e;smithi037=h;smithi037=k;smithi059=c;smithi059=f;smithi059=i;smithi059=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:38:59.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:58 smithi028 ceph-mon[31564]: Saving service mds.all spec with placement smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi037=b;smithi037=e;smithi037=h;smithi037=k;smithi059=c;smithi059=f;smithi059=i;smithi059=l;count:12 2024-06-06T08:38:59.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:58 smithi037 ceph-mon[36609]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi037=b;smithi037=e;smithi037=h;smithi037=k;smithi059=c;smithi059=f;smithi059=i;smithi059=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:38:59.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:58 smithi037 ceph-mon[36609]: Saving service mds.all spec with placement smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi037=b;smithi037=e;smithi037=h;smithi037=k;smithi059=c;smithi059=f;smithi059=i;smithi059=l;count:12 2024-06-06T08:39:00.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:59 smithi028 ceph-mon[31564]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:00.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:00.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:39:00.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:00.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:00.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:00.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:38:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:00.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:59 smithi037 ceph-mon[36609]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:00.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:00.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:39:00.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:00.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:38:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:00.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:59 smithi059 ceph-mon[36684]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:00.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:00.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:39:00.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:00.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:00.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:00.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:38:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:01.186 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:00 smithi059 ceph-mon[36684]: Deploying daemon mds.l on smithi059 2024-06-06T08:39:01.234 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:00 smithi028 ceph-mon[31564]: Deploying daemon mds.l on smithi059 2024-06-06T08:39:01.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:00 smithi037 ceph-mon[36609]: Deploying daemon mds.l on smithi059 2024-06-06T08:39:01.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.408+0000 7fb025a00700 1 -- 172.21.15.28:0/3950951362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020109480 msgr2=0x7fb020115990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:01.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.408+0000 7fb025a00700 1 --2- 172.21.15.28:0/3950951362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020109480 0x7fb020115990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb018009990 tx=0x7fb018009ca0 comp rx=0 tx=0).stop 2024-06-06T08:39:01.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.409+0000 7fb025a00700 1 -- 172.21.15.28:0/3950951362 shutdown_connections 2024-06-06T08:39:01.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.409+0000 7fb025a00700 1 --2- 172.21.15.28:0/3950951362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020109480 0x7fb020115990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:01.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.409+0000 7fb025a00700 1 --2- 172.21.15.28:0/3950951362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb02010eac0 0x7fb02010eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:01.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.409+0000 7fb025a00700 1 --2- 172.21.15.28:0/3950951362 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb020108ac0 0x7fb020108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:01.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.409+0000 7fb025a00700 1 -- 172.21.15.28:0/3950951362 >> 172.21.15.28:0/3950951362 conn(0x7fb020075c60 msgr2=0x7fb020078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:01.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.409+0000 7fb025a00700 1 -- 172.21.15.28:0/3950951362 shutdown_connections 2024-06-06T08:39:01.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.409+0000 7fb025a00700 1 -- 172.21.15.28:0/3950951362 wait complete. 2024-06-06T08:39:01.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.410+0000 7fb025a00700 1 Processor -- start 2024-06-06T08:39:01.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.410+0000 7fb025a00700 1 -- start start 2024-06-06T08:39:01.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.410+0000 7fb025a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020108ac0 0x7fb02019f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.410+0000 7fb025a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb020109480 0x7fb02019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.410+0000 7fb025a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb02010eac0 0x7fb0201a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.410+0000 7fb025a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb020118e00 con 0x7fb020109480 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.410+0000 7fb025a00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb020118c80 con 0x7fb02010eac0 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.410+0000 7fb025a00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb020118f80 con 0x7fb020108ac0 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01ea00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020108ac0 0x7fb02019f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01ea00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020108ac0 0x7fb02019f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:43446/0 (socket says 172.21.15.28:43446) 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01ea00700 1 -- 172.21.15.28:0/3375153028 learned_addr learned my addr 172.21.15.28:0/3375153028 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01e000700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb020109480 0x7fb02019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01f400700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb02010eac0 0x7fb0201a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01ea00700 1 -- 172.21.15.28:0/3375153028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb02010eac0 msgr2=0x7fb0201a3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:01.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01ea00700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb02010eac0 0x7fb0201a3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:01.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01ea00700 1 -- 172.21.15.28:0/3375153028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb020109480 msgr2=0x7fb02019f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:01.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01ea00700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb020109480 0x7fb02019f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:01.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01ea00700 1 -- 172.21.15.28:0/3375153028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0201a41c0 con 0x7fb020108ac0 2024-06-06T08:39:01.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01f400700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb02010eac0 0x7fb0201a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:39:01.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.411+0000 7fb01e000700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb020109480 0x7fb02019f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:39:01.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.412+0000 7fb01ea00700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020108ac0 0x7fb02019f1b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb010007f10 tx=0x7fb01000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:01.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.412+0000 7fb017400700 1 -- 172.21.15.28:0/3375153028 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01000ddd0 con 0x7fb020108ac0 2024-06-06T08:39:01.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.412+0000 7fb017400700 1 -- 172.21.15.28:0/3375153028 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb010004bb0 con 0x7fb020108ac0 2024-06-06T08:39:01.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.412+0000 7fb017400700 1 -- 172.21.15.28:0/3375153028 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0100047b0 con 0x7fb020108ac0 2024-06-06T08:39:01.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.412+0000 7fb025a00700 1 -- 172.21.15.28:0/3375153028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0201a44b0 con 0x7fb020108ac0 2024-06-06T08:39:01.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.412+0000 7fb025a00700 1 -- 172.21.15.28:0/3375153028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0201abd30 con 0x7fb020108ac0 2024-06-06T08:39:01.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.413+0000 7fb025a00700 1 -- 172.21.15.28:0/3375153028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb020069180 con 0x7fb020108ac0 2024-06-06T08:39:01.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.415+0000 7fb017400700 1 -- 172.21.15.28:0/3375153028 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb01001c020 con 0x7fb020108ac0 2024-06-06T08:39:01.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.416+0000 7fb017400700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb0040a2ca0 0x7fb0040a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:01.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.417+0000 7fb017400700 1 -- 172.21.15.28:0/3375153028 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fb0100cea30 con 0x7fb020108ac0 2024-06-06T08:39:01.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.417+0000 7fb01e000700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb0040a2ca0 0x7fb0040a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:01.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.417+0000 7fb01e000700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb0040a2ca0 0x7fb0040a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb02010dfa0 tx=0x7fb00c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:01.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.419+0000 7fb017400700 1 -- 172.21.15.28:0/3375153028 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb010010070 con 0x7fb020108ac0 2024-06-06T08:39:01.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.700+0000 7fb025a00700 1 -- 172.21.15.28:0/3375153028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0201abf60 con 0x7fb020108ac0 2024-06-06T08:39:01.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.700+0000 7fb017400700 1 -- 172.21.15.28:0/3375153028 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7fb01009bd90 con 0x7fb020108ac0 2024-06-06T08:39:01.700 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:39:01.700 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-06T08:39:01.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.704+0000 7fb025a00700 1 -- 172.21.15.28:0/3375153028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb0040a2ca0 msgr2=0x7fb0040a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:01.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.704+0000 7fb025a00700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb0040a2ca0 0x7fb0040a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb02010dfa0 tx=0x7fb00c009260 comp rx=0 tx=0).stop 2024-06-06T08:39:01.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.704+0000 7fb025a00700 1 -- 172.21.15.28:0/3375153028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020108ac0 msgr2=0x7fb02019f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:01.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.704+0000 7fb025a00700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020108ac0 0x7fb02019f1b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb010007f10 tx=0x7fb01000d3b0 comp rx=0 tx=0).stop 2024-06-06T08:39:01.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.704+0000 7fb025a00700 1 -- 172.21.15.28:0/3375153028 shutdown_connections 2024-06-06T08:39:01.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.704+0000 7fb025a00700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb0040a2ca0 0x7fb0040a5160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:01.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.704+0000 7fb025a00700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb02010eac0 0x7fb0201a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:01.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.704+0000 7fb025a00700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020108ac0 0x7fb02019f1b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:01.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.704+0000 7fb025a00700 1 --2- 172.21.15.28:0/3375153028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb020109480 0x7fb02019f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:01.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.704+0000 7fb025a00700 1 -- 172.21.15.28:0/3375153028 >> 172.21.15.28:0/3375153028 conn(0x7fb020075c60 msgr2=0x7fb020076140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:01.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.704+0000 7fb025a00700 1 -- 172.21.15.28:0/3375153028 shutdown_connections 2024-06-06T08:39:01.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:01.705+0000 7fb025a00700 1 -- 172.21.15.28:0/3375153028 wait complete. 2024-06-06T08:39:01.705 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 2 2024-06-06T08:39:01.937 INFO:journalctl@ceph.mds.l.smithi059.stdout:Jun 06 08:39:01 smithi059 systemd[1]: Started Ceph mds.l for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:39:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:01 smithi028 ceph-mon[31564]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:01 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.59:6832/3120575580,v1:172.21.15.59:6833/3120575580] up:boot 2024-06-06T08:39:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:01 smithi028 ceph-mon[31564]: fsmap 1 up:standby 2024-06-06T08:39:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T08:39:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:01 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/3375153028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:02.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:02.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:02.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:02.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:01 smithi037 ceph-mon[36609]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:02.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:01 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.59:6832/3120575580,v1:172.21.15.59:6833/3120575580] up:boot 2024-06-06T08:39:02.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:01 smithi037 ceph-mon[36609]: fsmap 1 up:standby 2024-06-06T08:39:02.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T08:39:02.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:01 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/3375153028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:02.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:02.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:02.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:02.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:02.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:02.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:02.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:01 smithi059 ceph-mon[36684]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:02.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:01 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.59:6832/3120575580,v1:172.21.15.59:6833/3120575580] up:boot 2024-06-06T08:39:02.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:01 smithi059 ceph-mon[36684]: fsmap 1 up:standby 2024-06-06T08:39:02.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T08:39:02.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:01 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/3375153028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:02.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:02.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:02.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:02.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:02.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:02.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:03.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:02 smithi037 ceph-mon[36609]: Deploying daemon mds.k on smithi037 2024-06-06T08:39:03.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:02 smithi037 ceph-mon[36609]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:03.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:02 smithi028 ceph-mon[31564]: Deploying daemon mds.k on smithi037 2024-06-06T08:39:03.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:02 smithi028 ceph-mon[31564]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:03.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:02 smithi059 ceph-mon[36684]: Deploying daemon mds.k on smithi037 2024-06-06T08:39:03.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:02 smithi059 ceph-mon[36684]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:04.266 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:39:04 smithi037 systemd[1]: Starting Ceph mds.k for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:39:04.544 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:39:04.563 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:39:04 smithi037 podman[66308]: 2024-06-06 08:39:04.390168486 +0000 UTC m=+0.018533153 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:39:04.563 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:39:04 smithi037 podman[66308]: 2024-06-06 08:39:04.513456055 +0000 UTC m=+0.141820697 container create 22164ee410a4f81fc8861f6eeb8027d2e74ab5ee3e1c8c64d9f9b6b889ac8470 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T08:39:05.016 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:39:05.063 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:39:04 smithi037 podman[66308]: 2024-06-06 08:39:04.757987763 +0000 UTC m=+0.386352425 container init 22164ee410a4f81fc8861f6eeb8027d2e74ab5ee3e1c8c64d9f9b6b889ac8470 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True) 2024-06-06T08:39:05.064 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:39:04 smithi037 podman[66308]: 2024-06-06 08:39:04.760744545 +0000 UTC m=+0.389109193 container start 22164ee410a4f81fc8861f6eeb8027d2e74ab5ee3e1c8c64d9f9b6b889ac8470 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:39:05.064 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:39:04 smithi037 ceph-mds[66328]: -- 172.21.15.37:0/3136299106 <== mon.2 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c43f3fba40 con 0x55c43f3cf000 2024-06-06T08:39:05.064 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:39:04 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k[66324]: starting mds.k at 2024-06-06T08:39:05.064 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:39:04 smithi037 bash[66308]: 22164ee410a4f81fc8861f6eeb8027d2e74ab5ee3e1c8c64d9f9b6b889ac8470 2024-06-06T08:39:05.064 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:39:04 smithi037 systemd[1]: Started Ceph mds.k for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:39:06.206 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:05 smithi028 ceph-mon[31564]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:06.206 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:06.206 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:06.206 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:06.206 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:06.206 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:06.206 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:06.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:05 smithi028 ceph-mon[31564]: Deploying daemon mds.j on smithi028 2024-06-06T08:39:06.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:05 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.37:6832/1955606328,v1:172.21.15.37:6833/1955606328] up:boot 2024-06-06T08:39:06.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:05 smithi028 ceph-mon[31564]: fsmap 2 up:standby 2024-06-06T08:39:06.207 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:05 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T08:39:06.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:05 smithi037 ceph-mon[36609]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:06.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:06.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:06.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:06.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:06.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:06.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:06.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:05 smithi037 ceph-mon[36609]: Deploying daemon mds.j on smithi028 2024-06-06T08:39:06.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:05 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.37:6832/1955606328,v1:172.21.15.37:6833/1955606328] up:boot 2024-06-06T08:39:06.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:05 smithi037 ceph-mon[36609]: fsmap 2 up:standby 2024-06-06T08:39:06.315 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:05 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T08:39:06.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:05 smithi059 ceph-mon[36684]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:06.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:05 smithi059 ceph-mon[36684]: Deploying daemon mds.j on smithi028 2024-06-06T08:39:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:05 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.37:6832/1955606328,v1:172.21.15.37:6833/1955606328] up:boot 2024-06-06T08:39:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:05 smithi059 ceph-mon[36684]: fsmap 2 up:standby 2024-06-06T08:39:06.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:05 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T08:39:08.154 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:07 smithi028 ceph-mon[31564]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:08.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.192+0000 7f005bc00700 1 -- 172.21.15.28:0/4258371535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00541084e0 msgr2=0x7f00541088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:08.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.192+0000 7f005bc00700 1 --2- 172.21.15.28:0/4258371535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00541084e0 0x7f00541088c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0048009990 tx=0x7f0048009ca0 comp rx=0 tx=0).stop 2024-06-06T08:39:08.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.193+0000 7f005bc00700 1 -- 172.21.15.28:0/4258371535 shutdown_connections 2024-06-06T08:39:08.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.193+0000 7f005bc00700 1 --2- 172.21.15.28:0/4258371535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f005406ab10 0x7f005410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:08.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.193+0000 7f005bc00700 1 --2- 172.21.15.28:0/4258371535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00541084e0 0x7f00541088c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:08.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.193+0000 7f005bc00700 1 --2- 172.21.15.28:0/4258371535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005406a170 0x7f005406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:08.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.193+0000 7f005bc00700 1 -- 172.21.15.28:0/4258371535 >> 172.21.15.28:0/4258371535 conn(0x7f00540782c0 msgr2=0x7f00540786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:08.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.193+0000 7f005bc00700 1 -- 172.21.15.28:0/4258371535 shutdown_connections 2024-06-06T08:39:08.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.193+0000 7f005bc00700 1 -- 172.21.15.28:0/4258371535 wait complete. 2024-06-06T08:39:08.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.194+0000 7f005bc00700 1 Processor -- start 2024-06-06T08:39:08.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.194+0000 7f005bc00700 1 -- start start 2024-06-06T08:39:08.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.195+0000 7f005bc00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005406a170 0x7f005419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:08.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.195+0000 7f005bc00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f005406ab10 0x7f005419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:08.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.195+0000 7f005bc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00541084e0 0x7f0054198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:08.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.195+0000 7f005bc00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0054112770 con 0x7f00541084e0 2024-06-06T08:39:08.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.195+0000 7f005bc00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00541125f0 con 0x7f005406ab10 2024-06-06T08:39:08.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.195+0000 7f005bc00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f00541128f0 con 0x7f005406a170 2024-06-06T08:39:08.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.195+0000 7f0059200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005406a170 0x7f005419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:08.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.195+0000 7f0059c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00541084e0 0x7f0054198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:08.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.195+0000 7f0059200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005406a170 0x7f005419e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:60026/0 (socket says 172.21.15.28:60026) 2024-06-06T08:39:08.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.195+0000 7f0059200700 1 -- 172.21.15.28:0/3141805623 learned_addr learned my addr 172.21.15.28:0/3141805623 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:39:08.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.195+0000 7f0053e00700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f005406ab10 0x7f005419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:08.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.196+0000 7f0059200700 1 -- 172.21.15.28:0/3141805623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f005406ab10 msgr2=0x7f005419ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:08.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.196+0000 7f0059200700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f005406ab10 0x7f005419ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:08.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.196+0000 7f0059200700 1 -- 172.21.15.28:0/3141805623 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00541084e0 msgr2=0x7f0054198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:08.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.196+0000 7f0059200700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00541084e0 0x7f0054198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:08.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.196+0000 7f0059200700 1 -- 172.21.15.28:0/3141805623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0054199210 con 0x7f005406a170 2024-06-06T08:39:08.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.196+0000 7f0059200700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005406a170 0x7f005419e8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f00480092e0 tx=0x7f004800bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:08.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.196+0000 7f0051600700 1 -- 172.21.15.28:0/3141805623 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048027070 con 0x7f005406a170 2024-06-06T08:39:08.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.196+0000 7f005bc00700 1 -- 172.21.15.28:0/3141805623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00541994a0 con 0x7f005406a170 2024-06-06T08:39:08.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.196+0000 7f0051600700 1 -- 172.21.15.28:0/3141805623 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0048003d70 con 0x7f005406a170 2024-06-06T08:39:08.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.196+0000 7f0051600700 1 -- 172.21.15.28:0/3141805623 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048022e60 con 0x7f005406a170 2024-06-06T08:39:08.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.197+0000 7f005bc00700 1 -- 172.21.15.28:0/3141805623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00541a57c0 con 0x7f005406a170 2024-06-06T08:39:08.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.198+0000 7f005bc00700 1 -- 172.21.15.28:0/3141805623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0054069180 con 0x7f005406a170 2024-06-06T08:39:08.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.200+0000 7f0051600700 1 -- 172.21.15.28:0/3141805623 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f004802a070 con 0x7f005406a170 2024-06-06T08:39:08.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.201+0000 7f0051600700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f003c0a2ca0 0x7f003c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:08.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.201+0000 7f0051600700 1 -- 172.21.15.28:0/3141805623 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f00480cf870 con 0x7f005406a170 2024-06-06T08:39:08.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.201+0000 7f0053e00700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f003c0a2ca0 0x7f003c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:08.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.202+0000 7f0053e00700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f003c0a2ca0 0x7f003c0a5160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0054078930 tx=0x7f0040009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:08.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.205+0000 7f0051600700 1 -- 172.21.15.28:0/3141805623 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0048013070 con 0x7f005406a170 2024-06-06T08:39:08.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:07 smithi037 ceph-mon[36609]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:08.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:07 smithi059 ceph-mon[36684]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:08.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.510+0000 7f005bc00700 1 -- 172.21.15.28:0/3141805623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0054199fe0 con 0x7f005406a170 2024-06-06T08:39:08.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.512+0000 7f0051600700 1 -- 172.21.15.28:0/3141805623 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7f004809cc60 con 0x7f005406a170 2024-06-06T08:39:08.510 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:39:08.510 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-06-06T08:39:08.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.515+0000 7f005bc00700 1 -- 172.21.15.28:0/3141805623 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f003c0a2ca0 msgr2=0x7f003c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:08.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.515+0000 7f005bc00700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f003c0a2ca0 0x7f003c0a5160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0054078930 tx=0x7f0040009260 comp rx=0 tx=0).stop 2024-06-06T08:39:08.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.515+0000 7f005bc00700 1 -- 172.21.15.28:0/3141805623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005406a170 msgr2=0x7f005419e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:08.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.515+0000 7f005bc00700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005406a170 0x7f005419e8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f00480092e0 tx=0x7f004800bb20 comp rx=0 tx=0).stop 2024-06-06T08:39:08.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.515+0000 7f005bc00700 1 -- 172.21.15.28:0/3141805623 shutdown_connections 2024-06-06T08:39:08.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.515+0000 7f005bc00700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f003c0a2ca0 0x7f003c0a5160 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:08.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.515+0000 7f005bc00700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00541084e0 0x7f0054198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:08.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.515+0000 7f005bc00700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005406a170 0x7f005419e8f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:08.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.515+0000 7f005bc00700 1 --2- 172.21.15.28:0/3141805623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f005406ab10 0x7f005419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:08.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.515+0000 7f005bc00700 1 -- 172.21.15.28:0/3141805623 >> 172.21.15.28:0/3141805623 conn(0x7f00540782c0 msgr2=0x7f00540ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:08.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.515+0000 7f005bc00700 1 -- 172.21.15.28:0/3141805623 shutdown_connections 2024-06-06T08:39:08.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:08.516+0000 7f005bc00700 1 -- 172.21.15.28:0/3141805623 wait complete. 2024-06-06T08:39:08.515 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 3 2024-06-06T08:39:08.960 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:08 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/3141805623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:09.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:08 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/3141805623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:09.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:08 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/3141805623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:09.714 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:39:09 smithi028 podman[72127]: 2024-06-06 08:39:09.545704631 +0000 UTC m=+0.136340619 container create de48cba5fc90a2032dd4e3b3dabdd087424e590ca1cb90f71058fbaa6a0c28d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-06-06T08:39:10.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:09 smithi028 ceph-mon[31564]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:10.291 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:39:09 smithi028 podman[72127]: 2024-06-06 08:39:09.81684195 +0000 UTC m=+0.407477970 container init de48cba5fc90a2032dd4e3b3dabdd087424e590ca1cb90f71058fbaa6a0c28d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-06T08:39:10.291 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:39:09 smithi028 podman[72127]: 2024-06-06 08:39:09.827756444 +0000 UTC m=+0.418392431 container start de48cba5fc90a2032dd4e3b3dabdd087424e590ca1cb90f71058fbaa6a0c28d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-j, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:39:10.291 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:39:09 smithi028 ceph-mds[72146]: -- 172.21.15.28:0/1228270818 <== mon.1 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5600b10c7a40 con 0x5600b109a800 2024-06-06T08:39:10.291 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:39:09 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-j[72142]: starting mds.j at 2024-06-06T08:39:10.291 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:39:09 smithi028 bash[72127]: de48cba5fc90a2032dd4e3b3dabdd087424e590ca1cb90f71058fbaa6a0c28d3 2024-06-06T08:39:10.291 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:39:09 smithi028 systemd[1]: Started Ceph mds.j for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:39:10.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:09 smithi037 ceph-mon[36609]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:10.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:09 smithi059 ceph-mon[36684]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:11.196 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:10 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.28:6834/906327649,v1:172.21.15.28:6835/906327649] up:boot 2024-06-06T08:39:11.197 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:10 smithi028 ceph-mon[31564]: fsmap 3 up:standby 2024-06-06T08:39:11.197 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-06T08:39:11.197 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:11.197 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:11.197 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:11.197 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:11.197 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:11.197 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:10 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:11.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:10 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.28:6834/906327649,v1:172.21.15.28:6835/906327649] up:boot 2024-06-06T08:39:11.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:10 smithi037 ceph-mon[36609]: fsmap 3 up:standby 2024-06-06T08:39:11.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:10 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-06T08:39:11.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:10 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:11.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:10 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:11.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:10 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:11.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:10 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:11.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:10 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:11.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:10 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:11.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:10 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.28:6834/906327649,v1:172.21.15.28:6835/906327649] up:boot 2024-06-06T08:39:11.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:10 smithi059 ceph-mon[36684]: fsmap 3 up:standby 2024-06-06T08:39:11.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:10 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-06T08:39:11.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:10 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:11.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:10 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:11.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:10 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:11.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:10 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:11.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:10 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:11.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:10 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:11.362 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:39:12.238 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:11 smithi028 ceph-mon[31564]: Deploying daemon mds.d on smithi028 2024-06-06T08:39:12.238 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:11 smithi028 ceph-mon[31564]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:12.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:11 smithi037 ceph-mon[36609]: Deploying daemon mds.d on smithi028 2024-06-06T08:39:12.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:11 smithi037 ceph-mon[36609]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:12.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:11 smithi059 ceph-mon[36684]: Deploying daemon mds.d on smithi028 2024-06-06T08:39:12.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:11 smithi059 ceph-mon[36684]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:12.484 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:39:13.093 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:12 smithi028 ceph-mon[31564]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:13.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:12 smithi037 ceph-mon[36609]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:13.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:12 smithi059 ceph-mon[36684]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:13.395 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:39:13 smithi028 systemd[1]: Starting Ceph mds.d for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:39:13.982 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:39:13 smithi028 podman[72522]: 2024-06-06 08:39:13.859529445 +0000 UTC m=+0.055203207 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:39:13.982 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:39:13 smithi028 podman[72522]: 2024-06-06 08:39:13.982785585 +0000 UTC m=+0.178459358 container create c29d2ec501a35b4f745cbdb8fe474e2c2c820c6f82dc72f46c8729cbd8b4878f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-d, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:39:14.586 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:39:14 smithi028 podman[72522]: 2024-06-06 08:39:14.30397385 +0000 UTC m=+0.499647591 container init c29d2ec501a35b4f745cbdb8fe474e2c2c820c6f82dc72f46c8729cbd8b4878f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-d, RELEASE=squid-3d89acc, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:39:14.586 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:39:14 smithi028 podman[72522]: 2024-06-06 08:39:14.315153629 +0000 UTC m=+0.510827369 container start c29d2ec501a35b4f745cbdb8fe474e2c2c820c6f82dc72f46c8729cbd8b4878f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-d, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-06T08:39:14.586 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:39:14 smithi028 ceph-mds[72561]: -- 172.21.15.28:0/3162422468 <== mon.1 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5569943bfa40 con 0x556994393000 2024-06-06T08:39:14.586 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:39:14 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-d[72556]: starting mds.d at 2024-06-06T08:39:14.586 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:39:14 smithi028 bash[72522]: c29d2ec501a35b4f745cbdb8fe474e2c2c820c6f82dc72f46c8729cbd8b4878f 2024-06-06T08:39:14.586 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:39:14 smithi028 systemd[1]: Started Ceph mds.d for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:39:14.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.875+0000 7fa1db600700 1 -- 172.21.15.28:0/4076568247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d4105060 msgr2=0x7fa1d4111570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:14.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.875+0000 7fa1db600700 1 --2- 172.21.15.28:0/4076568247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d4105060 0x7fa1d4111570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00b0a0 tx=0x7fa1cc00b3b0 comp rx=0 tx=0).stop 2024-06-06T08:39:14.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.875+0000 7fa1db600700 1 -- 172.21.15.28:0/4076568247 shutdown_connections 2024-06-06T08:39:14.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.875+0000 7fa1db600700 1 --2- 172.21.15.28:0/4076568247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d4105060 0x7fa1d4111570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:14.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.875+0000 7fa1db600700 1 --2- 172.21.15.28:0/4076568247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d410a6a0 0x7fa1d410aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:14.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.875+0000 7fa1db600700 1 --2- 172.21.15.28:0/4076568247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1d41046a0 0x7fa1d4104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:14.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.875+0000 7fa1db600700 1 -- 172.21.15.28:0/4076568247 >> 172.21.15.28:0/4076568247 conn(0x7fa1d4100190 msgr2=0x7fa1d41025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:14.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.875+0000 7fa1db600700 1 -- 172.21.15.28:0/4076568247 shutdown_connections 2024-06-06T08:39:14.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.875+0000 7fa1db600700 1 -- 172.21.15.28:0/4076568247 wait complete. 2024-06-06T08:39:14.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.876+0000 7fa1db600700 1 Processor -- start 2024-06-06T08:39:14.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.876+0000 7fa1db600700 1 -- start start 2024-06-06T08:39:14.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.877+0000 7fa1db600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d41046a0 0x7fa1d4111340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.877+0000 7fa1db600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d4105060 0x7fa1d410e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.877+0000 7fa1db600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1d410a6a0 0x7fa1d410e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.877+0000 7fa1db600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4114a30 con 0x7fa1d41046a0 2024-06-06T08:39:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.877+0000 7fa1db600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d41148b0 con 0x7fa1d4105060 2024-06-06T08:39:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.877+0000 7fa1db600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4114bb0 con 0x7fa1d410a6a0 2024-06-06T08:39:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.877+0000 7fa1d3e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d4105060 0x7fa1d410e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.877+0000 7fa1d3e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d4105060 0x7fa1d410e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:39810/0 (socket says 172.21.15.28:39810) 2024-06-06T08:39:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.877+0000 7fa1d3e00700 1 -- 172.21.15.28:0/2436931597 learned_addr learned my addr 172.21.15.28:0/2436931597 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:39:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.877+0000 7fa1d8c00700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d41046a0 0x7fa1d4111340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.877+0000 7fa1d9600700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1d410a6a0 0x7fa1d410e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.878+0000 7fa1d3e00700 1 -- 172.21.15.28:0/2436931597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1d410a6a0 msgr2=0x7fa1d410e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.878+0000 7fa1d3e00700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1d410a6a0 0x7fa1d410e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.878+0000 7fa1d3e00700 1 -- 172.21.15.28:0/2436931597 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d41046a0 msgr2=0x7fa1d4111340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.878+0000 7fa1d3e00700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d41046a0 0x7fa1d4111340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.878+0000 7fa1d3e00700 1 -- 172.21.15.28:0/2436931597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d410f1e0 con 0x7fa1d4105060 2024-06-06T08:39:14.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.878+0000 7fa1d9600700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1d410a6a0 0x7fa1d410e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:39:14.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.878+0000 7fa1d3e00700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d4105060 0x7fa1d410e3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000eb30 tx=0x7fa1c000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:14.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.878+0000 7fa1d1600700 1 -- 172.21.15.28:0/2436931597 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c000cbd0 con 0x7fa1d4105060 2024-06-06T08:39:14.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.878+0000 7fa1d1600700 1 -- 172.21.15.28:0/2436931597 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1c0004500 con 0x7fa1d4105060 2024-06-06T08:39:14.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.878+0000 7fa1d1600700 1 -- 172.21.15.28:0/2436931597 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0010430 con 0x7fa1d4105060 2024-06-06T08:39:14.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.878+0000 7fa1db600700 1 -- 172.21.15.28:0/2436931597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d41ab7f0 con 0x7fa1d4105060 2024-06-06T08:39:14.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.879+0000 7fa1db600700 1 -- 172.21.15.28:0/2436931597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d41abcb0 con 0x7fa1d4105060 2024-06-06T08:39:14.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.880+0000 7fa1db600700 1 -- 172.21.15.28:0/2436931597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d4105de0 con 0x7fa1d4105060 2024-06-06T08:39:14.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.882+0000 7fa1d1600700 1 -- 172.21.15.28:0/2436931597 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa1c0003f00 con 0x7fa1d4105060 2024-06-06T08:39:14.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.883+0000 7fa1d1600700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa1bc0a2ca0 0x7fa1bc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:14.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.883+0000 7fa1d1600700 1 -- 172.21.15.28:0/2436931597 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa1c00cef70 con 0x7fa1d4105060 2024-06-06T08:39:14.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.883+0000 7fa1d8c00700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa1bc0a2ca0 0x7fa1bc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:14.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.884+0000 7fa1d8c00700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa1bc0a2ca0 0x7fa1bc0a5160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009be0 tx=0x7fa1c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:14.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:14.887+0000 7fa1d1600700 1 -- 172.21.15.28:0/2436931597 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa1c009c2d0 con 0x7fa1d4105060 2024-06-06T08:39:15.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.171+0000 7fa1db600700 1 -- 172.21.15.28:0/2436931597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1d41abfd0 con 0x7fa1d4105060 2024-06-06T08:39:15.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.172+0000 7fa1d1600700 1 -- 172.21.15.28:0/2436931597 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3040 (secure 0 0 0) 0x7fa1c009bbd0 con 0x7fa1d4105060 2024-06-06T08:39:15.171 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:39:15.171 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-06-06T08:39:15.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 -- 172.21.15.28:0/2436931597 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa1bc0a2ca0 msgr2=0x7fa1bc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:15.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa1bc0a2ca0 0x7fa1bc0a5160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009be0 tx=0x7fa1c8009260 comp rx=0 tx=0).stop 2024-06-06T08:39:15.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 -- 172.21.15.28:0/2436931597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d4105060 msgr2=0x7fa1d410e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:15.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d4105060 0x7fa1d410e3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000eb30 tx=0x7fa1c000ee40 comp rx=0 tx=0).stop 2024-06-06T08:39:15.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 -- 172.21.15.28:0/2436931597 shutdown_connections 2024-06-06T08:39:15.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa1bc0a2ca0 0x7fa1bc0a5160 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:15.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1d410a6a0 0x7fa1d410e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:15.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1d41046a0 0x7fa1d4111340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:15.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 --2- 172.21.15.28:0/2436931597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d4105060 0x7fa1d410e3f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:15.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 -- 172.21.15.28:0/2436931597 >> 172.21.15.28:0/2436931597 conn(0x7fa1d4100190 msgr2=0x7fa1d4100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:15.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 -- 172.21.15.28:0/2436931597 shutdown_connections 2024-06-06T08:39:15.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:15.175+0000 7fa1db600700 1 -- 172.21.15.28:0/2436931597 wait complete. 2024-06-06T08:39:15.175 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 4 2024-06-06T08:39:15.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:15.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:15.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:15.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:15.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:15.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:15.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:15.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: Deploying daemon mds.e on smithi037 2024-06-06T08:39:15.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2436931597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:15.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.28:6836/165707269,v1:172.21.15.28:6837/165707269] up:boot 2024-06-06T08:39:15.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: fsmap 4 up:standby 2024-06-06T08:39:15.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:15 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-06T08:39:15.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:15.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:15.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:15.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:15.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:15.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:15.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:15.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: Deploying daemon mds.e on smithi037 2024-06-06T08:39:15.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2436931597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:15.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.28:6836/165707269,v1:172.21.15.28:6837/165707269] up:boot 2024-06-06T08:39:15.815 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: fsmap 4 up:standby 2024-06-06T08:39:15.815 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:15 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-06T08:39:15.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:15.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:15.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:15.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:15.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:15.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:15.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:15.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: Deploying daemon mds.e on smithi037 2024-06-06T08:39:15.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2436931597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:15.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.28:6836/165707269,v1:172.21.15.28:6837/165707269] up:boot 2024-06-06T08:39:15.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: fsmap 4 up:standby 2024-06-06T08:39:15.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:15 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-06T08:39:17.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:17 smithi037 ceph-mon[36609]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:17.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:17 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:17.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:17 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:17.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:17 smithi028 ceph-mon[31564]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:17.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:17 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:17.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:17 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:17.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:17 smithi059 ceph-mon[36684]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:17.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:17 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:17.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:17 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:18.026 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:39:18.520 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:39:18.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:18 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:18.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:18 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:18.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:18 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:18.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:18 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] up:boot 2024-06-06T08:39:18.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:18 smithi028 ceph-mon[31564]: fsmap 5 up:standby 2024-06-06T08:39:18.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:18 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T08:39:18.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:18 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:18.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:18 smithi028 ceph-mon[31564]: Deploying daemon mds.f on smithi059 2024-06-06T08:39:18.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:18 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:18.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:18 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:18.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:18 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:18.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:18 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] up:boot 2024-06-06T08:39:18.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:18 smithi037 ceph-mon[36609]: fsmap 5 up:standby 2024-06-06T08:39:18.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:18 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T08:39:18.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:18 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:18.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:18 smithi037 ceph-mon[36609]: Deploying daemon mds.f on smithi059 2024-06-06T08:39:18.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:18 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:18.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:18 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:18.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:18 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:18.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:18 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] up:boot 2024-06-06T08:39:18.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:18 smithi059 ceph-mon[36684]: fsmap 5 up:standby 2024-06-06T08:39:18.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:18 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T08:39:18.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:18 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:18.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:18 smithi059 ceph-mon[36684]: Deploying daemon mds.f on smithi059 2024-06-06T08:39:19.781 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:19 smithi059 ceph-mon[36684]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:19.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:19 smithi028 ceph-mon[31564]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:19.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:19 smithi037 ceph-mon[36609]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:20.100 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:39:20 smithi059 podman[66796]: 2024-06-06 08:39:20.0280185 +0000 UTC m=+0.142078762 container create 2a4b5056d1830f510971b207a84e8f4a475f8d3f6e2af74f555689e10a451051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T08:39:20.599 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:39:20 smithi059 podman[66796]: 2024-06-06 08:39:20.264189642 +0000 UTC m=+0.378249912 container init 2a4b5056d1830f510971b207a84e8f4a475f8d3f6e2af74f555689e10a451051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-06-06T08:39:20.600 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:39:20 smithi059 podman[66796]: 2024-06-06 08:39:20.26701958 +0000 UTC m=+0.381079836 container start 2a4b5056d1830f510971b207a84e8f4a475f8d3f6e2af74f555689e10a451051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-06-06T08:39:20.600 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:39:20 smithi059 ceph-mds[66814]: -- 172.21.15.59:0/2257040546 <== mon.1 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d023e03a40 con 0x55d023dd6800 2024-06-06T08:39:20.600 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:39:20 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f[66810]: starting mds.f at 2024-06-06T08:39:20.600 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:39:20 smithi059 bash[66796]: 2a4b5056d1830f510971b207a84e8f4a475f8d3f6e2af74f555689e10a451051 2024-06-06T08:39:20.600 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:39:20 smithi059 systemd[1]: Started Ceph mds.f for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:39:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.842+0000 7fbe8e800700 1 -- 172.21.15.28:0/4126935636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe88108500 msgr2=0x7fbe881088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.842+0000 7fbe8e800700 1 --2- 172.21.15.28:0/4126935636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe88108500 0x7fbe881088e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009990 tx=0x7fbe78009ca0 comp rx=0 tx=0).stop 2024-06-06T08:39:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.842+0000 7fbe8e800700 1 -- 172.21.15.28:0/4126935636 shutdown_connections 2024-06-06T08:39:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.842+0000 7fbe8e800700 1 --2- 172.21.15.28:0/4126935636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe8806ab30 0x7fbe8810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.842+0000 7fbe8e800700 1 --2- 172.21.15.28:0/4126935636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe88108500 0x7fbe881088e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.842+0000 7fbe8e800700 1 --2- 172.21.15.28:0/4126935636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe8806a170 0x7fbe8806a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.842+0000 7fbe8e800700 1 -- 172.21.15.28:0/4126935636 >> 172.21.15.28:0/4126935636 conn(0x7fbe88078340 msgr2=0x7fbe88078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.842+0000 7fbe8e800700 1 -- 172.21.15.28:0/4126935636 shutdown_connections 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.843+0000 7fbe8e800700 1 -- 172.21.15.28:0/4126935636 wait complete. 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.844+0000 7fbe8e800700 1 Processor -- start 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.844+0000 7fbe8e800700 1 -- start start 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.844+0000 7fbe8e800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe8806a170 0x7fbe8819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.844+0000 7fbe8e800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8806ab30 0x7fbe8819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.844+0000 7fbe8e800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe88108500 0x7fbe88198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.844+0000 7fbe8e800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe881127b0 con 0x7fbe88108500 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.844+0000 7fbe8e800700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbe88112630 con 0x7fbe8806a170 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.844+0000 7fbe8e800700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe88112930 con 0x7fbe8806ab30 2024-06-06T08:39:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.844+0000 7fbe7ea00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8806ab30 0x7fbe8819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.845+0000 7fbe7ea00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8806ab30 0x7fbe8819ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:56370/0 (socket says 172.21.15.28:56370) 2024-06-06T08:39:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.845+0000 7fbe7ea00700 1 -- 172.21.15.28:0/4022455478 learned_addr learned my addr 172.21.15.28:0/4022455478 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:39:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.845+0000 7fbe87400700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe8806a170 0x7fbe8819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.845+0000 7fbe87e00700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe88108500 0x7fbe88198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.845+0000 7fbe7ea00700 1 -- 172.21.15.28:0/4022455478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe8806a170 msgr2=0x7fbe8819ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.845+0000 7fbe7ea00700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe8806a170 0x7fbe8819ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.845+0000 7fbe7ea00700 1 -- 172.21.15.28:0/4022455478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe88108500 msgr2=0x7fbe88198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.845+0000 7fbe7ea00700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe88108500 0x7fbe88198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.845+0000 7fbe7ea00700 1 -- 172.21.15.28:0/4022455478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe881993f0 con 0x7fbe8806ab30 2024-06-06T08:39:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.845+0000 7fbe7ea00700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8806ab30 0x7fbe8819ef80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000e9a0 tx=0x7fbe7000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.846+0000 7fbe84c00700 1 -- 172.21.15.28:0/4022455478 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000ca10 con 0x7fbe8806ab30 2024-06-06T08:39:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.846+0000 7fbe84c00700 1 -- 172.21.15.28:0/4022455478 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe7000cbb0 con 0x7fbe8806ab30 2024-06-06T08:39:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.846+0000 7fbe8e800700 1 -- 172.21.15.28:0/4022455478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe881996e0 con 0x7fbe8806ab30 2024-06-06T08:39:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.846+0000 7fbe84c00700 1 -- 172.21.15.28:0/4022455478 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70018680 con 0x7fbe8806ab30 2024-06-06T08:39:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.846+0000 7fbe8e800700 1 -- 172.21.15.28:0/4022455478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe881a59c0 con 0x7fbe8806ab30 2024-06-06T08:39:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.847+0000 7fbe8e800700 1 -- 172.21.15.28:0/4022455478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe8810a9e0 con 0x7fbe8806ab30 2024-06-06T08:39:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.849+0000 7fbe84c00700 1 -- 172.21.15.28:0/4022455478 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbe70010430 con 0x7fbe8806ab30 2024-06-06T08:39:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.850+0000 7fbe84c00700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbe6c0a2ca0 0x7fbe6c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.851+0000 7fbe84c00700 1 -- 172.21.15.28:0/4022455478 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fbe700cf160 con 0x7fbe8806ab30 2024-06-06T08:39:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.851+0000 7fbe87400700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbe6c0a2ca0 0x7fbe6c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.851+0000 7fbe87400700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbe6c0a2ca0 0x7fbe6c0a5160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800b2e0 tx=0x7fbe78005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:20.857+0000 7fbe84c00700 1 -- 172.21.15.28:0/4022455478 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbe7009c4c0 con 0x7fbe8806ab30 2024-06-06T08:39:21.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.136+0000 7fbe8e800700 1 -- 172.21.15.28:0/4022455478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe88199fd0 con 0x7fbe8806ab30 2024-06-06T08:39:21.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.137+0000 7fbe84c00700 1 -- 172.21.15.28:0/4022455478 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5512 (secure 0 0 0) 0x7fbe7009bdc0 con 0x7fbe8806ab30 2024-06-06T08:39:21.137 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:39:21.137 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-06-06T08:39:21.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.140+0000 7fbe8e800700 1 -- 172.21.15.28:0/4022455478 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbe6c0a2ca0 msgr2=0x7fbe6c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:21.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.140+0000 7fbe8e800700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbe6c0a2ca0 0x7fbe6c0a5160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800b2e0 tx=0x7fbe78005fd0 comp rx=0 tx=0).stop 2024-06-06T08:39:21.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.140+0000 7fbe8e800700 1 -- 172.21.15.28:0/4022455478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8806ab30 msgr2=0x7fbe8819ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:21.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.140+0000 7fbe8e800700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8806ab30 0x7fbe8819ef80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000e9a0 tx=0x7fbe7000ecb0 comp rx=0 tx=0).stop 2024-06-06T08:39:21.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.140+0000 7fbe8e800700 1 -- 172.21.15.28:0/4022455478 shutdown_connections 2024-06-06T08:39:21.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.140+0000 7fbe8e800700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbe6c0a2ca0 0x7fbe6c0a5160 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:21.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.140+0000 7fbe8e800700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbe88108500 0x7fbe88198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:21.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.141+0000 7fbe8e800700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe8806a170 0x7fbe8819ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:21.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.141+0000 7fbe8e800700 1 --2- 172.21.15.28:0/4022455478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8806ab30 0x7fbe8819ef80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:21.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.141+0000 7fbe8e800700 1 -- 172.21.15.28:0/4022455478 >> 172.21.15.28:0/4022455478 conn(0x7fbe88078340 msgr2=0x7fbe88100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:21.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.141+0000 7fbe8e800700 1 -- 172.21.15.28:0/4022455478 shutdown_connections 2024-06-06T08:39:21.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:21.141+0000 7fbe8e800700 1 -- 172.21.15.28:0/4022455478 wait complete. 2024-06-06T08:39:21.142 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2024-06-06T08:39:21.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:21.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:21.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:21.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:21.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:21.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:21.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:21.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: Deploying daemon mds.c on smithi059 2024-06-06T08:39:21.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.59:6834/2983089313,v1:172.21.15.59:6835/2983089313] up:boot 2024-06-06T08:39:21.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: fsmap 6 up:standby 2024-06-06T08:39:21.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T08:39:21.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:21 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/4022455478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:21.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:21.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:21.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:21.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:21.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:21.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:21.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:21.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: Deploying daemon mds.c on smithi059 2024-06-06T08:39:21.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.59:6834/2983089313,v1:172.21.15.59:6835/2983089313] up:boot 2024-06-06T08:39:21.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: fsmap 6 up:standby 2024-06-06T08:39:21.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T08:39:21.815 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:21 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/4022455478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:21.846 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:21.846 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:21.846 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:21.846 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:21.846 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:21.846 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:21.846 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:21.846 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: Deploying daemon mds.c on smithi059 2024-06-06T08:39:21.846 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.59:6834/2983089313,v1:172.21.15.59:6835/2983089313] up:boot 2024-06-06T08:39:21.847 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: fsmap 6 up:standby 2024-06-06T08:39:21.847 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T08:39:21.847 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:21 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/4022455478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:22.849 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:39:22 smithi059 systemd[1]: Starting Ceph mds.c for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:39:23.212 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:39:22 smithi059 podman[67099]: 2024-06-06 08:39:22.860711144 +0000 UTC m=+0.017893848 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:39:23.213 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:39:22 smithi059 podman[67099]: 2024-06-06 08:39:22.968148442 +0000 UTC m=+0.125331176 container create e6f5b1445916e349bd83348f9d5f270bf33ca612603eb6efae07156fedac772f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0) 2024-06-06T08:39:23.213 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:39:23 smithi059 podman[67099]: 2024-06-06 08:39:23.187817285 +0000 UTC m=+0.344999974 container init e6f5b1445916e349bd83348f9d5f270bf33ca612603eb6efae07156fedac772f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-06-06T08:39:23.213 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:39:23 smithi059 podman[67099]: 2024-06-06 08:39:23.19037456 +0000 UTC m=+0.347557256 container start e6f5b1445916e349bd83348f9d5f270bf33ca612603eb6efae07156fedac772f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c, ceph=True, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-06-06T08:39:23.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:23 smithi059 ceph-mon[36684]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:23.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:23.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:23.600 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:39:23 smithi059 ceph-mds[67118]: -- 172.21.15.59:0/1379358389 <== mon.1 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bfd75e1a40 con 0x55bfd75b4800 2024-06-06T08:39:23.600 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:39:23 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c[67114]: starting mds.c at 2024-06-06T08:39:23.600 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:39:23 smithi059 bash[67099]: e6f5b1445916e349bd83348f9d5f270bf33ca612603eb6efae07156fedac772f 2024-06-06T08:39:23.600 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:39:23 smithi059 systemd[1]: Started Ceph mds.c for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:39:23.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:23 smithi028 ceph-mon[31564]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:23.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:23.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:23.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:23 smithi037 ceph-mon[36609]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:23.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:23.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:23.978 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:39:24.458 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:39:24.777 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:24.777 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:24.778 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:24.778 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:24 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] up:boot 2024-06-06T08:39:24.778 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:24 smithi028 ceph-mon[31564]: fsmap 7 up:standby 2024-06-06T08:39:24.778 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T08:39:24.778 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:24.778 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:24 smithi028 ceph-mon[31564]: Deploying daemon mds.h on smithi037 2024-06-06T08:39:24.782 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:24.782 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:24.782 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:24.782 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:24 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] up:boot 2024-06-06T08:39:24.782 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:24 smithi059 ceph-mon[36684]: fsmap 7 up:standby 2024-06-06T08:39:24.782 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T08:39:24.783 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:24.783 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:24 smithi059 ceph-mon[36684]: Deploying daemon mds.h on smithi037 2024-06-06T08:39:24.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:24.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:24.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:24.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:24 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] up:boot 2024-06-06T08:39:24.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:24 smithi037 ceph-mon[36609]: fsmap 7 up:standby 2024-06-06T08:39:24.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T08:39:24.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:24.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:24 smithi037 ceph-mon[36609]: Deploying daemon mds.h on smithi037 2024-06-06T08:39:25.753 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:25 smithi059 ceph-mon[36684]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:25.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:25 smithi028 ceph-mon[31564]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:25.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:25 smithi037 ceph-mon[36609]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:25.814 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:39:25 smithi037 systemd[1]: Starting Ceph mds.h for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:39:26.142 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:39:25 smithi037 podman[66934]: 2024-06-06 08:39:25.752556007 +0000 UTC m=+0.017803704 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:39:26.142 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:39:25 smithi037 podman[66934]: 2024-06-06 08:39:25.874437074 +0000 UTC m=+0.139684751 container create bfa090feaa21e54dde2f74e69e97031bfaf354ba94cb81e41af50c8cf4da22cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-06-06T08:39:26.142 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:39:26 smithi037 podman[66934]: 2024-06-06 08:39:26.144017014 +0000 UTC m=+0.409264698 container init bfa090feaa21e54dde2f74e69e97031bfaf354ba94cb81e41af50c8cf4da22cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-06-06T08:39:26.563 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:39:26 smithi037 podman[66934]: 2024-06-06 08:39:26.147031281 +0000 UTC m=+0.412278973 container start bfa090feaa21e54dde2f74e69e97031bfaf354ba94cb81e41af50c8cf4da22cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:39:26.564 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:39:26 smithi037 ceph-mds[66953]: -- 172.21.15.37:0/1603288788 <== mon.2 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf4ed4da40 con 0x55bf4ed20c00 2024-06-06T08:39:26.564 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:39:26 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h[66949]: starting mds.h at 2024-06-06T08:39:26.564 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:39:26 smithi037 bash[66934]: bfa090feaa21e54dde2f74e69e97031bfaf354ba94cb81e41af50c8cf4da22cd 2024-06-06T08:39:26.564 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:39:26 smithi037 systemd[1]: Started Ceph mds.h for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:39:26.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.797+0000 7f11c9000700 1 -- 172.21.15.28:0/3523272923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c410a650 msgr2=0x7f11c410aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:26.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.797+0000 7f11c9000700 1 --2- 172.21.15.28:0/3523272923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c410a650 0x7f11c410aa30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009990 tx=0x7f11b4009ca0 comp rx=0 tx=0).stop 2024-06-06T08:39:26.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.798+0000 7f11c9000700 1 -- 172.21.15.28:0/3523272923 shutdown_connections 2024-06-06T08:39:26.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.798+0000 7f11c9000700 1 --2- 172.21.15.28:0/3523272923 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11c4104f80 0x7f11c4111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:26.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.798+0000 7f11c9000700 1 --2- 172.21.15.28:0/3523272923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c410a650 0x7f11c410aa30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:26.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.798+0000 7f11c9000700 1 --2- 172.21.15.28:0/3523272923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c41045c0 0x7f11c4104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:26.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.798+0000 7f11c9000700 1 -- 172.21.15.28:0/3523272923 >> 172.21.15.28:0/3523272923 conn(0x7f11c41000b0 msgr2=0x7f11c41024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:26.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.798+0000 7f11c9000700 1 -- 172.21.15.28:0/3523272923 shutdown_connections 2024-06-06T08:39:26.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.798+0000 7f11c9000700 1 -- 172.21.15.28:0/3523272923 wait complete. 2024-06-06T08:39:26.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.799+0000 7f11c9000700 1 Processor -- start 2024-06-06T08:39:26.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.799+0000 7f11c9000700 1 -- start start 2024-06-06T08:39:26.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.799+0000 7f11c9000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11c41045c0 0x7f11c419ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:26.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.799+0000 7f11c9000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c4104f80 0x7f11c419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:26.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.799+0000 7f11c9000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c410a650 0x7f11c419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:26.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.799+0000 7f11c9000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11c4114940 con 0x7f11c41045c0 2024-06-06T08:39:26.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.799+0000 7f11c9000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f11c41147c0 con 0x7f11c4104f80 2024-06-06T08:39:26.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.799+0000 7f11c9000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f11c4114ac0 con 0x7f11c410a650 2024-06-06T08:39:26.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.800+0000 7f11c3e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c410a650 0x7f11c419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:26.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.800+0000 7f11c2a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c4104f80 0x7f11c419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:26.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.800+0000 7f11c3400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11c41045c0 0x7f11c419ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:26.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.800+0000 7f11c3e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c410a650 0x7f11c419f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:33976/0 (socket says 172.21.15.28:33976) 2024-06-06T08:39:26.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.800+0000 7f11c3e00700 1 -- 172.21.15.28:0/1831358917 learned_addr learned my addr 172.21.15.28:0/1831358917 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:39:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.800+0000 7f11c3e00700 1 -- 172.21.15.28:0/1831358917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c4104f80 msgr2=0x7f11c419b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.800+0000 7f11c3e00700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c4104f80 0x7f11c419b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.800+0000 7f11c3e00700 1 -- 172.21.15.28:0/1831358917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11c41045c0 msgr2=0x7f11c419ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.800+0000 7f11c3e00700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11c41045c0 0x7f11c419ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.800+0000 7f11c3e00700 1 -- 172.21.15.28:0/1831358917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c419fd20 con 0x7f11c410a650 2024-06-06T08:39:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.801+0000 7f11c3e00700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c410a650 0x7f11c419f5e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00ef30 tx=0x7f11bc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:26.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.801+0000 7f11bbe00700 1 -- 172.21.15.28:0/1831358917 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0092e0 con 0x7f11c410a650 2024-06-06T08:39:26.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.801+0000 7f11c9000700 1 -- 172.21.15.28:0/1831358917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c419ffb0 con 0x7f11c410a650 2024-06-06T08:39:26.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.801+0000 7f11bbe00700 1 -- 172.21.15.28:0/1831358917 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11bc004bb0 con 0x7f11c410a650 2024-06-06T08:39:26.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.801+0000 7f11bbe00700 1 -- 172.21.15.28:0/1831358917 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc004280 con 0x7f11c410a650 2024-06-06T08:39:26.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.801+0000 7f11c9000700 1 -- 172.21.15.28:0/1831358917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c41a7890 con 0x7f11c410a650 2024-06-06T08:39:26.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.802+0000 7f11c9000700 1 -- 172.21.15.28:0/1831358917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c4069180 con 0x7f11c410a650 2024-06-06T08:39:26.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.804+0000 7f11bbe00700 1 -- 172.21.15.28:0/1831358917 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f11bc01b030 con 0x7f11c410a650 2024-06-06T08:39:26.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.805+0000 7f11bbe00700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f11a80a2ca0 0x7f11a80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:26.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.805+0000 7f11bbe00700 1 -- 172.21.15.28:0/1831358917 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f11bc0ce680 con 0x7f11c410a650 2024-06-06T08:39:26.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.806+0000 7f11c3400700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f11a80a2ca0 0x7f11a80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:26.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.806+0000 7f11c3400700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f11a80a2ca0 0x7f11a80a5160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11b400b2e0 tx=0x7f11b4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:26.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:26.809+0000 7f11bbe00700 1 -- 172.21.15.28:0/1831358917 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f11bc022020 con 0x7f11c410a650 2024-06-06T08:39:27.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.092+0000 7f11c9000700 1 -- 172.21.15.28:0/1831358917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11c41a7a60 con 0x7f11c410a650 2024-06-06T08:39:27.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.093+0000 7f11bbe00700 1 -- 172.21.15.28:0/1831358917 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7162 (secure 0 0 0) 0x7f11bc010040 con 0x7f11c410a650 2024-06-06T08:39:27.092 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:39:27.092 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-06-06T08:39:27.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 -- 172.21.15.28:0/1831358917 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f11a80a2ca0 msgr2=0x7f11a80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:27.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f11a80a2ca0 0x7f11a80a5160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11b400b2e0 tx=0x7f11b4005fd0 comp rx=0 tx=0).stop 2024-06-06T08:39:27.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 -- 172.21.15.28:0/1831358917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c410a650 msgr2=0x7f11c419f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:27.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c410a650 0x7f11c419f5e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00ef30 tx=0x7f11bc00c3a0 comp rx=0 tx=0).stop 2024-06-06T08:39:27.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 -- 172.21.15.28:0/1831358917 shutdown_connections 2024-06-06T08:39:27.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f11a80a2ca0 0x7f11a80a5160 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:27.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c410a650 0x7f11c419f5e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:27.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11c41045c0 0x7f11c419ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:27.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 --2- 172.21.15.28:0/1831358917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11c4104f80 0x7f11c419b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:27.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 -- 172.21.15.28:0/1831358917 >> 172.21.15.28:0/1831358917 conn(0x7f11c41000b0 msgr2=0x7f11c4101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:27.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 -- 172.21.15.28:0/1831358917 shutdown_connections 2024-06-06T08:39:27.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:27.096+0000 7f11c9000700 1 -- 172.21.15.28:0/1831358917 wait complete. 2024-06-06T08:39:27.096 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 9 2024-06-06T08:39:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: Deploying daemon mds.i on smithi059 2024-06-06T08:39:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] up:boot 2024-06-06T08:39:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: fsmap 8 up:standby 2024-06-06T08:39:27.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T08:39:27.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:27 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1831358917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:27.490 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:27.490 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:27.490 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:27.490 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:27.490 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:27.490 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:27.490 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:27.490 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: Deploying daemon mds.i on smithi059 2024-06-06T08:39:27.490 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] up:boot 2024-06-06T08:39:27.491 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: fsmap 8 up:standby 2024-06-06T08:39:27.491 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T08:39:27.491 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:27 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1831358917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:27.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:27.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:27.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:27.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:27.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:27.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: Deploying daemon mds.i on smithi059 2024-06-06T08:39:27.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] up:boot 2024-06-06T08:39:27.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: fsmap 8 up:standby 2024-06-06T08:39:27.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T08:39:27.564 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:27 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1831358917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:29.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:29 smithi059 ceph-mon[36684]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:29.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:29 smithi028 ceph-mon[31564]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:29.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:29 smithi037 ceph-mon[36609]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:30.094 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:39:30.512 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:30 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] up:boot 2024-06-06T08:39:30.512 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:30 smithi028 ceph-mon[31564]: fsmap 9 up:standby 2024-06-06T08:39:30.512 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T08:39:30.513 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:30.513 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:30.513 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:30.513 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:30.513 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:30.513 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:30.513 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:30 smithi028 ceph-mon[31564]: Deploying daemon mds.g on smithi028 2024-06-06T08:39:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:30 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] up:boot 2024-06-06T08:39:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:30 smithi059 ceph-mon[36684]: fsmap 9 up:standby 2024-06-06T08:39:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T08:39:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:30.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:30 smithi059 ceph-mon[36684]: Deploying daemon mds.g on smithi028 2024-06-06T08:39:30.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:30 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] up:boot 2024-06-06T08:39:30.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:30 smithi037 ceph-mon[36609]: fsmap 9 up:standby 2024-06-06T08:39:30.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T08:39:30.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:30.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:30.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:30.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:30.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:30.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:30.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:30 smithi037 ceph-mon[36609]: Deploying daemon mds.g on smithi028 2024-06-06T08:39:31.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:31 smithi028 ceph-mon[31564]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:31.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:31 smithi037 ceph-mon[36609]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:31.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:31 smithi059 ceph-mon[36684]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:31.894 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:39:33.001 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:39:32 smithi028 systemd[1]: Starting Ceph mds.g for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:39:33.647 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:33 smithi028 ceph-mon[31564]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:33.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:33 smithi037 ceph-mon[36609]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:33.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:33 smithi059 ceph-mon[36684]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:33.903 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:39:33 smithi028 podman[73302]: 2024-06-06 08:39:33.553133063 +0000 UTC m=+0.036485538 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:39:33.903 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:39:33 smithi028 podman[73302]: 2024-06-06 08:39:33.68430991 +0000 UTC m=+0.167662409 container create ee17ab967d385588ba5c8601a54a014c1d72dc14c0ab98b42ec223fdc18cae38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-06-06T08:39:34.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.455+0000 7feb2c200700 1 -- 172.21.15.28:0/3136448680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb2410a680 msgr2=0x7feb2410aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:34.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.455+0000 7feb2c200700 1 --2- 172.21.15.28:0/3136448680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb2410a680 0x7feb2410aa60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb18009990 tx=0x7feb18009ca0 comp rx=0 tx=0).stop 2024-06-06T08:39:34.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.455+0000 7feb2c200700 1 -- 172.21.15.28:0/3136448680 shutdown_connections 2024-06-06T08:39:34.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.455+0000 7feb2c200700 1 --2- 172.21.15.28:0/3136448680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb24105040 0x7feb24111550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:34.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.455+0000 7feb2c200700 1 --2- 172.21.15.28:0/3136448680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb2410a680 0x7feb2410aa60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:34.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.455+0000 7feb2c200700 1 --2- 172.21.15.28:0/3136448680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb24104680 0x7feb24104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:34.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.455+0000 7feb2c200700 1 -- 172.21.15.28:0/3136448680 >> 172.21.15.28:0/3136448680 conn(0x7feb24100170 msgr2=0x7feb24102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:34.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.455+0000 7feb2c200700 1 -- 172.21.15.28:0/3136448680 shutdown_connections 2024-06-06T08:39:34.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.455+0000 7feb2c200700 1 -- 172.21.15.28:0/3136448680 wait complete. 2024-06-06T08:39:34.456 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:39:34 smithi028 podman[73302]: 2024-06-06 08:39:34.186672118 +0000 UTC m=+0.670024620 container init ee17ab967d385588ba5c8601a54a014c1d72dc14c0ab98b42ec223fdc18cae38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T08:39:34.456 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:39:34 smithi028 podman[73302]: 2024-06-06 08:39:34.197201749 +0000 UTC m=+0.680554254 container start ee17ab967d385588ba5c8601a54a014c1d72dc14c0ab98b42ec223fdc18cae38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-06-06T08:39:34.456 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:39:34 smithi028 ceph-mds[73343]: -- 172.21.15.28:0/1699338021 <== mon.0 v2:172.21.15.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5646561c3a40 con 0x564656196c00 2024-06-06T08:39:34.456 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:39:34 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g[73335]: starting mds.g at 2024-06-06T08:39:34.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.456+0000 7feb2c200700 1 Processor -- start 2024-06-06T08:39:34.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb2c200700 1 -- start start 2024-06-06T08:39:34.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb2c200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb24104680 0x7feb2419ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:34.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb2c200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb24105040 0x7feb2419b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:34.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb2c200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb2410a680 0x7feb2419f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:34.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb2c200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7feb24114a20 con 0x7feb2410a680 2024-06-06T08:39:34.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb2c200700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feb241148a0 con 0x7feb24105040 2024-06-06T08:39:34.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb2c200700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feb24114ba0 con 0x7feb24104680 2024-06-06T08:39:34.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb29800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb24104680 0x7feb2419ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:34.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb28e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb24105040 0x7feb2419b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:34.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb29800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb24104680 0x7feb2419ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:34012/0 (socket says 172.21.15.28:34012) 2024-06-06T08:39:34.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb29800700 1 -- 172.21.15.28:0/713657787 learned_addr learned my addr 172.21.15.28:0/713657787 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:39:34.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.457+0000 7feb2a200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb2410a680 0x7feb2419f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:34.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.458+0000 7feb28e00700 1 -- 172.21.15.28:0/713657787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb24104680 msgr2=0x7feb2419ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:34.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.458+0000 7feb28e00700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb24104680 0x7feb2419ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:34.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.458+0000 7feb28e00700 1 -- 172.21.15.28:0/713657787 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb2410a680 msgr2=0x7feb2419f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:34.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.458+0000 7feb28e00700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb2410a680 0x7feb2419f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:34.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.458+0000 7feb28e00700 1 -- 172.21.15.28:0/713657787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2419fe40 con 0x7feb24105040 2024-06-06T08:39:34.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.458+0000 7feb2a200700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb2410a680 0x7feb2419f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:39:34.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.458+0000 7feb28e00700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb24105040 0x7feb2419b370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb1000e9f0 tx=0x7feb1000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:34.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.459+0000 7feb22000700 1 -- 172.21.15.28:0/713657787 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1000cbd0 con 0x7feb24105040 2024-06-06T08:39:34.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.459+0000 7feb22000700 1 -- 172.21.15.28:0/713657787 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb10004500 con 0x7feb24105040 2024-06-06T08:39:34.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.459+0000 7feb22000700 1 -- 172.21.15.28:0/713657787 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10005280 con 0x7feb24105040 2024-06-06T08:39:34.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.459+0000 7feb2c200700 1 -- 172.21.15.28:0/713657787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb241a0130 con 0x7feb24105040 2024-06-06T08:39:34.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.459+0000 7feb2c200700 1 -- 172.21.15.28:0/713657787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb241a79b0 con 0x7feb24105040 2024-06-06T08:39:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.460+0000 7feb2c200700 1 -- 172.21.15.28:0/713657787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb24069180 con 0x7feb24105040 2024-06-06T08:39:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.462+0000 7feb22000700 1 -- 172.21.15.28:0/713657787 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7feb10005420 con 0x7feb24105040 2024-06-06T08:39:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.464+0000 7feb22000700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7feb0c0a2ca0 0x7feb0c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.464+0000 7feb22000700 1 -- 172.21.15.28:0/713657787 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7feb100ceb40 con 0x7feb24105040 2024-06-06T08:39:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.464+0000 7feb29800700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7feb0c0a2ca0 0x7feb0c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.465+0000 7feb29800700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7feb0c0a2ca0 0x7feb0c0a5160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb18006010 tx=0x7feb1800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:34.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.468+0000 7feb22000700 1 -- 172.21.15.28:0/713657787 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7feb1009bea0 con 0x7feb24105040 2024-06-06T08:39:34.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.779+0000 7feb2c200700 1 -- 172.21.15.28:0/713657787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb2402dca0 con 0x7feb24105040 2024-06-06T08:39:34.779 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:39:34 smithi028 bash[73302]: ee17ab967d385588ba5c8601a54a014c1d72dc14c0ab98b42ec223fdc18cae38 2024-06-06T08:39:34.779 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:39:34 smithi028 systemd[1]: Started Ceph mds.g for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:39:34.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.780+0000 7feb22000700 1 -- 172.21.15.28:0/713657787 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8809 (secure 0 0 0) 0x7feb1009b7a0 con 0x7feb24105040 2024-06-06T08:39:34.779 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:39:34.780 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14388,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/735176440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":735176440},{"type":"v1","addr":"172.21.15.28:6839","nonce":735176440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/771325139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":771325139},{"type":"v1","addr":"172.21.15.59:6839","nonce":771325139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-06-06T08:39:34.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 -- 172.21.15.28:0/713657787 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7feb0c0a2ca0 msgr2=0x7feb0c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:34.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7feb0c0a2ca0 0x7feb0c0a5160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb18006010 tx=0x7feb1800b260 comp rx=0 tx=0).stop 2024-06-06T08:39:34.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 -- 172.21.15.28:0/713657787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb24105040 msgr2=0x7feb2419b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:34.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb24105040 0x7feb2419b370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb1000e9f0 tx=0x7feb1000ed00 comp rx=0 tx=0).stop 2024-06-06T08:39:34.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 -- 172.21.15.28:0/713657787 shutdown_connections 2024-06-06T08:39:34.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7feb0c0a2ca0 0x7feb0c0a5160 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:34.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb2410a680 0x7feb2419f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:34.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb24104680 0x7feb2419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:34.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 --2- 172.21.15.28:0/713657787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb24105040 0x7feb2419b370 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:34.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 -- 172.21.15.28:0/713657787 >> 172.21.15.28:0/713657787 conn(0x7feb24100170 msgr2=0x7feb24100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:34.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 -- 172.21.15.28:0/713657787 shutdown_connections 2024-06-06T08:39:34.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:34.784+0000 7feb2c200700 1 -- 172.21.15.28:0/713657787 wait complete. 2024-06-06T08:39:34.784 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 11 2024-06-06T08:39:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.28:6838/735176440,v1:172.21.15.28:6839/735176440] up:boot 2024-06-06T08:39:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: fsmap 10 up:standby 2024-06-06T08:39:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T08:39:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:35.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:35.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:35.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:35.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:35.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: Deploying daemon mds.a on smithi028 2024-06-06T08:39:35.792 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:35 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/713657787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:35.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:35.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.28:6838/735176440,v1:172.21.15.28:6839/735176440] up:boot 2024-06-06T08:39:35.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: fsmap 10 up:standby 2024-06-06T08:39:35.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T08:39:35.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:35.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:35.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:35.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:35.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:35.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:35.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: Deploying daemon mds.a on smithi028 2024-06-06T08:39:35.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:35 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/713657787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:35.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:35.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.28:6838/735176440,v1:172.21.15.28:6839/735176440] up:boot 2024-06-06T08:39:35.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: fsmap 10 up:standby 2024-06-06T08:39:35.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T08:39:35.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:35.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:35.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:35.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:35.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:35.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:35.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: Deploying daemon mds.a on smithi028 2024-06-06T08:39:35.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:35 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/713657787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:37.632 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:39:37.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:37 smithi028 ceph-mon[31564]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:37.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:37 smithi037 ceph-mon[36609]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:37.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:37 smithi059 ceph-mon[36684]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:38.231 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:39:37 smithi028 systemd[1]: Starting Ceph mds.a for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:39:38.531 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:39:38 smithi028 podman[73694]: 2024-06-06 08:39:38.136287801 +0000 UTC m=+0.033336522 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:39:38.531 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:39:38 smithi028 podman[73694]: 2024-06-06 08:39:38.244996731 +0000 UTC m=+0.142045477 container create cca8901e7351785a24da8d9772bfdcb3e07573b697382cd5f6ce017aa59265f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-06-06T08:39:38.531 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:39:38 smithi028 podman[73694]: 2024-06-06 08:39:38.532215509 +0000 UTC m=+0.429264311 container init cca8901e7351785a24da8d9772bfdcb3e07573b697382cd5f6ce017aa59265f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-06T08:39:38.657 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:39:38.791 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:39:38 smithi028 podman[73694]: 2024-06-06 08:39:38.542702829 +0000 UTC m=+0.439751555 container start cca8901e7351785a24da8d9772bfdcb3e07573b697382cd5f6ce017aa59265f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528) 2024-06-06T08:39:38.791 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:39:38 smithi028 ceph-mds[73735]: -- 172.21.15.28:0/2657939541 <== mon.0 v2:172.21.15.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56131e407a40 con 0x56131e3db000 2024-06-06T08:39:38.791 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:39:38 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a[73729]: starting mds.a at 2024-06-06T08:39:38.791 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:39:38 smithi028 bash[73694]: cca8901e7351785a24da8d9772bfdcb3e07573b697382cd5f6ce017aa59265f6 2024-06-06T08:39:38.791 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:39:38 smithi028 systemd[1]: Started Ceph mds.a for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:39:39.812 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:39 smithi037 ceph-mon[36609]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:39 smithi037 ceph-mon[36609]: Deploying daemon mds.b on smithi037 2024-06-06T08:39:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:39 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.28:6840/3192274308,v1:172.21.15.28:6841/3192274308] up:boot 2024-06-06T08:39:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:39 smithi037 ceph-mon[36609]: fsmap 11 up:standby 2024-06-06T08:39:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:39 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T08:39:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:39 smithi028 ceph-mon[31564]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:40.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:40.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:40.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:40.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:39 smithi028 ceph-mon[31564]: Deploying daemon mds.b on smithi037 2024-06-06T08:39:40.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:39 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.28:6840/3192274308,v1:172.21.15.28:6841/3192274308] up:boot 2024-06-06T08:39:40.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:39 smithi028 ceph-mon[31564]: fsmap 11 up:standby 2024-06-06T08:39:40.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:39 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T08:39:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:39 smithi059 ceph-mon[36684]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T08:39:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T08:39:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:40.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:39 smithi059 ceph-mon[36684]: Deploying daemon mds.b on smithi037 2024-06-06T08:39:40.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:39 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.28:6840/3192274308,v1:172.21.15.28:6841/3192274308] up:boot 2024-06-06T08:39:40.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:39 smithi059 ceph-mon[36684]: fsmap 11 up:standby 2024-06-06T08:39:40.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:39 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T08:39:40.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.945+0000 7f60c1800700 1 -- 172.21.15.28:0/356145233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc1089d0 msgr2=0x7f60bc108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:40.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.945+0000 7f60c1800700 1 --2- 172.21.15.28:0/356145233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc1089d0 0x7f60bc108e50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009990 tx=0x7f60a8009ca0 comp rx=0 tx=0).stop 2024-06-06T08:39:40.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.945+0000 7f60c1800700 1 -- 172.21.15.28:0/356145233 shutdown_connections 2024-06-06T08:39:40.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.945+0000 7f60c1800700 1 --2- 172.21.15.28:0/356145233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60bc109390 0x7f60bc115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:40.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.945+0000 7f60c1800700 1 --2- 172.21.15.28:0/356145233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60bc10d8a0 0x7f60bc10dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:40.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.945+0000 7f60c1800700 1 --2- 172.21.15.28:0/356145233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc1089d0 0x7f60bc108e50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:40.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.945+0000 7f60c1800700 1 -- 172.21.15.28:0/356145233 >> 172.21.15.28:0/356145233 conn(0x7f60bc078220 msgr2=0x7f60bc1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:40.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.945+0000 7f60c1800700 1 -- 172.21.15.28:0/356145233 shutdown_connections 2024-06-06T08:39:40.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.945+0000 7f60c1800700 1 -- 172.21.15.28:0/356145233 wait complete. 2024-06-06T08:39:40.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.946+0000 7f60c1800700 1 Processor -- start 2024-06-06T08:39:40.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.947+0000 7f60c1800700 1 -- start start 2024-06-06T08:39:40.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.947+0000 7f60c1800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60bc1089d0 0x7f60bc19f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:40.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.947+0000 7f60c1800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc109390 0x7f60bc19f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:40.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.947+0000 7f60c1800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60bc10d8a0 0x7f60bc1a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:40.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.947+0000 7f60c1800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc118cd0 con 0x7f60bc1089d0 2024-06-06T08:39:40.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.947+0000 7f60c1800700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc118b50 con 0x7f60bc109390 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.947+0000 7f60c1800700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc118e50 con 0x7f60bc10d8a0 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.947+0000 7f60bb400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc109390 0x7f60bc19f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.947+0000 7f60bbe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60bc1089d0 0x7f60bc19f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.947+0000 7f60bb400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc109390 0x7f60bc19f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:38324/0 (socket says 172.21.15.28:38324) 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.947+0000 7f60bb400700 1 -- 172.21.15.28:0/4285428713 learned_addr learned my addr 172.21.15.28:0/4285428713 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.948+0000 7f60c0e00700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60bc10d8a0 0x7f60bc1a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.948+0000 7f60bbe00700 1 -- 172.21.15.28:0/4285428713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60bc10d8a0 msgr2=0x7f60bc1a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.948+0000 7f60bbe00700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60bc10d8a0 0x7f60bc1a3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.948+0000 7f60bbe00700 1 -- 172.21.15.28:0/4285428713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc109390 msgr2=0x7f60bc19f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.948+0000 7f60bbe00700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc109390 0x7f60bc19f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.948+0000 7f60bbe00700 1 -- 172.21.15.28:0/4285428713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc1a41b0 con 0x7f60bc1089d0 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.948+0000 7f60bb400700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc109390 0x7f60bc19f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:39:40.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.948+0000 7f60bbe00700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60bc1089d0 0x7f60bc19f1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00e9f0 tx=0x7f60ac00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.949+0000 7f60b8c00700 1 -- 172.21.15.28:0/4285428713 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00c9c0 con 0x7f60bc1089d0 2024-06-06T08:39:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.949+0000 7f60c1800700 1 -- 172.21.15.28:0/4285428713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60bc1a44a0 con 0x7f60bc1089d0 2024-06-06T08:39:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.949+0000 7f60b8c00700 1 -- 172.21.15.28:0/4285428713 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60ac00cb60 con 0x7f60bc1089d0 2024-06-06T08:39:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.949+0000 7f60b8c00700 1 -- 172.21.15.28:0/4285428713 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac018680 con 0x7f60bc1089d0 2024-06-06T08:39:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.949+0000 7f60c1800700 1 -- 172.21.15.28:0/4285428713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60bc1abd20 con 0x7f60bc1089d0 2024-06-06T08:39:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.950+0000 7f60c1800700 1 -- 172.21.15.28:0/4285428713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60bc069180 con 0x7f60bc1089d0 2024-06-06T08:39:40.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.953+0000 7f60b8c00700 1 -- 172.21.15.28:0/4285428713 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f60ac010430 con 0x7f60bc1089d0 2024-06-06T08:39:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.954+0000 7f60b8c00700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60a00a2ca0 0x7f60a00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.954+0000 7f60b8c00700 1 -- 172.21.15.28:0/4285428713 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f60ac0cee50 con 0x7f60bc1089d0 2024-06-06T08:39:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.954+0000 7f60bb400700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60a00a2ca0 0x7f60a00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.955+0000 7f60bb400700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60a00a2ca0 0x7f60a00a5160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f60bc108580 tx=0x7f60a8009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:40.958+0000 7f60b8c00700 1 -- 172.21.15.28:0/4285428713 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f60ac09c1b0 con 0x7f60bc1089d0 2024-06-06T08:39:41.063 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:39:40 smithi037 systemd[1]: Starting Ceph mds.b for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:39:41.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.235+0000 7f60c1800700 1 -- 172.21.15.28:0/4285428713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60bc02dca0 con 0x7f60bc1089d0 2024-06-06T08:39:41.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.237+0000 7f60b8c00700 1 -- 172.21.15.28:0/4285428713 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9635 (secure 0 0 0) 0x7f60ac09bab0 con 0x7f60bc1089d0 2024-06-06T08:39:41.236 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:39:41.236 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14388,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/735176440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":735176440},{"type":"v1","addr":"172.21.15.28:6839","nonce":735176440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6841/3192274308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":3192274308},{"type":"v1","addr":"172.21.15.28:6841","nonce":3192274308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/771325139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":771325139},{"type":"v1","addr":"172.21.15.59:6839","nonce":771325139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-06-06T08:39:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 -- 172.21.15.28:0/4285428713 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60a00a2ca0 msgr2=0x7f60a00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60a00a2ca0 0x7f60a00a5160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f60bc108580 tx=0x7f60a8009590 comp rx=0 tx=0).stop 2024-06-06T08:39:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 -- 172.21.15.28:0/4285428713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60bc1089d0 msgr2=0x7f60bc19f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60bc1089d0 0x7f60bc19f1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00e9f0 tx=0x7f60ac00ed00 comp rx=0 tx=0).stop 2024-06-06T08:39:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 -- 172.21.15.28:0/4285428713 shutdown_connections 2024-06-06T08:39:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60a00a2ca0 0x7f60a00a5160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60bc10d8a0 0x7f60bc1a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60bc1089d0 0x7f60bc19f1a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 --2- 172.21.15.28:0/4285428713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc109390 0x7f60bc19f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 -- 172.21.15.28:0/4285428713 >> 172.21.15.28:0/4285428713 conn(0x7f60bc078220 msgr2=0x7f60bc0788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 -- 172.21.15.28:0/4285428713 shutdown_connections 2024-06-06T08:39:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:41.240+0000 7f60c1800700 1 -- 172.21.15.28:0/4285428713 wait complete. 2024-06-06T08:39:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 12 2024-06-06T08:39:41.440 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:39:41 smithi037 podman[67246]: 2024-06-06 08:39:41.1878965 +0000 UTC m=+0.114057464 container create 9b5f9b2bc609a2897096c94b377ddd3b5a47df8a3ac622afa7938bd0c9656725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-06-06T08:39:41.441 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:39:41 smithi037 podman[67246]: 2024-06-06 08:39:41.092282573 +0000 UTC m=+0.018443555 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:39:41.441 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:39:41 smithi037 podman[67246]: 2024-06-06 08:39:41.415815228 +0000 UTC m=+0.341976195 container init 9b5f9b2bc609a2897096c94b377ddd3b5a47df8a3ac622afa7938bd0c9656725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux ) 2024-06-06T08:39:41.441 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:39:41 smithi037 podman[67246]: 2024-06-06 08:39:41.418596052 +0000 UTC m=+0.344757019 container start 9b5f9b2bc609a2897096c94b377ddd3b5a47df8a3ac622afa7938bd0c9656725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:39:41.441 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:39:41 smithi037 ceph-mds[67265]: -- 172.21.15.37:0/1931198680 <== mon.2 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ecc319a40 con 0x556ecc2ed000 2024-06-06T08:39:41.748 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:39:41 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b[67261]: starting mds.b at 2024-06-06T08:39:41.749 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:39:41 smithi037 bash[67246]: 9b5f9b2bc609a2897096c94b377ddd3b5a47df8a3ac622afa7938bd0c9656725 2024-06-06T08:39:41.749 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:39:41 smithi037 systemd[1]: Started Ceph mds.b for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:39:42.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:41 smithi037 ceph-mon[36609]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:42.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:41 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/4285428713' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:42.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:41 smithi028 ceph-mon[31564]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:42.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:41 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/4285428713' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:42.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:41 smithi059 ceph-mon[36684]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:41 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/4285428713' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:43.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:42 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] up:boot 2024-06-06T08:39:43.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:42 smithi037 ceph-mon[36609]: fsmap 12 up:standby 2024-06-06T08:39:43.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:42 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T08:39:43.014 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:42 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:39:43.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:42 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] up:boot 2024-06-06T08:39:43.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:42 smithi028 ceph-mon[31564]: fsmap 12 up:standby 2024-06-06T08:39:43.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:42 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T08:39:43.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:42 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:39:43.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:42 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] up:boot 2024-06-06T08:39:43.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:42 smithi059 ceph-mon[36684]: fsmap 12 up:standby 2024-06-06T08:39:43.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:42 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T08:39:43.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:42 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:39:44.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:43 smithi028 ceph-mon[31564]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:44.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:43 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:43 smithi037 ceph-mon[36609]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:44.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:43 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:43 smithi059 ceph-mon[36684]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:44.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:43 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:44.190 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:39:44.663 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:39:46.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:45 smithi028 ceph-mon[31564]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:46.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:46.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:39:46.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:45 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:39:46.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:45 smithi037 ceph-mon[36609]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:46.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:46.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:39:46.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:45 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:39:46.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:45 smithi059 ceph-mon[36684]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:46.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:46.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:39:46.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:46.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:45 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:39:47.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.004+0000 7fe330000700 1 -- 172.21.15.28:0/4040275249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280769c0 msgr2=0x7fe328076da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:47.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.004+0000 7fe330000700 1 --2- 172.21.15.28:0/4040275249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280769c0 0x7fe328076da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0098f0 tx=0x7fe31c009c00 comp rx=0 tx=0).stop 2024-06-06T08:39:47.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.004+0000 7fe330000700 1 -- 172.21.15.28:0/4040275249 shutdown_connections 2024-06-06T08:39:47.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.004+0000 7fe330000700 1 --2- 172.21.15.28:0/4040275249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe328113370 0x7fe328115760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:47.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.004+0000 7fe330000700 1 --2- 172.21.15.28:0/4040275249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280769c0 0x7fe328076da0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:47.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.004+0000 7fe330000700 1 --2- 172.21.15.28:0/4040275249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3280772e0 0x7fe328112e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:47.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.004+0000 7fe330000700 1 -- 172.21.15.28:0/4040275249 >> 172.21.15.28:0/4040275249 conn(0x7fe3281001c0 msgr2=0x7fe3281025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:47.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.004+0000 7fe330000700 1 -- 172.21.15.28:0/4040275249 shutdown_connections 2024-06-06T08:39:47.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.004+0000 7fe330000700 1 -- 172.21.15.28:0/4040275249 wait complete. 2024-06-06T08:39:47.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.006+0000 7fe330000700 1 Processor -- start 2024-06-06T08:39:47.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.006+0000 7fe330000700 1 -- start start 2024-06-06T08:39:47.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.006+0000 7fe330000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3280769c0 0x7fe32819f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:47.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.006+0000 7fe330000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3280772e0 0x7fe32819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:47.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.006+0000 7fe330000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe328113370 0x7fe3281a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:47.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.006+0000 7fe330000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe328118e40 con 0x7fe3280772e0 2024-06-06T08:39:47.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.006+0000 7fe330000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe328118cc0 con 0x7fe328113370 2024-06-06T08:39:47.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.006+0000 7fe330000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe328118fc0 con 0x7fe3280769c0 2024-06-06T08:39:47.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32e000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe328113370 0x7fe3281a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:47.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32cc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3280772e0 0x7fe32819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:47.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32d600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3280769c0 0x7fe32819f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:47.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32d600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3280769c0 0x7fe32819f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:52026/0 (socket says 172.21.15.28:52026) 2024-06-06T08:39:47.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32e000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe328113370 0x7fe3281a3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:58564/0 (socket says 172.21.15.28:58564) 2024-06-06T08:39:47.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32d600700 1 -- 172.21.15.28:0/2550304224 learned_addr learned my addr 172.21.15.28:0/2550304224 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:39:47.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32d600700 1 -- 172.21.15.28:0/2550304224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe328113370 msgr2=0x7fe3281a3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:47.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32d600700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe328113370 0x7fe3281a3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:47.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32d600700 1 -- 172.21.15.28:0/2550304224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3280772e0 msgr2=0x7fe32819f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:47.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32d600700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3280772e0 0x7fe32819f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:47.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32d600700 1 -- 172.21.15.28:0/2550304224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3281a42a0 con 0x7fe3280769c0 2024-06-06T08:39:47.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.007+0000 7fe32cc00700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3280772e0 0x7fe32819f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:39:47.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.008+0000 7fe32d600700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3280769c0 0x7fe32819f290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009230 tx=0x7fe31c00fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:47.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.008+0000 7fe326000700 1 -- 172.21.15.28:0/2550304224 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c005180 con 0x7fe3280769c0 2024-06-06T08:39:47.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.008+0000 7fe326000700 1 -- 172.21.15.28:0/2550304224 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe31c00b560 con 0x7fe3280769c0 2024-06-06T08:39:47.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.008+0000 7fe330000700 1 -- 172.21.15.28:0/2550304224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3281a4530 con 0x7fe3280769c0 2024-06-06T08:39:47.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.008+0000 7fe326000700 1 -- 172.21.15.28:0/2550304224 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c003a70 con 0x7fe3280769c0 2024-06-06T08:39:47.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.008+0000 7fe330000700 1 -- 172.21.15.28:0/2550304224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3281abe10 con 0x7fe3280769c0 2024-06-06T08:39:47.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.009+0000 7fe330000700 1 -- 172.21.15.28:0/2550304224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe328069180 con 0x7fe3280769c0 2024-06-06T08:39:47.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.011+0000 7fe326000700 1 -- 172.21.15.28:0/2550304224 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe31c029060 con 0x7fe3280769c0 2024-06-06T08:39:47.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.012+0000 7fe326000700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe3100a2ca0 0x7fe3100a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:47.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.012+0000 7fe326000700 1 -- 172.21.15.28:0/2550304224 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe31c0cf470 con 0x7fe3280769c0 2024-06-06T08:39:47.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.013+0000 7fe32cc00700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe3100a2ca0 0x7fe3100a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:47.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.013+0000 7fe32cc00700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe3100a2ca0 0x7fe3100a5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe314009750 tx=0x7fe314009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:47.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.019+0000 7fe326000700 1 -- 172.21.15.28:0/2550304224 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe31c013030 con 0x7fe3280769c0 2024-06-06T08:39:47.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.310+0000 7fe330000700 1 -- 172.21.15.28:0/2550304224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe32802dca0 con 0x7fe3280769c0 2024-06-06T08:39:47.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.311+0000 7fe326000700 1 -- 172.21.15.28:0/2550304224 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10458 (secure 0 0 0) 0x7fe31c09c860 con 0x7fe3280769c0 2024-06-06T08:39:47.310 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:39:47.310 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14388,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6839/735176440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":735176440},{"type":"v1","addr":"172.21.15.28:6839","nonce":735176440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6841/3192274308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":3192274308},{"type":"v1","addr":"172.21.15.28:6841","nonce":3192274308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24485,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/771325139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":771325139},{"type":"v1","addr":"172.21.15.59:6839","nonce":771325139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24503,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24542,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/527311102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":527311102},{"type":"v1","addr":"172.21.15.37:6839","nonce":527311102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-06-06T08:39:47.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.314+0000 7fe330000700 1 -- 172.21.15.28:0/2550304224 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe3100a2ca0 msgr2=0x7fe3100a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:47.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.314+0000 7fe330000700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe3100a2ca0 0x7fe3100a5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe314009750 tx=0x7fe314009310 comp rx=0 tx=0).stop 2024-06-06T08:39:47.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.314+0000 7fe330000700 1 -- 172.21.15.28:0/2550304224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3280769c0 msgr2=0x7fe32819f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:47.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.314+0000 7fe330000700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3280769c0 0x7fe32819f290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009230 tx=0x7fe31c00fa70 comp rx=0 tx=0).stop 2024-06-06T08:39:47.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.315+0000 7fe330000700 1 -- 172.21.15.28:0/2550304224 shutdown_connections 2024-06-06T08:39:47.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.315+0000 7fe330000700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe3100a2ca0 0x7fe3100a5160 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:47.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.315+0000 7fe330000700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe328113370 0x7fe3281a3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:47.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.315+0000 7fe330000700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3280769c0 0x7fe32819f290 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:47.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.315+0000 7fe330000700 1 --2- 172.21.15.28:0/2550304224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3280772e0 0x7fe32819f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:47.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.315+0000 7fe330000700 1 -- 172.21.15.28:0/2550304224 >> 172.21.15.28:0/2550304224 conn(0x7fe3281001c0 msgr2=0x7fe3281025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:47.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.315+0000 7fe330000700 1 -- 172.21.15.28:0/2550304224 shutdown_connections 2024-06-06T08:39:47.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:47.315+0000 7fe330000700 1 -- 172.21.15.28:0/2550304224 wait complete. 2024-06-06T08:39:47.315 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 13 2024-06-06T08:39:48.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:47 smithi028 ceph-mon[31564]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:48.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:47 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2550304224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:48.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:47 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:47 smithi037 ceph-mon[36609]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:48.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:47 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2550304224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:48.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:47 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:47 smithi059 ceph-mon[36684]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:48.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:47 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2550304224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:39:48.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:47 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:48.647 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-06-06T08:39:49.126 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:39:50.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:49 smithi028 ceph-mon[31564]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:50.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:49 smithi037 ceph-mon[36609]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:50.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:49 smithi059 ceph-mon[36684]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:51.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.571+0000 7f0d4b000700 1 -- 172.21.15.28:0/2854735735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d4406b3c0 msgr2=0x7f0d4410f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:51.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.571+0000 7f0d4b000700 1 --2- 172.21.15.28:0/2854735735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d4406b3c0 0x7f0d4410f310 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009f90 tx=0x7f0d3c00b330 comp rx=0 tx=0).stop 2024-06-06T08:39:51.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.572+0000 7f0d4b000700 1 -- 172.21.15.28:0/2854735735 shutdown_connections 2024-06-06T08:39:51.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.572+0000 7f0d4b000700 1 --2- 172.21.15.28:0/2854735735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d4406b3c0 0x7f0d4410f310 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:51.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.572+0000 7f0d4b000700 1 --2- 172.21.15.28:0/2854735735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d441084f0 0x7f0d441088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:51.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.572+0000 7f0d4b000700 1 --2- 172.21.15.28:0/2854735735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4406aa00 0x7f0d4406ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:51.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.572+0000 7f0d4b000700 1 -- 172.21.15.28:0/2854735735 >> 172.21.15.28:0/2854735735 conn(0x7f0d44078300 msgr2=0x7f0d44078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:51.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.572+0000 7f0d4b000700 1 -- 172.21.15.28:0/2854735735 shutdown_connections 2024-06-06T08:39:51.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.572+0000 7f0d4b000700 1 -- 172.21.15.28:0/2854735735 wait complete. 2024-06-06T08:39:51.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.573+0000 7f0d4b000700 1 Processor -- start 2024-06-06T08:39:51.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.573+0000 7f0d4b000700 1 -- start start 2024-06-06T08:39:51.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d4b000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4406aa00 0x7f0d44101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d4b000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d4406b3c0 0x7f0d44101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d4b000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d441084f0 0x7f0d44101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d4b000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44112770 con 0x7f0d441084f0 2024-06-06T08:39:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d4b000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d441125f0 con 0x7f0d4406aa00 2024-06-06T08:39:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d4b000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d441128f0 con 0x7f0d4406b3c0 2024-06-06T08:39:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d43e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4406aa00 0x7f0d44101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d49000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d441084f0 0x7f0d44101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d43e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4406aa00 0x7f0d44101450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:58572/0 (socket says 172.21.15.28:58572) 2024-06-06T08:39:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d43e00700 1 -- 172.21.15.28:0/748135497 learned_addr learned my addr 172.21.15.28:0/748135497 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:39:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d43400700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d4406b3c0 0x7f0d44101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:51.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d43e00700 1 -- 172.21.15.28:0/748135497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d4406b3c0 msgr2=0x7f0d44101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:51.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d43e00700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d4406b3c0 0x7f0d44101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:51.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d43e00700 1 -- 172.21.15.28:0/748135497 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d441084f0 msgr2=0x7f0d44101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:51.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.574+0000 7f0d43e00700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d441084f0 0x7f0d44101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.575+0000 7f0d43e00700 1 -- 172.21.15.28:0/748135497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d441a70b0 con 0x7f0d4406aa00 2024-06-06T08:39:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.575+0000 7f0d43e00700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4406aa00 0x7f0d44101450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400e9f0 tx=0x7f0d3400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.575+0000 7f0d40c00700 1 -- 172.21.15.28:0/748135497 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34004a30 con 0x7f0d4406aa00 2024-06-06T08:39:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.575+0000 7f0d40c00700 1 -- 172.21.15.28:0/748135497 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d3400cca0 con 0x7f0d4406aa00 2024-06-06T08:39:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.575+0000 7f0d4b000700 1 -- 172.21.15.28:0/748135497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d441a73a0 con 0x7f0d4406aa00 2024-06-06T08:39:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.575+0000 7f0d4b000700 1 -- 172.21.15.28:0/748135497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d441a78e0 con 0x7f0d4406aa00 2024-06-06T08:39:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.575+0000 7f0d40c00700 1 -- 172.21.15.28:0/748135497 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340056c0 con 0x7f0d4406aa00 2024-06-06T08:39:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.576+0000 7f0d4b000700 1 -- 172.21.15.28:0/748135497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d4410a9d0 con 0x7f0d4406aa00 2024-06-06T08:39:51.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.579+0000 7f0d40c00700 1 -- 172.21.15.28:0/748135497 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0d3400c7c0 con 0x7f0d4406aa00 2024-06-06T08:39:51.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.580+0000 7f0d40c00700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0d280a2ca0 0x7f0d280a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:51.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.580+0000 7f0d40c00700 1 -- 172.21.15.28:0/748135497 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f0d340cee70 con 0x7f0d4406aa00 2024-06-06T08:39:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.580+0000 7f0d43400700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0d280a2ca0 0x7f0d280a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.581+0000 7f0d43400700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0d280a2ca0 0x7f0d280a5160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0d44078890 tx=0x7f0d30009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:51.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.582+0000 7f0d40c00700 1 -- 172.21.15.28:0/748135497 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0d34053850 con 0x7f0d4406aa00 2024-06-06T08:39:51.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.816+0000 7f0d4b000700 1 -- 172.21.15.28:0/748135497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0d44102980 con 0x7f0d4406aa00 2024-06-06T08:39:51.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.816+0000 7f0d40c00700 1 -- 172.21.15.28:0/748135497 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f0d3409c1d0 con 0x7f0d4406aa00 2024-06-06T08:39:51.815 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:39:51.815 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2024-06-06T08:39:51.816 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:39:51.816 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2024-06-06T08:39:51.816 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2024-06-06T08:39:51.816 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:39:51.816 INFO:teuthology.orchestra.run.smithi028.stdout:] 2024-06-06T08:39:51.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.819+0000 7f0d4b000700 1 -- 172.21.15.28:0/748135497 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0d280a2ca0 msgr2=0x7f0d280a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:51.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.819+0000 7f0d4b000700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0d280a2ca0 0x7f0d280a5160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0d44078890 tx=0x7f0d30009260 comp rx=0 tx=0).stop 2024-06-06T08:39:51.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.819+0000 7f0d4b000700 1 -- 172.21.15.28:0/748135497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4406aa00 msgr2=0x7f0d44101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:51.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.819+0000 7f0d4b000700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4406aa00 0x7f0d44101450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400e9f0 tx=0x7f0d3400ed00 comp rx=0 tx=0).stop 2024-06-06T08:39:51.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.820+0000 7f0d4b000700 1 -- 172.21.15.28:0/748135497 shutdown_connections 2024-06-06T08:39:51.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.820+0000 7f0d4b000700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0d280a2ca0 0x7f0d280a5160 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:51.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.820+0000 7f0d4b000700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d441084f0 0x7f0d44101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:51.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.820+0000 7f0d4b000700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4406aa00 0x7f0d44101450 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:51.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.820+0000 7f0d4b000700 1 --2- 172.21.15.28:0/748135497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d4406b3c0 0x7f0d44101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:51.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.820+0000 7f0d4b000700 1 -- 172.21.15.28:0/748135497 >> 172.21.15.28:0/748135497 conn(0x7f0d44078300 msgr2=0x7f0d440ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:51.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.820+0000 7f0d4b000700 1 -- 172.21.15.28:0/748135497 shutdown_connections 2024-06-06T08:39:51.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:51.820+0000 7f0d4b000700 1 -- 172.21.15.28:0/748135497 wait complete. 2024-06-06T08:39:52.261 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:51 smithi028 ceph-mon[31564]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:52.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:52.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:52.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:52.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:39:52.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:52.262 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:51 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/748135497' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-06T08:39:52.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:51 smithi037 ceph-mon[36609]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:52.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:52.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:52.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:39:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:52.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:51 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/748135497' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-06T08:39:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:51 smithi059 ceph-mon[36684]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:39:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:39:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:39:52.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:51 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/748135497' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-06T08:39:52.729 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-06T08:39:52.730 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-06T08:39:53.227 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:39:54.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:53 smithi028 ceph-mon[31564]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:54.168 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:53 smithi059 ceph-mon[36684]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:54.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:53 smithi037 ceph-mon[36609]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:55.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.571+0000 7f6890000700 1 -- 172.21.15.28:0/3261255063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68881046b0 msgr2=0x7f6888104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:55.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.571+0000 7f6890000700 1 --2- 172.21.15.28:0/3261255063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68881046b0 0x7f6888104b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6874009990 tx=0x7f6874009ca0 comp rx=0 tx=0).stop 2024-06-06T08:39:55.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.571+0000 7f6890000700 1 -- 172.21.15.28:0/3261255063 shutdown_connections 2024-06-06T08:39:55.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.571+0000 7f6890000700 1 --2- 172.21.15.28:0/3261255063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6888105070 0x7f6888111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.571+0000 7f6890000700 1 --2- 172.21.15.28:0/3261255063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f688810a6b0 0x7f688810aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.571+0000 7f6890000700 1 --2- 172.21.15.28:0/3261255063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68881046b0 0x7f6888104b30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.571+0000 7f6890000700 1 -- 172.21.15.28:0/3261255063 >> 172.21.15.28:0/3261255063 conn(0x7f68881001a0 msgr2=0x7f68881025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.571+0000 7f6890000700 1 -- 172.21.15.28:0/3261255063 shutdown_connections 2024-06-06T08:39:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.571+0000 7f6890000700 1 -- 172.21.15.28:0/3261255063 wait complete. 2024-06-06T08:39:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.573+0000 7f6890000700 1 Processor -- start 2024-06-06T08:39:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.573+0000 7f6890000700 1 -- start start 2024-06-06T08:39:55.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.573+0000 7f6890000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68881046b0 0x7f68880769a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:55.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.573+0000 7f6890000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6888105070 0x7f6888076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:55.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.573+0000 7f6890000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f688810a6b0 0x7f6888077420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:55.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f6890000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6888114a90 con 0x7f6888105070 2024-06-06T08:39:55.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f6890000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6888114910 con 0x7f688810a6b0 2024-06-06T08:39:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f6890000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6888114c10 con 0x7f68881046b0 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f688cc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6888105070 0x7f6888076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f688e000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f688810a6b0 0x7f6888077420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f688d600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68881046b0 0x7f68880769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f688cc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6888105070 0x7f6888076ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46942/0 (socket says 172.21.15.28:46942) 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f688cc00700 1 -- 172.21.15.28:0/749603074 learned_addr learned my addr 172.21.15.28:0/749603074 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f688e000700 1 -- 172.21.15.28:0/749603074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68881046b0 msgr2=0x7f68880769a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f688e000700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68881046b0 0x7f68880769a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f688e000700 1 -- 172.21.15.28:0/749603074 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6888105070 msgr2=0x7f6888076ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f688e000700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6888105070 0x7f6888076ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f688e000700 1 -- 172.21.15.28:0/749603074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68881ab510 con 0x7f688810a6b0 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.574+0000 7f688d600700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68881046b0 0x7f68880769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.575+0000 7f688e000700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f688810a6b0 0x7f6888077420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6880009f60 tx=0x7f6880009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.575+0000 7f6886000700 1 -- 172.21.15.28:0/749603074 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68800092e0 con 0x7f688810a6b0 2024-06-06T08:39:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.575+0000 7f6890000700 1 -- 172.21.15.28:0/749603074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68881ab7a0 con 0x7f688810a6b0 2024-06-06T08:39:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.575+0000 7f6886000700 1 -- 172.21.15.28:0/749603074 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6880004bb0 con 0x7f688810a6b0 2024-06-06T08:39:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.575+0000 7f6886000700 1 -- 172.21.15.28:0/749603074 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880004280 con 0x7f688810a6b0 2024-06-06T08:39:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.575+0000 7f6890000700 1 -- 172.21.15.28:0/749603074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68881abce0 con 0x7f688810a6b0 2024-06-06T08:39:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.576+0000 7f6890000700 1 -- 172.21.15.28:0/749603074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6888105df0 con 0x7f688810a6b0 2024-06-06T08:39:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.578+0000 7f6886000700 1 -- 172.21.15.28:0/749603074 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6880044d10 con 0x7f688810a6b0 2024-06-06T08:39:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.580+0000 7f6886000700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f68700a2c20 0x7f68700a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:39:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.580+0000 7f6886000700 1 -- 172.21.15.28:0/749603074 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f68800ceb20 con 0x7f688810a6b0 2024-06-06T08:39:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.580+0000 7f688d600700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f68700a2c20 0x7f68700a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:39:55.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.581+0000 7f688d600700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f68700a2c20 0x7f68700a50e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f687c009fd0 tx=0x7f687c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:39:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.582+0000 7f6886000700 1 -- 172.21.15.28:0/749603074 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6880022020 con 0x7f688810a6b0 2024-06-06T08:39:55.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:55.813+0000 7f6890000700 1 -- 172.21.15.28:0/749603074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f688802dca0 con 0x7f688810a6b0 2024-06-06T08:39:56.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.432+0000 7f6886000700 1 -- 172.21.15.28:0/749603074 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f6880010040 con 0x7f688810a6b0 2024-06-06T08:39:56.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.437+0000 7f6890000700 1 -- 172.21.15.28:0/749603074 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f68700a2c20 msgr2=0x7f68700a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:56.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.438+0000 7f6890000700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f68700a2c20 0x7f68700a50e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f687c009fd0 tx=0x7f687c009260 comp rx=0 tx=0).stop 2024-06-06T08:39:56.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.438+0000 7f6890000700 1 -- 172.21.15.28:0/749603074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f688810a6b0 msgr2=0x7f6888077420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:39:56.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.438+0000 7f6890000700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f688810a6b0 0x7f6888077420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6880009f60 tx=0x7f6880009f90 comp rx=0 tx=0).stop 2024-06-06T08:39:56.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.438+0000 7f6890000700 1 -- 172.21.15.28:0/749603074 shutdown_connections 2024-06-06T08:39:56.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.438+0000 7f6890000700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f68700a2c20 0x7f68700a50e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:56.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.438+0000 7f6890000700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f688810a6b0 0x7f6888077420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:56.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.438+0000 7f6890000700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68881046b0 0x7f68880769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:56.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.438+0000 7f6890000700 1 --2- 172.21.15.28:0/749603074 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6888105070 0x7f6888076ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:39:56.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.438+0000 7f6890000700 1 -- 172.21.15.28:0/749603074 >> 172.21.15.28:0/749603074 conn(0x7f68881001a0 msgr2=0x7f68881006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:39:56.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.440+0000 7f6890000700 1 -- 172.21.15.28:0/749603074 shutdown_connections 2024-06-06T08:39:56.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:39:56.440+0000 7f6890000700 1 -- 172.21.15.28:0/749603074 wait complete. 2024-06-06T08:39:56.445 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2024-06-06T08:39:56.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:56 smithi028 ceph-mon[31564]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:56.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:56 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/749603074' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T08:39:56.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:56 smithi037 ceph-mon[36609]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:56.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:56 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/749603074' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T08:39:56.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:56 smithi059 ceph-mon[36684]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:56.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:56 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/749603074' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T08:39:57.428 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-06T08:39:57.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:57 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T08:39:57.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:57 smithi028 ceph-mon[31564]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:57.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:57 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-06T08:39:57.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:57 smithi028 ceph-mon[31564]: osdmap e82: 12 total, 12 up, 12 in 2024-06-06T08:39:57.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:57 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T08:39:57.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:57 smithi037 ceph-mon[36609]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:57.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:57 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-06T08:39:57.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:57 smithi037 ceph-mon[36609]: osdmap e82: 12 total, 12 up, 12 in 2024-06-06T08:39:57.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:57 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T08:39:57.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:57 smithi059 ceph-mon[36684]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:57.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:57 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-06T08:39:57.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:57 smithi059 ceph-mon[36684]: osdmap e82: 12 total, 12 up, 12 in 2024-06-06T08:39:57.886 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:39:58.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:58 smithi028 ceph-mon[31564]: osdmap e83: 12 total, 12 up, 12 in 2024-06-06T08:39:58.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:58 smithi037 ceph-mon[36609]: osdmap e83: 12 total, 12 up, 12 in 2024-06-06T08:39:58.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:58 smithi059 ceph-mon[36684]: osdmap e83: 12 total, 12 up, 12 in 2024-06-06T08:39:59.721 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:59 smithi028 ceph-mon[31564]: pgmap v322: 33 pgs: 10 active+clean, 6 creating+peering, 17 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:59.721 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:59 smithi028 ceph-mon[31564]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T08:39:59.721 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:39:59 smithi028 ceph-mon[31564]: osdmap e84: 12 total, 12 up, 12 in 2024-06-06T08:39:59.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:59 smithi037 ceph-mon[36609]: pgmap v322: 33 pgs: 10 active+clean, 6 creating+peering, 17 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:59.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:59 smithi037 ceph-mon[36609]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T08:39:59.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:39:59 smithi037 ceph-mon[36609]: osdmap e84: 12 total, 12 up, 12 in 2024-06-06T08:39:59.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:59 smithi059 ceph-mon[36684]: pgmap v322: 33 pgs: 10 active+clean, 6 creating+peering, 17 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:39:59.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:59 smithi059 ceph-mon[36684]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T08:39:59.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:39:59 smithi059 ceph-mon[36684]: osdmap e84: 12 total, 12 up, 12 in 2024-06-06T08:40:00.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.278+0000 7f0b73600700 1 -- 172.21.15.28:0/1278899016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6c105090 msgr2=0x7f0b6c1115a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:00.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.278+0000 7f0b73600700 1 --2- 172.21.15.28:0/1278899016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6c105090 0x7f0b6c1115a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400b0a0 tx=0x7f0b6400b3b0 comp rx=0 tx=0).stop 2024-06-06T08:40:00.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.279+0000 7f0b73600700 1 -- 172.21.15.28:0/1278899016 shutdown_connections 2024-06-06T08:40:00.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.279+0000 7f0b73600700 1 --2- 172.21.15.28:0/1278899016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6c105090 0x7f0b6c1115a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:00.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.279+0000 7f0b73600700 1 --2- 172.21.15.28:0/1278899016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c10a6d0 0x7f0b6c10aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:00.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.279+0000 7f0b73600700 1 --2- 172.21.15.28:0/1278899016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b6c1046d0 0x7f0b6c104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:00.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.279+0000 7f0b73600700 1 -- 172.21.15.28:0/1278899016 >> 172.21.15.28:0/1278899016 conn(0x7f0b6c1001c0 msgr2=0x7f0b6c1025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:00.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.279+0000 7f0b73600700 1 -- 172.21.15.28:0/1278899016 shutdown_connections 2024-06-06T08:40:00.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.279+0000 7f0b73600700 1 -- 172.21.15.28:0/1278899016 wait complete. 2024-06-06T08:40:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.280+0000 7f0b73600700 1 Processor -- start 2024-06-06T08:40:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.280+0000 7f0b73600700 1 -- start start 2024-06-06T08:40:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.280+0000 7f0b73600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c1046d0 0x7f0b6c19ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b73600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b6c105090 0x7f0b6c19b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b73600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6c10a6d0 0x7f0b6c19f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b73600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c114ab0 con 0x7f0b6c105090 2024-06-06T08:40:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b73600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c114930 con 0x7f0b6c10a6d0 2024-06-06T08:40:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b73600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c114c30 con 0x7f0b6c1046d0 2024-06-06T08:40:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b6be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b6c105090 0x7f0b6c19b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b6be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b6c105090 0x7f0b6c19b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:37540/0 (socket says 172.21.15.28:37540) 2024-06-06T08:40:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b6be00700 1 -- 172.21.15.28:0/990240028 learned_addr learned my addr 172.21.15.28:0/990240028 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b71600700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6c10a6d0 0x7f0b6c19f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b70c00700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c1046d0 0x7f0b6c19ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b6be00700 1 -- 172.21.15.28:0/990240028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c1046d0 msgr2=0x7f0b6c19ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b6be00700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c1046d0 0x7f0b6c19ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b6be00700 1 -- 172.21.15.28:0/990240028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6c10a6d0 msgr2=0x7f0b6c19f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b6be00700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6c10a6d0 0x7f0b6c19f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.281+0000 7f0b6be00700 1 -- 172.21.15.28:0/990240028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6c19fe20 con 0x7f0b6c105090 2024-06-06T08:40:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.282+0000 7f0b6be00700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b6c105090 0x7f0b6c19b3a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800e9a0 tx=0x7f0b5800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.282+0000 7f0b69600700 1 -- 172.21.15.28:0/990240028 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800ca10 con 0x7f0b6c105090 2024-06-06T08:40:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.282+0000 7f0b73600700 1 -- 172.21.15.28:0/990240028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6c1a0110 con 0x7f0b6c105090 2024-06-06T08:40:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.282+0000 7f0b69600700 1 -- 172.21.15.28:0/990240028 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b5800cbb0 con 0x7f0b6c105090 2024-06-06T08:40:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.282+0000 7f0b69600700 1 -- 172.21.15.28:0/990240028 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58018680 con 0x7f0b6c105090 2024-06-06T08:40:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.282+0000 7f0b73600700 1 -- 172.21.15.28:0/990240028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6c1a7990 con 0x7f0b6c105090 2024-06-06T08:40:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.283+0000 7f0b73600700 1 -- 172.21.15.28:0/990240028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6c10cc60 con 0x7f0b6c105090 2024-06-06T08:40:00.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.286+0000 7f0b69600700 1 -- 172.21.15.28:0/990240028 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0b58010430 con 0x7f0b6c105090 2024-06-06T08:40:00.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.288+0000 7f0b69600700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b540a2c20 0x7f0b540a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:00.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.288+0000 7f0b69600700 1 -- 172.21.15.28:0/990240028 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7497+0+0 (secure 0 0 0) 0x7f0b580cf480 con 0x7f0b6c105090 2024-06-06T08:40:00.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.288+0000 7f0b70c00700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b540a2c20 0x7f0b540a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:00.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.289+0000 7f0b70c00700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b540a2c20 0x7f0b540a50e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0b600045b0 tx=0x7f0b6000b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:00.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.291+0000 7f0b69600700 1 -- 172.21.15.28:0/990240028 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0b5809c670 con 0x7f0b6c105090 2024-06-06T08:40:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:00.527+0000 7f0b73600700 1 -- 172.21.15.28:0/990240028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0b6c19c170 con 0x7f0b6c105090 2024-06-06T08:40:00.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:00 smithi028 ceph-mon[31564]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-06-06T08:40:00.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:00 smithi028 ceph-mon[31564]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-06-06T08:40:00.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:00 smithi028 ceph-mon[31564]: application not enabled on pool 'cephfs_metadata' 2024-06-06T08:40:00.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:00 smithi028 ceph-mon[31564]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-06-06T08:40:00.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:00 smithi037 ceph-mon[36609]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-06-06T08:40:00.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:00 smithi037 ceph-mon[36609]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-06-06T08:40:00.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:00 smithi037 ceph-mon[36609]: application not enabled on pool 'cephfs_metadata' 2024-06-06T08:40:00.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:00 smithi037 ceph-mon[36609]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-06-06T08:40:00.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:00 smithi059 ceph-mon[36684]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-06-06T08:40:00.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:00 smithi059 ceph-mon[36684]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-06-06T08:40:00.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:00 smithi059 ceph-mon[36684]: application not enabled on pool 'cephfs_metadata' 2024-06-06T08:40:00.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:00 smithi059 ceph-mon[36684]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-06-06T08:40:01.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.468+0000 7f0b69600700 1 -- 172.21.15.28:0/990240028 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) ==== 170+0+0 (secure 0 0 0) 0x7f0b5809bf70 con 0x7f0b6c105090 2024-06-06T08:40:01.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.473+0000 7f0b73600700 1 -- 172.21.15.28:0/990240028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b540a2c20 msgr2=0x7f0b540a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:01.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.473+0000 7f0b73600700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b540a2c20 0x7f0b540a50e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0b600045b0 tx=0x7f0b6000b3c0 comp rx=0 tx=0).stop 2024-06-06T08:40:01.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.473+0000 7f0b73600700 1 -- 172.21.15.28:0/990240028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b6c105090 msgr2=0x7f0b6c19b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:01.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.473+0000 7f0b73600700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b6c105090 0x7f0b6c19b3a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800e9a0 tx=0x7f0b5800ecb0 comp rx=0 tx=0).stop 2024-06-06T08:40:01.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.475+0000 7f0b73600700 1 -- 172.21.15.28:0/990240028 shutdown_connections 2024-06-06T08:40:01.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.475+0000 7f0b73600700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b540a2c20 0x7f0b540a50e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:01.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.475+0000 7f0b73600700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b6c10a6d0 0x7f0b6c19f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:01.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.475+0000 7f0b73600700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c1046d0 0x7f0b6c19ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:01.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.475+0000 7f0b73600700 1 --2- 172.21.15.28:0/990240028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b6c105090 0x7f0b6c19b3a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:01.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.475+0000 7f0b73600700 1 -- 172.21.15.28:0/990240028 >> 172.21.15.28:0/990240028 conn(0x7f0b6c1001c0 msgr2=0x7f0b6c1006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:01.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.475+0000 7f0b73600700 1 -- 172.21.15.28:0/990240028 shutdown_connections 2024-06-06T08:40:01.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:01.477+0000 7f0b73600700 1 -- 172.21.15.28:0/990240028 wait complete. 2024-06-06T08:40:01.481 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2024-06-06T08:40:01.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:01 smithi028 ceph-mon[31564]: pgmap v324: 33 pgs: 18 active+clean, 6 creating+peering, 9 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:40:01.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:01 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/990240028' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T08:40:01.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:01 smithi037 ceph-mon[36609]: pgmap v324: 33 pgs: 18 active+clean, 6 creating+peering, 9 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:40:01.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:01 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/990240028' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T08:40:01.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:01 smithi059 ceph-mon[36684]: pgmap v324: 33 pgs: 18 active+clean, 6 creating+peering, 9 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:40:01.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:01 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/990240028' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T08:40:02.478 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-06T08:40:02.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:02 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/990240028' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-06T08:40:02.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:02 smithi028 ceph-mon[31564]: osdmap e85: 12 total, 12 up, 12 in 2024-06-06T08:40:02.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:02 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/990240028' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-06T08:40:02.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:02 smithi037 ceph-mon[36609]: osdmap e85: 12 total, 12 up, 12 in 2024-06-06T08:40:02.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:02 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/990240028' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-06T08:40:02.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:02 smithi059 ceph-mon[36684]: osdmap e85: 12 total, 12 up, 12 in 2024-06-06T08:40:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:03.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:03 smithi028 ceph-mon[31564]: pgmap v326: 97 pgs: 26 creating+peering, 38 unknown, 33 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:40:03.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:03 smithi028 ceph-mon[31564]: osdmap e86: 12 total, 12 up, 12 in 2024-06-06T08:40:03.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:03 smithi037 ceph-mon[36609]: pgmap v326: 97 pgs: 26 creating+peering, 38 unknown, 33 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:40:03.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:03 smithi037 ceph-mon[36609]: osdmap e86: 12 total, 12 up, 12 in 2024-06-06T08:40:03.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:03 smithi059 ceph-mon[36684]: pgmap v326: 97 pgs: 26 creating+peering, 38 unknown, 33 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:40:03.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:03 smithi059 ceph-mon[36684]: osdmap e86: 12 total, 12 up, 12 in 2024-06-06T08:40:04.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:04 smithi028 ceph-mon[31564]: osdmap e87: 12 total, 12 up, 12 in 2024-06-06T08:40:04.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:04 smithi037 ceph-mon[36609]: osdmap e87: 12 total, 12 up, 12 in 2024-06-06T08:40:04.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:04 smithi059 ceph-mon[36684]: osdmap e87: 12 total, 12 up, 12 in 2024-06-06T08:40:05.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.118+0000 7f7b62c00700 1 -- 172.21.15.28:0/635335093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c105070 msgr2=0x7f7b5c111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:05.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.118+0000 7f7b62c00700 1 --2- 172.21.15.28:0/635335093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c105070 0x7f7b5c111580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009990 tx=0x7f7b54009ca0 comp rx=0 tx=0).stop 2024-06-06T08:40:05.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.118+0000 7f7b62c00700 1 -- 172.21.15.28:0/635335093 shutdown_connections 2024-06-06T08:40:05.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.118+0000 7f7b62c00700 1 --2- 172.21.15.28:0/635335093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c105070 0x7f7b5c111580 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:05.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.118+0000 7f7b62c00700 1 --2- 172.21.15.28:0/635335093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b5c10a6b0 0x7f7b5c10aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:05.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.118+0000 7f7b62c00700 1 --2- 172.21.15.28:0/635335093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b5c1046b0 0x7f7b5c104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:05.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.118+0000 7f7b62c00700 1 -- 172.21.15.28:0/635335093 >> 172.21.15.28:0/635335093 conn(0x7f7b5c1001a0 msgr2=0x7f7b5c1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:05.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.118+0000 7f7b62c00700 1 -- 172.21.15.28:0/635335093 shutdown_connections 2024-06-06T08:40:05.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.118+0000 7f7b62c00700 1 -- 172.21.15.28:0/635335093 wait complete. 2024-06-06T08:40:05.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.120+0000 7f7b62c00700 1 Processor -- start 2024-06-06T08:40:05.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.120+0000 7f7b62c00700 1 -- start start 2024-06-06T08:40:05.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.120+0000 7f7b62c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b5c1046b0 0x7f7b5c19adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:05.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.120+0000 7f7b62c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b5c105070 0x7f7b5c19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:05.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.120+0000 7f7b62c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c10a6b0 0x7f7b5c19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:05.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.120+0000 7f7b62c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c114a40 con 0x7f7b5c105070 2024-06-06T08:40:05.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.120+0000 7f7b62c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c1148c0 con 0x7f7b5c10a6b0 2024-06-06T08:40:05.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.120+0000 7f7b62c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c114bc0 con 0x7f7b5c1046b0 2024-06-06T08:40:05.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.120+0000 7f7b5b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b5c105070 0x7f7b5c19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:05.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.121+0000 7f7b5b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b5c105070 0x7f7b5c19b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:37566/0 (socket says 172.21.15.28:37566) 2024-06-06T08:40:05.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.121+0000 7f7b5b400700 1 -- 172.21.15.28:0/824216437 learned_addr learned my addr 172.21.15.28:0/824216437 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:05.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.121+0000 7f7b5be00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b5c1046b0 0x7f7b5c19adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:05.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.121+0000 7f7b60c00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c10a6b0 0x7f7b5c19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:05.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.121+0000 7f7b5b400700 1 -- 172.21.15.28:0/824216437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b5c1046b0 msgr2=0x7f7b5c19adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:05.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.121+0000 7f7b5b400700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b5c1046b0 0x7f7b5c19adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:05.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.121+0000 7f7b5b400700 1 -- 172.21.15.28:0/824216437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c10a6b0 msgr2=0x7f7b5c19f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:05.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.121+0000 7f7b5b400700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c10a6b0 0x7f7b5c19f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:05.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.121+0000 7f7b5b400700 1 -- 172.21.15.28:0/824216437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c19fe00 con 0x7f7b5c105070 2024-06-06T08:40:05.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.121+0000 7f7b5be00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b5c1046b0 0x7f7b5c19adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:40:05.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.121+0000 7f7b60c00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c10a6b0 0x7f7b5c19f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:40:05.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.122+0000 7f7b5b400700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b5c105070 0x7f7b5c19b330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800d950 tx=0x7f7b4800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:05.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.122+0000 7f7b58c00700 1 -- 172.21.15.28:0/824216437 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48016070 con 0x7f7b5c105070 2024-06-06T08:40:05.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.122+0000 7f7b58c00700 1 -- 172.21.15.28:0/824216437 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b4800fd70 con 0x7f7b5c105070 2024-06-06T08:40:05.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.122+0000 7f7b62c00700 1 -- 172.21.15.28:0/824216437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5c1a00f0 con 0x7f7b5c105070 2024-06-06T08:40:05.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.122+0000 7f7b58c00700 1 -- 172.21.15.28:0/824216437 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800e610 con 0x7f7b5c105070 2024-06-06T08:40:05.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.122+0000 7f7b62c00700 1 -- 172.21.15.28:0/824216437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b5c1a7970 con 0x7f7b5c105070 2024-06-06T08:40:05.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.123+0000 7f7b62c00700 1 -- 172.21.15.28:0/824216437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b5c069180 con 0x7f7b5c105070 2024-06-06T08:40:05.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.127+0000 7f7b58c00700 1 -- 172.21.15.28:0/824216437 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7b48019070 con 0x7f7b5c105070 2024-06-06T08:40:05.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.128+0000 7f7b58c00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7b400a2c20 0x7f7b400a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:05.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.129+0000 7f7b58c00700 1 -- 172.21.15.28:0/824216437 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 7879+0+0 (secure 0 0 0) 0x7f7b480ce9c0 con 0x7f7b5c105070 2024-06-06T08:40:05.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.129+0000 7f7b5be00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7b400a2c20 0x7f7b400a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:05.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.129+0000 7f7b5be00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7b400a2c20 0x7f7b400a50e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009480 tx=0x7f7b4c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:05.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.132+0000 7f7b58c00700 1 -- 172.21.15.28:0/824216437 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7b4809ba30 con 0x7f7b5c105070 2024-06-06T08:40:05.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.414+0000 7f7b62c00700 1 -- 172.21.15.28:0/824216437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7b5c1a7be0 con 0x7f7b5c105070 2024-06-06T08:40:05.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.508+0000 7f7b58c00700 1 -- 172.21.15.28:0/824216437 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f7b4809b330 con 0x7f7b5c105070 2024-06-06T08:40:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.513+0000 7f7b62c00700 1 -- 172.21.15.28:0/824216437 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7b400a2c20 msgr2=0x7f7b400a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.513+0000 7f7b62c00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7b400a2c20 0x7f7b400a50e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009480 tx=0x7f7b4c00b040 comp rx=0 tx=0).stop 2024-06-06T08:40:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.513+0000 7f7b62c00700 1 -- 172.21.15.28:0/824216437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b5c105070 msgr2=0x7f7b5c19b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.513+0000 7f7b62c00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b5c105070 0x7f7b5c19b330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800d950 tx=0x7f7b4800dc60 comp rx=0 tx=0).stop 2024-06-06T08:40:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.513+0000 7f7b62c00700 1 -- 172.21.15.28:0/824216437 shutdown_connections 2024-06-06T08:40:05.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.513+0000 7f7b62c00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7b400a2c20 0x7f7b400a50e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:05.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.513+0000 7f7b62c00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c10a6b0 0x7f7b5c19f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:05.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.513+0000 7f7b62c00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b5c1046b0 0x7f7b5c19adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:05.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.513+0000 7f7b62c00700 1 --2- 172.21.15.28:0/824216437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7b5c105070 0x7f7b5c19b330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:05.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.513+0000 7f7b62c00700 1 -- 172.21.15.28:0/824216437 >> 172.21.15.28:0/824216437 conn(0x7f7b5c1001a0 msgr2=0x7f7b5c100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:05.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.514+0000 7f7b62c00700 1 -- 172.21.15.28:0/824216437 shutdown_connections 2024-06-06T08:40:05.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:05.514+0000 7f7b62c00700 1 -- 172.21.15.28:0/824216437 wait complete. 2024-06-06T08:40:05.518 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 2 and data pool 3 2024-06-06T08:40:05.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:05 smithi028 ceph-mon[31564]: pgmap v329: 97 pgs: 26 creating+peering, 16 unknown, 55 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:40:05.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:05 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/824216437' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-06T08:40:05.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:05 smithi028 ceph-mon[31564]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-06T08:40:05.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:05 smithi037 ceph-mon[36609]: pgmap v329: 97 pgs: 26 creating+peering, 16 unknown, 55 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:40:05.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:05 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/824216437' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-06T08:40:05.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:05 smithi037 ceph-mon[36609]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-06T08:40:05.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:05 smithi059 ceph-mon[36684]: pgmap v329: 97 pgs: 26 creating+peering, 16 unknown, 55 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:40:05.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:05 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/824216437' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-06T08:40:05.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:05 smithi059 ceph-mon[36684]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-06T08:40:06.385 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T08:40:06.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:06 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/824216437' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-06T08:40:06.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:06 smithi028 ceph-mon[31564]: osdmap e88: 12 total, 12 up, 12 in 2024-06-06T08:40:06.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:06 smithi028 ceph-mon[31564]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-06T08:40:06.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:06 smithi028 ceph-mon[31564]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-06T08:40:06.813 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:40:06 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b[67261]: 2024-06-06T08:40:06.762+0000 7f60be832700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-06T08:40:06.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:06 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/824216437' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-06T08:40:06.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:06 smithi037 ceph-mon[36609]: osdmap e88: 12 total, 12 up, 12 in 2024-06-06T08:40:06.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:06 smithi037 ceph-mon[36609]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-06T08:40:06.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:06 smithi037 ceph-mon[36609]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-06T08:40:06.844 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:06.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:06 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/824216437' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-06T08:40:06.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:06 smithi059 ceph-mon[36684]: osdmap e88: 12 total, 12 up, 12 in 2024-06-06T08:40:06.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:06 smithi059 ceph-mon[36684]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-06T08:40:06.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:06 smithi059 ceph-mon[36684]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-06T08:40:07.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:07 smithi028 ceph-mon[31564]: pgmap v331: 97 pgs: 26 creating+peering, 71 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-06-06T08:40:07.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:07 smithi028 ceph-mon[31564]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-06T08:40:07.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:07 smithi028 ceph-mon[31564]: Cluster is now healthy 2024-06-06T08:40:07.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:07 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] up:active 2024-06-06T08:40:07.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:07 smithi028 ceph-mon[31564]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:07.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:07 smithi028 ceph-mon[31564]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:07.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:07 smithi037 ceph-mon[36609]: pgmap v331: 97 pgs: 26 creating+peering, 71 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-06-06T08:40:07.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:07 smithi037 ceph-mon[36609]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-06T08:40:07.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:07 smithi037 ceph-mon[36609]: Cluster is now healthy 2024-06-06T08:40:07.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:07 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] up:active 2024-06-06T08:40:07.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:07 smithi037 ceph-mon[36609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:07.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:07 smithi037 ceph-mon[36609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:07.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:07 smithi059 ceph-mon[36684]: pgmap v331: 97 pgs: 26 creating+peering, 71 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-06-06T08:40:07.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:07 smithi059 ceph-mon[36684]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-06T08:40:07.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:07 smithi059 ceph-mon[36684]: Cluster is now healthy 2024-06-06T08:40:07.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:07 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] up:active 2024-06-06T08:40:07.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:07 smithi059 ceph-mon[36684]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:07.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:07 smithi059 ceph-mon[36684]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:09.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.088+0000 7f57f8200700 1 -- 172.21.15.28:0/1609027578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57f0105070 msgr2=0x7f57f0111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:09.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.088+0000 7f57f8200700 1 --2- 172.21.15.28:0/1609027578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57f0105070 0x7f57f0111580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f57e800b0a0 tx=0x7f57e800b3b0 comp rx=0 tx=0).stop 2024-06-06T08:40:09.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.088+0000 7f57f8200700 1 -- 172.21.15.28:0/1609027578 shutdown_connections 2024-06-06T08:40:09.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.088+0000 7f57f8200700 1 --2- 172.21.15.28:0/1609027578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57f0105070 0x7f57f0111580 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:09.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.088+0000 7f57f8200700 1 --2- 172.21.15.28:0/1609027578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f010a6b0 0x7f57f010aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:09.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.088+0000 7f57f8200700 1 --2- 172.21.15.28:0/1609027578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f01046b0 0x7f57f0104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:09.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.088+0000 7f57f8200700 1 -- 172.21.15.28:0/1609027578 >> 172.21.15.28:0/1609027578 conn(0x7f57f01001a0 msgr2=0x7f57f01025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:09.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.089+0000 7f57f8200700 1 -- 172.21.15.28:0/1609027578 shutdown_connections 2024-06-06T08:40:09.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.089+0000 7f57f8200700 1 -- 172.21.15.28:0/1609027578 wait complete. 2024-06-06T08:40:09.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.090+0000 7f57f8200700 1 Processor -- start 2024-06-06T08:40:09.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.090+0000 7f57f8200700 1 -- start start 2024-06-06T08:40:09.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f8200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f01046b0 0x7f57f019ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:09.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f8200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57f0105070 0x7f57f019b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:09.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f8200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f010a6b0 0x7f57f019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:09.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f8200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0114a90 con 0x7f57f0105070 2024-06-06T08:40:09.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f8200700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0114910 con 0x7f57f01046b0 2024-06-06T08:40:09.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f8200700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0114c10 con 0x7f57f010a6b0 2024-06-06T08:40:09.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f4e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57f0105070 0x7f57f019b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:09.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f5800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f01046b0 0x7f57f019ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:09.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f5800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f01046b0 0x7f57f019ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:47126/0 (socket says 172.21.15.28:47126) 2024-06-06T08:40:09.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f5800700 1 -- 172.21.15.28:0/2493881619 learned_addr learned my addr 172.21.15.28:0/2493881619 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:09.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f6200700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f010a6b0 0x7f57f019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:09.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.091+0000 7f57f5800700 1 -- 172.21.15.28:0/2493881619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f010a6b0 msgr2=0x7f57f019f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:09.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.092+0000 7f57f5800700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f010a6b0 0x7f57f019f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:09.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.092+0000 7f57f5800700 1 -- 172.21.15.28:0/2493881619 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57f0105070 msgr2=0x7f57f019b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:09.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.092+0000 7f57f5800700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57f0105070 0x7f57f019b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:09.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.092+0000 7f57f5800700 1 -- 172.21.15.28:0/2493881619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f019fe10 con 0x7f57f01046b0 2024-06-06T08:40:09.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.092+0000 7f57f6200700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f010a6b0 0x7f57f019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:40:09.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.092+0000 7f57f5800700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f01046b0 0x7f57f019ae00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f57e400e9a0 tx=0x7f57e400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:09.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.092+0000 7f57ee000700 1 -- 172.21.15.28:0/2493881619 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e400ca10 con 0x7f57f01046b0 2024-06-06T08:40:09.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.092+0000 7f57ee000700 1 -- 172.21.15.28:0/2493881619 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57e400cbb0 con 0x7f57f01046b0 2024-06-06T08:40:09.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.092+0000 7f57f8200700 1 -- 172.21.15.28:0/2493881619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f01a0100 con 0x7f57f01046b0 2024-06-06T08:40:09.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.092+0000 7f57ee000700 1 -- 172.21.15.28:0/2493881619 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4018680 con 0x7f57f01046b0 2024-06-06T08:40:09.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.092+0000 7f57f8200700 1 -- 172.21.15.28:0/2493881619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f01a7980 con 0x7f57f01046b0 2024-06-06T08:40:09.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.093+0000 7f57f8200700 1 -- 172.21.15.28:0/2493881619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f0069180 con 0x7f57f01046b0 2024-06-06T08:40:09.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.096+0000 7f57ee000700 1 -- 172.21.15.28:0/2493881619 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f57e4010430 con 0x7f57f01046b0 2024-06-06T08:40:09.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.097+0000 7f57ee000700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f57d80a2c20 0x7f57d80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:09.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.097+0000 7f57ee000700 1 -- 172.21.15.28:0/2493881619 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f57e40cf140 con 0x7f57f01046b0 2024-06-06T08:40:09.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.097+0000 7f57f4e00700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f57d80a2c20 0x7f57d80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:09.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.098+0000 7f57f4e00700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f57d80a2c20 0x7f57d80a50e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f57f01026d0 tx=0x7f57dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:09.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.101+0000 7f57ee000700 1 -- 172.21.15.28:0/2493881619 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f57e409c150 con 0x7f57f01046b0 2024-06-06T08:40:09.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.334+0000 7f57f8200700 1 -- 172.21.15.28:0/2493881619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57f01a7b50 con 0x7f57f01046b0 2024-06-06T08:40:09.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.336+0000 7f57ee000700 1 -- 172.21.15.28:0/2493881619 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22087 (secure 0 0 0) 0x7f57e409ba50 con 0x7f57f01046b0 2024-06-06T08:40:09.335 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:40:09.336 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":88,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","created":"2024-06-06T08:30:30.991501+0000","modified":"2024-06-06T08:40:05.416064+0000","last_up_change":"2024-06-06T08:38:45.850887+0000","last_in_change":"2024-06-06T08:38:26.532528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T08:34:26.800168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T08:39:56.375661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T08:40:01.096994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7edaffea-7613-4d20-b9b8-108a17af8f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6803","nonce":2001709636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6805","nonce":2001709636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6809","nonce":2001709636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6807","nonce":2001709636}]},"public_addr":"172.21.15.28:6803/2001709636","cluster_addr":"172.21.15.28:6805/2001709636","heartbeat_back_addr":"172.21.15.28:6809/2001709636","heartbeat_front_addr":"172.21.15.28:6807/2001709636","state":["exists","up"]},{"osd":1,"uuid":"17eb7536-c2a4-4f8b-bec4-b1abb5125836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6801","nonce":593429648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6803","nonce":593429648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6807","nonce":593429648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6805","nonce":593429648}]},"public_addr":"172.21.15.37:6801/593429648","cluster_addr":"172.21.15.37:6803/593429648","heartbeat_back_addr":"172.21.15.37:6807/593429648","heartbeat_front_addr":"172.21.15.37:6805/593429648","state":["exists","up"]},{"osd":2,"uuid":"3ea64fd8-13f4-4d53-933b-07055ec72701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6801","nonce":88678886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6803","nonce":88678886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6807","nonce":88678886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6805","nonce":88678886}]},"public_addr":"172.21.15.59:6801/88678886","cluster_addr":"172.21.15.59:6803/88678886","heartbeat_back_addr":"172.21.15.59:6807/88678886","heartbeat_front_addr":"172.21.15.59:6805/88678886","state":["exists","up"]},{"osd":3,"uuid":"8be9cdb5-12a9-438e-b8cd-ce65988b0ac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6811","nonce":484290430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6813","nonce":484290430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6817","nonce":484290430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6815","nonce":484290430}]},"public_addr":"172.21.15.28:6811/484290430","cluster_addr":"172.21.15.28:6813/484290430","heartbeat_back_addr":"172.21.15.28:6817/484290430","heartbeat_front_addr":"172.21.15.28:6815/484290430","state":["exists","up"]},{"osd":4,"uuid":"ddea397d-d7b1-46f3-9a13-dd318cade055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6809","nonce":3596500266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6811","nonce":3596500266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6815","nonce":3596500266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6813","nonce":3596500266}]},"public_addr":"172.21.15.37:6809/3596500266","cluster_addr":"172.21.15.37:6811/3596500266","heartbeat_back_addr":"172.21.15.37:6815/3596500266","heartbeat_front_addr":"172.21.15.37:6813/3596500266","state":["exists","up"]},{"osd":5,"uuid":"ee19857b-b047-4d15-8b17-257b6e4966a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6809","nonce":3037648282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6811","nonce":3037648282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6815","nonce":3037648282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6813","nonce":3037648282}]},"public_addr":"172.21.15.59:6809/3037648282","cluster_addr":"172.21.15.59:6811/3037648282","heartbeat_back_addr":"172.21.15.59:6815/3037648282","heartbeat_front_addr":"172.21.15.59:6813/3037648282","state":["exists","up"]},{"osd":6,"uuid":"1d57d0ba-8e37-4ac2-87e8-40b20b24fc53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6819","nonce":3794924886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6821","nonce":3794924886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6825","nonce":3794924886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6823","nonce":3794924886}]},"public_addr":"172.21.15.28:6819/3794924886","cluster_addr":"172.21.15.28:6821/3794924886","heartbeat_back_addr":"172.21.15.28:6825/3794924886","heartbeat_front_addr":"172.21.15.28:6823/3794924886","state":["exists","up"]},{"osd":7,"uuid":"43f3c2c8-752d-4a70-99dd-2c14aeefa137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6817","nonce":724042860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6819","nonce":724042860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6823","nonce":724042860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6821","nonce":724042860}]},"public_addr":"172.21.15.37:6817/724042860","cluster_addr":"172.21.15.37:6819/724042860","heartbeat_back_addr":"172.21.15.37:6823/724042860","heartbeat_front_addr":"172.21.15.37:6821/724042860","state":["exists","up"]},{"osd":8,"uuid":"3ffc07d7-ca79-419d-88a4-2b53d07ffae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6817","nonce":1240363223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6819","nonce":1240363223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6823","nonce":1240363223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6821","nonce":1240363223}]},"public_addr":"172.21.15.59:6817/1240363223","cluster_addr":"172.21.15.59:6819/1240363223","heartbeat_back_addr":"172.21.15.59:6823/1240363223","heartbeat_front_addr":"172.21.15.59:6821/1240363223","state":["exists","up"]},{"osd":9,"uuid":"4e014fc7-1ca3-4d6c-acdd-95ca59541310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6827","nonce":2555848355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6829","nonce":2555848355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6833","nonce":2555848355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6831","nonce":2555848355}]},"public_addr":"172.21.15.28:6827/2555848355","cluster_addr":"172.21.15.28:6829/2555848355","heartbeat_back_addr":"172.21.15.28:6833/2555848355","heartbeat_front_addr":"172.21.15.28:6831/2555848355","state":["exists","up"]},{"osd":10,"uuid":"fc418661-5e89-4241-b14b-241a2be432f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6825","nonce":176857372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6827","nonce":176857372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6831","nonce":176857372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6829","nonce":176857372}]},"public_addr":"172.21.15.37:6825/176857372","cluster_addr":"172.21.15.37:6827/176857372","heartbeat_back_addr":"172.21.15.37:6831/176857372","heartbeat_front_addr":"172.21.15.37:6829/176857372","state":["exists","up"]},{"osd":11,"uuid":"e54d81ee-1461-4229-a1c0-c6e750dd66ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6825","nonce":2675673798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6827","nonce":2675673798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6831","nonce":2675673798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6829","nonce":2675673798}]},"public_addr":"172.21.15.59:6825/2675673798","cluster_addr":"172.21.15.59:6827/2675673798","heartbeat_back_addr":"172.21.15.59:6831/2675673798","heartbeat_front_addr":"172.21.15.59:6829/2675673798","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:33.904270+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:58.988528+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:22.997033+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:57.171455+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:23.594371+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:48.928423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:22.957203+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:50.599655+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:16.166981+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:50.755673+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:18.677280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:44.432598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/4230567915":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/2860387445":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/886961600":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/3217551014":"2024-06-07T08:31:40.064884+0000","172.21.15.28:0/1629731223":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/219831273":"2024-06-07T08:31:04.770627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T08:40:09.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.339+0000 7f57f8200700 1 -- 172.21.15.28:0/2493881619 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f57d80a2c20 msgr2=0x7f57d80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:09.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.339+0000 7f57f8200700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f57d80a2c20 0x7f57d80a50e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f57f01026d0 tx=0x7f57dc009260 comp rx=0 tx=0).stop 2024-06-06T08:40:09.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.339+0000 7f57f8200700 1 -- 172.21.15.28:0/2493881619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f01046b0 msgr2=0x7f57f019ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:09.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.339+0000 7f57f8200700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f01046b0 0x7f57f019ae00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f57e400e9a0 tx=0x7f57e400ecb0 comp rx=0 tx=0).stop 2024-06-06T08:40:09.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.339+0000 7f57f8200700 1 -- 172.21.15.28:0/2493881619 shutdown_connections 2024-06-06T08:40:09.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.339+0000 7f57f8200700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f57d80a2c20 0x7f57d80a50e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:09.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.339+0000 7f57f8200700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f010a6b0 0x7f57f019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:09.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.339+0000 7f57f8200700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f01046b0 0x7f57f019ae00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:09.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.339+0000 7f57f8200700 1 --2- 172.21.15.28:0/2493881619 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57f0105070 0x7f57f019b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:09.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.340+0000 7f57f8200700 1 -- 172.21.15.28:0/2493881619 >> 172.21.15.28:0/2493881619 conn(0x7f57f01001a0 msgr2=0x7f57f0100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:09.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.340+0000 7f57f8200700 1 -- 172.21.15.28:0/2493881619 shutdown_connections 2024-06-06T08:40:09.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:09.340+0000 7f57f8200700 1 -- 172.21.15.28:0/2493881619 wait complete. 2024-06-06T08:40:09.730 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:09 smithi028 ceph-mon[31564]: pgmap v332: 97 pgs: 97 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-06T08:40:09.731 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:09 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2493881619' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:40:09.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:09 smithi037 ceph-mon[36609]: pgmap v332: 97 pgs: 97 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-06T08:40:09.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:09 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2493881619' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:40:09.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:09 smithi059 ceph-mon[36684]: pgmap v332: 97 pgs: 97 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-06T08:40:09.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:09 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2493881619' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:40:10.156 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T08:40:10.640 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:11.795 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:11 smithi028 ceph-mon[31564]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-06-06T08:40:11.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:11 smithi037 ceph-mon[36609]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-06-06T08:40:11.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:11 smithi059 ceph-mon[36684]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-06-06T08:40:12.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.953+0000 7f896d600700 1 -- 172.21.15.28:0/418796317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8968108520 msgr2=0x7f8968108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:12.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.953+0000 7f896d600700 1 --2- 172.21.15.28:0/418796317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8968108520 0x7f8968108900 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8958009990 tx=0x7f8958009ca0 comp rx=0 tx=0).stop 2024-06-06T08:40:12.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.953+0000 7f896d600700 1 -- 172.21.15.28:0/418796317 shutdown_connections 2024-06-06T08:40:12.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.953+0000 7f896d600700 1 --2- 172.21.15.28:0/418796317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f896806b520 0x7f896810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:12.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.953+0000 7f896d600700 1 --2- 172.21.15.28:0/418796317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8968108520 0x7f8968108900 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:12.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.953+0000 7f896d600700 1 --2- 172.21.15.28:0/418796317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f896806ab60 0x7f896806afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:12.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.953+0000 7f896d600700 1 -- 172.21.15.28:0/418796317 >> 172.21.15.28:0/418796317 conn(0x7f8968078340 msgr2=0x7f8968078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:12.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.953+0000 7f896d600700 1 -- 172.21.15.28:0/418796317 shutdown_connections 2024-06-06T08:40:12.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.953+0000 7f896d600700 1 -- 172.21.15.28:0/418796317 wait complete. 2024-06-06T08:40:12.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.954+0000 7f896d600700 1 Processor -- start 2024-06-06T08:40:12.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.954+0000 7f896d600700 1 -- start start 2024-06-06T08:40:12.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.954+0000 7f896d600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f896806ab60 0x7f896819ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:12.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.954+0000 7f896d600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f896806b520 0x7f896819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:12.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f896d600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8968108520 0x7f896819f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f896d600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f89681127d0 con 0x7f8968108520 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f896d600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8968112650 con 0x7f896806ab60 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f896d600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8968112950 con 0x7f896806b520 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f8967400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8968108520 0x7f896819f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f8966a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f896806ab60 0x7f896819ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f8966a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f896806ab60 0x7f896819ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:47138/0 (socket says 172.21.15.28:47138) 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f8967400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8968108520 0x7f896819f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33280/0 (socket says 172.21.15.28:33280) 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f8966a00700 1 -- 172.21.15.28:0/468170950 learned_addr learned my addr 172.21.15.28:0/468170950 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f895e000700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f896806b520 0x7f896819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f8966a00700 1 -- 172.21.15.28:0/468170950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f896806b520 msgr2=0x7f896819b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f8966a00700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f896806b520 0x7f896819b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f8966a00700 1 -- 172.21.15.28:0/468170950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8968108520 msgr2=0x7f896819f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f8966a00700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8968108520 0x7f896819f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:12.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f8966a00700 1 -- 172.21.15.28:0/468170950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896819fe70 con 0x7f896806ab60 2024-06-06T08:40:12.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.955+0000 7f8967400700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8968108520 0x7f896819f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:40:12.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.956+0000 7f8966a00700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f896806ab60 0x7f896819ae60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8958000c00 tx=0x7f895800bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:12.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.956+0000 7f895fe00700 1 -- 172.21.15.28:0/468170950 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958027070 con 0x7f896806ab60 2024-06-06T08:40:12.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.956+0000 7f895fe00700 1 -- 172.21.15.28:0/468170950 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8958003d70 con 0x7f896806ab60 2024-06-06T08:40:12.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.956+0000 7f895fe00700 1 -- 172.21.15.28:0/468170950 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895800f460 con 0x7f896806ab60 2024-06-06T08:40:12.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.956+0000 7f896d600700 1 -- 172.21.15.28:0/468170950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89681a0100 con 0x7f896806ab60 2024-06-06T08:40:12.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.956+0000 7f896d600700 1 -- 172.21.15.28:0/468170950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89681a79e0 con 0x7f896806ab60 2024-06-06T08:40:12.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.958+0000 7f896d600700 1 -- 172.21.15.28:0/468170950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8968103be0 con 0x7f896806ab60 2024-06-06T08:40:12.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.959+0000 7f895fe00700 1 -- 172.21.15.28:0/468170950 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f895802a070 con 0x7f896806ab60 2024-06-06T08:40:12.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.961+0000 7f895fe00700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f89480a2ca0 0x7f89480a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:12.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.961+0000 7f895fe00700 1 -- 172.21.15.28:0/468170950 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f89580cfd60 con 0x7f896806ab60 2024-06-06T08:40:12.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.961+0000 7f895e000700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f89480a2ca0 0x7f89480a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:12.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.962+0000 7f895e000700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f89480a2ca0 0x7f89480a5160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f89681037c0 tx=0x7f8950009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:12.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:12.965+0000 7f895fe00700 1 -- 172.21.15.28:0/468170950 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f895805e850 con 0x7f896806ab60 2024-06-06T08:40:13.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.196+0000 7f896d600700 1 -- 172.21.15.28:0/468170950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f896819c1c0 con 0x7f896806ab60 2024-06-06T08:40:13.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.199+0000 7f895fe00700 1 -- 172.21.15.28:0/468170950 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22087 (secure 0 0 0) 0x7f8958013070 con 0x7f896806ab60 2024-06-06T08:40:13.199 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:40:13.199 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":88,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","created":"2024-06-06T08:30:30.991501+0000","modified":"2024-06-06T08:40:05.416064+0000","last_up_change":"2024-06-06T08:38:45.850887+0000","last_in_change":"2024-06-06T08:38:26.532528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T08:34:26.800168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T08:39:56.375661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T08:40:01.096994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7edaffea-7613-4d20-b9b8-108a17af8f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6803","nonce":2001709636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6805","nonce":2001709636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6809","nonce":2001709636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6807","nonce":2001709636}]},"public_addr":"172.21.15.28:6803/2001709636","cluster_addr":"172.21.15.28:6805/2001709636","heartbeat_back_addr":"172.21.15.28:6809/2001709636","heartbeat_front_addr":"172.21.15.28:6807/2001709636","state":["exists","up"]},{"osd":1,"uuid":"17eb7536-c2a4-4f8b-bec4-b1abb5125836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6801","nonce":593429648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6803","nonce":593429648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6807","nonce":593429648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6805","nonce":593429648}]},"public_addr":"172.21.15.37:6801/593429648","cluster_addr":"172.21.15.37:6803/593429648","heartbeat_back_addr":"172.21.15.37:6807/593429648","heartbeat_front_addr":"172.21.15.37:6805/593429648","state":["exists","up"]},{"osd":2,"uuid":"3ea64fd8-13f4-4d53-933b-07055ec72701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6801","nonce":88678886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6803","nonce":88678886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6807","nonce":88678886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6805","nonce":88678886}]},"public_addr":"172.21.15.59:6801/88678886","cluster_addr":"172.21.15.59:6803/88678886","heartbeat_back_addr":"172.21.15.59:6807/88678886","heartbeat_front_addr":"172.21.15.59:6805/88678886","state":["exists","up"]},{"osd":3,"uuid":"8be9cdb5-12a9-438e-b8cd-ce65988b0ac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6811","nonce":484290430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6813","nonce":484290430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6817","nonce":484290430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6815","nonce":484290430}]},"public_addr":"172.21.15.28:6811/484290430","cluster_addr":"172.21.15.28:6813/484290430","heartbeat_back_addr":"172.21.15.28:6817/484290430","heartbeat_front_addr":"172.21.15.28:6815/484290430","state":["exists","up"]},{"osd":4,"uuid":"ddea397d-d7b1-46f3-9a13-dd318cade055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6809","nonce":3596500266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6811","nonce":3596500266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6815","nonce":3596500266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6813","nonce":3596500266}]},"public_addr":"172.21.15.37:6809/3596500266","cluster_addr":"172.21.15.37:6811/3596500266","heartbeat_back_addr":"172.21.15.37:6815/3596500266","heartbeat_front_addr":"172.21.15.37:6813/3596500266","state":["exists","up"]},{"osd":5,"uuid":"ee19857b-b047-4d15-8b17-257b6e4966a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6809","nonce":3037648282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6811","nonce":3037648282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6815","nonce":3037648282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6813","nonce":3037648282}]},"public_addr":"172.21.15.59:6809/3037648282","cluster_addr":"172.21.15.59:6811/3037648282","heartbeat_back_addr":"172.21.15.59:6815/3037648282","heartbeat_front_addr":"172.21.15.59:6813/3037648282","state":["exists","up"]},{"osd":6,"uuid":"1d57d0ba-8e37-4ac2-87e8-40b20b24fc53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6819","nonce":3794924886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6821","nonce":3794924886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6825","nonce":3794924886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6823","nonce":3794924886}]},"public_addr":"172.21.15.28:6819/3794924886","cluster_addr":"172.21.15.28:6821/3794924886","heartbeat_back_addr":"172.21.15.28:6825/3794924886","heartbeat_front_addr":"172.21.15.28:6823/3794924886","state":["exists","up"]},{"osd":7,"uuid":"43f3c2c8-752d-4a70-99dd-2c14aeefa137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6817","nonce":724042860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6819","nonce":724042860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6823","nonce":724042860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6821","nonce":724042860}]},"public_addr":"172.21.15.37:6817/724042860","cluster_addr":"172.21.15.37:6819/724042860","heartbeat_back_addr":"172.21.15.37:6823/724042860","heartbeat_front_addr":"172.21.15.37:6821/724042860","state":["exists","up"]},{"osd":8,"uuid":"3ffc07d7-ca79-419d-88a4-2b53d07ffae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6817","nonce":1240363223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6819","nonce":1240363223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6823","nonce":1240363223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6821","nonce":1240363223}]},"public_addr":"172.21.15.59:6817/1240363223","cluster_addr":"172.21.15.59:6819/1240363223","heartbeat_back_addr":"172.21.15.59:6823/1240363223","heartbeat_front_addr":"172.21.15.59:6821/1240363223","state":["exists","up"]},{"osd":9,"uuid":"4e014fc7-1ca3-4d6c-acdd-95ca59541310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6827","nonce":2555848355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6829","nonce":2555848355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6833","nonce":2555848355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6831","nonce":2555848355}]},"public_addr":"172.21.15.28:6827/2555848355","cluster_addr":"172.21.15.28:6829/2555848355","heartbeat_back_addr":"172.21.15.28:6833/2555848355","heartbeat_front_addr":"172.21.15.28:6831/2555848355","state":["exists","up"]},{"osd":10,"uuid":"fc418661-5e89-4241-b14b-241a2be432f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6825","nonce":176857372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6827","nonce":176857372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6831","nonce":176857372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6829","nonce":176857372}]},"public_addr":"172.21.15.37:6825/176857372","cluster_addr":"172.21.15.37:6827/176857372","heartbeat_back_addr":"172.21.15.37:6831/176857372","heartbeat_front_addr":"172.21.15.37:6829/176857372","state":["exists","up"]},{"osd":11,"uuid":"e54d81ee-1461-4229-a1c0-c6e750dd66ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6825","nonce":2675673798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6827","nonce":2675673798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6831","nonce":2675673798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6829","nonce":2675673798}]},"public_addr":"172.21.15.59:6825/2675673798","cluster_addr":"172.21.15.59:6827/2675673798","heartbeat_back_addr":"172.21.15.59:6831/2675673798","heartbeat_front_addr":"172.21.15.59:6829/2675673798","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:33.904270+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:58.988528+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:22.997033+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:57.171455+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:23.594371+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:48.928423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:22.957203+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:50.599655+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:16.166981+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:50.755673+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:18.677280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:44.432598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/4230567915":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/2860387445":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/886961600":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/3217551014":"2024-06-07T08:31:40.064884+0000","172.21.15.28:0/1629731223":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/219831273":"2024-06-07T08:31:04.770627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T08:40:13.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 -- 172.21.15.28:0/468170950 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f89480a2ca0 msgr2=0x7f89480a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:13.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f89480a2ca0 0x7f89480a5160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f89681037c0 tx=0x7f8950009260 comp rx=0 tx=0).stop 2024-06-06T08:40:13.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 -- 172.21.15.28:0/468170950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f896806ab60 msgr2=0x7f896819ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:13.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f896806ab60 0x7f896819ae60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8958000c00 tx=0x7f895800bab0 comp rx=0 tx=0).stop 2024-06-06T08:40:13.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 -- 172.21.15.28:0/468170950 shutdown_connections 2024-06-06T08:40:13.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f89480a2ca0 0x7f89480a5160 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:13.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8968108520 0x7f896819f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:13.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f896806ab60 0x7f896819ae60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:13.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 --2- 172.21.15.28:0/468170950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f896806b520 0x7f896819b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:13.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 -- 172.21.15.28:0/468170950 >> 172.21.15.28:0/468170950 conn(0x7f8968078340 msgr2=0x7f896810d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:13.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 -- 172.21.15.28:0/468170950 shutdown_connections 2024-06-06T08:40:13.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:13.202+0000 7f896d600700 1 -- 172.21.15.28:0/468170950 wait complete. 2024-06-06T08:40:13.781 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:13 smithi028 ceph-mon[31564]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-06-06T08:40:13.781 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:13 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/468170950' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:40:13.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:13 smithi037 ceph-mon[36609]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-06-06T08:40:13.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:13 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/468170950' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:40:13.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:13 smithi059 ceph-mon[36684]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-06-06T08:40:13.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:13 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/468170950' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:40:14.026 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-06-06T08:40:14.492 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:15.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:15 smithi037 ceph-mon[36609]: pgmap v335: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-06T08:40:15.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:15 smithi059 ceph-mon[36684]: pgmap v335: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-06T08:40:16.027 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:15 smithi028 ceph-mon[31564]: pgmap v335: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-06T08:40:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.863+0000 7f61aaa00700 1 -- 172.21.15.28:0/147766000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a40747b0 msgr2=0x7f61a4074b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.863+0000 7f61aaa00700 1 --2- 172.21.15.28:0/147766000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a40747b0 0x7f61a4074b90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6198009990 tx=0x7f6198009ca0 comp rx=0 tx=0).stop 2024-06-06T08:40:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.863+0000 7f61aaa00700 1 -- 172.21.15.28:0/147766000 shutdown_connections 2024-06-06T08:40:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.863+0000 7f61aaa00700 1 --2- 172.21.15.28:0/147766000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61a410ec80 0x7f61a4111070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.863+0000 7f61aaa00700 1 --2- 172.21.15.28:0/147766000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a40747b0 0x7f61a4074b90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.863+0000 7f61aaa00700 1 --2- 172.21.15.28:0/147766000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61a40750d0 0x7f61a410e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.863+0000 7f61aaa00700 1 -- 172.21.15.28:0/147766000 >> 172.21.15.28:0/147766000 conn(0x7f61a40fdf10 msgr2=0x7f61a4100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.863+0000 7f61aaa00700 1 -- 172.21.15.28:0/147766000 shutdown_connections 2024-06-06T08:40:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.863+0000 7f61aaa00700 1 -- 172.21.15.28:0/147766000 wait complete. 2024-06-06T08:40:16.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.864+0000 7f61aaa00700 1 Processor -- start 2024-06-06T08:40:16.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.865+0000 7f61aaa00700 1 -- start start 2024-06-06T08:40:16.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.865+0000 7f61aaa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61a40747b0 0x7f61a419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:16.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.865+0000 7f61aaa00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61a40750d0 0x7f61a419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:16.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.865+0000 7f61aaa00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a410ec80 0x7f61a419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:16.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.865+0000 7f61aaa00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f61a4114920 con 0x7f61a40747b0 2024-06-06T08:40:16.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.865+0000 7f61aaa00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61a41147a0 con 0x7f61a410ec80 2024-06-06T08:40:16.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.865+0000 7f61aaa00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f61a4114aa0 con 0x7f61a40750d0 2024-06-06T08:40:16.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.865+0000 7f61a9600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61a40747b0 0x7f61a419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:16.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.865+0000 7f61a8c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61a40750d0 0x7f61a419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:16.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.865+0000 7f61a9600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61a40747b0 0x7f61a419ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42288/0 (socket says 172.21.15.28:42288) 2024-06-06T08:40:16.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.865+0000 7f61a9600700 1 -- 172.21.15.28:0/2660782458 learned_addr learned my addr 172.21.15.28:0/2660782458 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:16.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.866+0000 7f61aa000700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a410ec80 0x7f61a419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:16.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.866+0000 7f61a8c00700 1 -- 172.21.15.28:0/2660782458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a410ec80 msgr2=0x7f61a419f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:16.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.866+0000 7f61a8c00700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a410ec80 0x7f61a419f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:16.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.866+0000 7f61a8c00700 1 -- 172.21.15.28:0/2660782458 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61a40747b0 msgr2=0x7f61a419ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:16.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.866+0000 7f61a8c00700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61a40747b0 0x7f61a419ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:16.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.866+0000 7f61a8c00700 1 -- 172.21.15.28:0/2660782458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a419fe20 con 0x7f61a40750d0 2024-06-06T08:40:16.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.866+0000 7f61a9600700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61a40747b0 0x7f61a419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:40:16.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.866+0000 7f61aa000700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a410ec80 0x7f61a419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:40:16.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.866+0000 7f61a8c00700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61a40750d0 0x7f61a419b350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f619000e9f0 tx=0x7f619000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:16.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.867+0000 7f61a2000700 1 -- 172.21.15.28:0/2660782458 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619000c9c0 con 0x7f61a40750d0 2024-06-06T08:40:16.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.867+0000 7f61aaa00700 1 -- 172.21.15.28:0/2660782458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a41a0110 con 0x7f61a40750d0 2024-06-06T08:40:16.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.867+0000 7f61a2000700 1 -- 172.21.15.28:0/2660782458 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f619000cb60 con 0x7f61a40750d0 2024-06-06T08:40:16.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.867+0000 7f61a2000700 1 -- 172.21.15.28:0/2660782458 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190018680 con 0x7f61a40750d0 2024-06-06T08:40:16.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.867+0000 7f61aaa00700 1 -- 172.21.15.28:0/2660782458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a41a7990 con 0x7f61a40750d0 2024-06-06T08:40:16.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.868+0000 7f61aaa00700 1 -- 172.21.15.28:0/2660782458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6184005330 con 0x7f61a40750d0 2024-06-06T08:40:16.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.870+0000 7f61a2000700 1 -- 172.21.15.28:0/2660782458 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f619000cd10 con 0x7f61a40750d0 2024-06-06T08:40:16.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.871+0000 7f61a2000700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f618c0a2c20 0x7f618c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:16.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.872+0000 7f61a2000700 1 -- 172.21.15.28:0/2660782458 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f61900cf190 con 0x7f61a40750d0 2024-06-06T08:40:16.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.872+0000 7f61a9600700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f618c0a2c20 0x7f618c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:16.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.872+0000 7f61a9600700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f618c0a2c20 0x7f618c0a50e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6198009750 tx=0x7f619800b2a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:16.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:16.874+0000 7f61a2000700 1 -- 172.21.15.28:0/2660782458 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f619009c1a0 con 0x7f61a40750d0 2024-06-06T08:40:17.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.151+0000 7f61aaa00700 1 -- 172.21.15.28:0/2660782458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6184005620 con 0x7f61a40750d0 2024-06-06T08:40:17.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.564+0000 7f61a2000700 1 -- 172.21.15.28:0/2660782458 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f619009baa0 con 0x7f61a40750d0 2024-06-06T08:40:17.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.568+0000 7f61aaa00700 1 -- 172.21.15.28:0/2660782458 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f618c0a2c20 msgr2=0x7f618c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:17.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.568+0000 7f61aaa00700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f618c0a2c20 0x7f618c0a50e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6198009750 tx=0x7f619800b2a0 comp rx=0 tx=0).stop 2024-06-06T08:40:17.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.568+0000 7f61aaa00700 1 -- 172.21.15.28:0/2660782458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61a40750d0 msgr2=0x7f61a419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:17.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.568+0000 7f61aaa00700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61a40750d0 0x7f61a419b350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f619000e9f0 tx=0x7f619000ed00 comp rx=0 tx=0).stop 2024-06-06T08:40:17.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.568+0000 7f61aaa00700 1 -- 172.21.15.28:0/2660782458 shutdown_connections 2024-06-06T08:40:17.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.568+0000 7f61aaa00700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f618c0a2c20 0x7f618c0a50e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:17.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.568+0000 7f61aaa00700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a410ec80 0x7f61a419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:17.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.568+0000 7f61aaa00700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61a40747b0 0x7f61a419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:17.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.568+0000 7f61aaa00700 1 --2- 172.21.15.28:0/2660782458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61a40750d0 0x7f61a419b350 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:17.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.568+0000 7f61aaa00700 1 -- 172.21.15.28:0/2660782458 >> 172.21.15.28:0/2660782458 conn(0x7f61a40fdf10 msgr2=0x7f61a40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:17.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.569+0000 7f61aaa00700 1 -- 172.21.15.28:0/2660782458 shutdown_connections 2024-06-06T08:40:17.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:17.569+0000 7f61aaa00700 1 -- 172.21.15.28:0/2660782458 wait complete. 2024-06-06T08:40:17.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:17 smithi059 ceph-mon[36684]: pgmap v336: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-06-06T08:40:17.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:17 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2660782458' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T08:40:17.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:17 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T08:40:17.964 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:17 smithi028 ceph-mon[31564]: pgmap v336: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-06-06T08:40:17.964 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:17 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2660782458' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T08:40:17.965 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:17 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T08:40:18.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:17 smithi037 ceph-mon[36609]: pgmap v336: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-06-06T08:40:18.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:17 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2660782458' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T08:40:18.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:17 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T08:40:18.406 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-06-06T08:40:18.407 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-06-06T08:40:18.579 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:18 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-06T08:40:18.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:18 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-06T08:40:18.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:18 smithi059 ceph-mon[36684]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:18.930 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:19.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:18 smithi028 ceph-mon[31564]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:19.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:18 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-06T08:40:19.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:18 smithi037 ceph-mon[36609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:19.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:19 smithi028 ceph-mon[31564]: pgmap v337: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 3 op/s 2024-06-06T08:40:19.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:19 smithi059 ceph-mon[36684]: pgmap v337: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 3 op/s 2024-06-06T08:40:20.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:19 smithi037 ceph-mon[36609]: pgmap v337: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 3 op/s 2024-06-06T08:40:21.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.195+0000 7fccc7400700 1 -- 172.21.15.28:0/2370532021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc0109480 msgr2=0x7fccc0115990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:21.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.195+0000 7fccc7400700 1 --2- 172.21.15.28:0/2370532021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc0109480 0x7fccc0115990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fccb800b0a0 tx=0x7fccb800b3b0 comp rx=0 tx=0).stop 2024-06-06T08:40:21.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.195+0000 7fccc7400700 1 -- 172.21.15.28:0/2370532021 shutdown_connections 2024-06-06T08:40:21.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.195+0000 7fccc7400700 1 --2- 172.21.15.28:0/2370532021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc0109480 0x7fccc0115990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:21.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.195+0000 7fccc7400700 1 --2- 172.21.15.28:0/2370532021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fccc010eac0 0x7fccc010eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:21.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.195+0000 7fccc7400700 1 --2- 172.21.15.28:0/2370532021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc0108ac0 0x7fccc0108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:21.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.195+0000 7fccc7400700 1 -- 172.21.15.28:0/2370532021 >> 172.21.15.28:0/2370532021 conn(0x7fccc0075c60 msgr2=0x7fccc01072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:21.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.195+0000 7fccc7400700 1 -- 172.21.15.28:0/2370532021 shutdown_connections 2024-06-06T08:40:21.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.195+0000 7fccc7400700 1 -- 172.21.15.28:0/2370532021 wait complete. 2024-06-06T08:40:21.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.196+0000 7fccc7400700 1 Processor -- start 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccc7400700 1 -- start start 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccc7400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fccc0108ac0 0x7fccc019f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccc7400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc0109480 0x7fccc019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccc7400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc010eac0 0x7fccc01a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccc7400700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0118df0 con 0x7fccc0108ac0 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccc7400700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0118c70 con 0x7fccc0109480 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccc7400700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0118f70 con 0x7fccc010eac0 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccc4a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fccc0108ac0 0x7fccc019f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccc4a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fccc0108ac0 0x7fccc019f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42312/0 (socket says 172.21.15.28:42312) 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccc4a00700 1 -- 172.21.15.28:0/2078155027 learned_addr learned my addr 172.21.15.28:0/2078155027 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccc5400700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc010eac0 0x7fccc01a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:21.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.197+0000 7fccb7e00700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc0109480 0x7fccc019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.198+0000 7fccc5400700 1 -- 172.21.15.28:0/2078155027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc0109480 msgr2=0x7fccc019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.198+0000 7fccc5400700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc0109480 0x7fccc019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.198+0000 7fccc5400700 1 -- 172.21.15.28:0/2078155027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fccc0108ac0 msgr2=0x7fccc019f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.198+0000 7fccc5400700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fccc0108ac0 0x7fccc019f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.198+0000 7fccc5400700 1 -- 172.21.15.28:0/2078155027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc01a41c0 con 0x7fccc010eac0 2024-06-06T08:40:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.198+0000 7fccc5400700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc010eac0 0x7fccc01a3a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fccb800b0a0 tx=0x7fccb8004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:21.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.199+0000 7fccbe000700 1 -- 172.21.15.28:0/2078155027 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8021070 con 0x7fccc010eac0 2024-06-06T08:40:21.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.199+0000 7fccbe000700 1 -- 172.21.15.28:0/2078155027 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccb8007b80 con 0x7fccc010eac0 2024-06-06T08:40:21.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.199+0000 7fccc7400700 1 -- 172.21.15.28:0/2078155027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc01a4450 con 0x7fccc010eac0 2024-06-06T08:40:21.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.199+0000 7fccbe000700 1 -- 172.21.15.28:0/2078155027 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8005040 con 0x7fccc010eac0 2024-06-06T08:40:21.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.199+0000 7fccc7400700 1 -- 172.21.15.28:0/2078155027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc01abd30 con 0x7fccc010eac0 2024-06-06T08:40:21.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.200+0000 7fccc7400700 1 -- 172.21.15.28:0/2078155027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc0069180 con 0x7fccc010eac0 2024-06-06T08:40:21.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.202+0000 7fccbe000700 1 -- 172.21.15.28:0/2078155027 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fccb8024070 con 0x7fccc010eac0 2024-06-06T08:40:21.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.203+0000 7fccbe000700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcca00a2ca0 0x7fcca00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:21.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.203+0000 7fccbe000700 1 -- 172.21.15.28:0/2078155027 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fccb800f020 con 0x7fccc010eac0 2024-06-06T08:40:21.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.204+0000 7fccc4a00700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcca00a2ca0 0x7fcca00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.204+0000 7fccc4a00700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcca00a2ca0 0x7fcca00a5160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009ca0 tx=0x7fccb0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.206+0000 7fccbe000700 1 -- 172.21.15.28:0/2078155027 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fccb802b020 con 0x7fccc010eac0 2024-06-06T08:40:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.491+0000 7fccc7400700 1 -- 172.21.15.28:0/2078155027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fccc01a0510 con 0x7fccc010eac0 2024-06-06T08:40:21.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.590+0000 7fccbe000700 1 -- 172.21.15.28:0/2078155027 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fccb8011390 con 0x7fccc010eac0 2024-06-06T08:40:21.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.593+0000 7fccc7400700 1 -- 172.21.15.28:0/2078155027 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcca00a2ca0 msgr2=0x7fcca00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:21.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.593+0000 7fccc7400700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcca00a2ca0 0x7fcca00a5160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009ca0 tx=0x7fccb0009260 comp rx=0 tx=0).stop 2024-06-06T08:40:21.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.593+0000 7fccc7400700 1 -- 172.21.15.28:0/2078155027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc010eac0 msgr2=0x7fccc01a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:21.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.593+0000 7fccc7400700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc010eac0 0x7fccc01a3a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fccb800b0a0 tx=0x7fccb8004d00 comp rx=0 tx=0).stop 2024-06-06T08:40:21.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.594+0000 7fccc7400700 1 -- 172.21.15.28:0/2078155027 shutdown_connections 2024-06-06T08:40:21.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.594+0000 7fccc7400700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcca00a2ca0 0x7fcca00a5160 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:21.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.594+0000 7fccc7400700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc010eac0 0x7fccc01a3a80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:21.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.594+0000 7fccc7400700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fccc0108ac0 0x7fccc019f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:21.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.594+0000 7fccc7400700 1 --2- 172.21.15.28:0/2078155027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc0109480 0x7fccc019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:21.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.594+0000 7fccc7400700 1 -- 172.21.15.28:0/2078155027 >> 172.21.15.28:0/2078155027 conn(0x7fccc0075c60 msgr2=0x7fccc0076180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:21.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.594+0000 7fccc7400700 1 -- 172.21.15.28:0/2078155027 shutdown_connections 2024-06-06T08:40:21.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:21.594+0000 7fccc7400700 1 -- 172.21.15.28:0/2078155027 wait complete. 2024-06-06T08:40:21.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:21 smithi028 ceph-mon[31564]: pgmap v338: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-06-06T08:40:21.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:21 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2078155027' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-06T08:40:21.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:21 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-06T08:40:21.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:21 smithi059 ceph-mon[36684]: pgmap v338: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-06-06T08:40:21.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:21 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2078155027' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-06T08:40:21.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:21 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-06T08:40:22.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:21 smithi037 ceph-mon[36609]: pgmap v338: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-06-06T08:40:22.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:21 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2078155027' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-06T08:40:22.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:21 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-06T08:40:22.400 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-06-06T08:40:22.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:22 smithi059 ceph-mon[36684]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-06T08:40:22.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:22 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-06T08:40:22.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:22 smithi059 ceph-mon[36684]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-06T08:40:22.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:22 smithi059 ceph-mon[36684]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:22.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:22 smithi059 ceph-mon[36684]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-06-06T08:40:22.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:22 smithi059 ceph-mon[36684]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-06-06T08:40:22.873 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:23.024 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:22 smithi028 ceph-mon[31564]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-06T08:40:23.024 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:22 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-06T08:40:23.025 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:22 smithi028 ceph-mon[31564]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-06T08:40:23.025 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:22 smithi028 ceph-mon[31564]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:23.025 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:22 smithi028 ceph-mon[31564]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-06-06T08:40:23.025 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:22 smithi028 ceph-mon[31564]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-06-06T08:40:23.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:22 smithi037 ceph-mon[36609]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-06T08:40:23.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:22 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-06T08:40:23.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:22 smithi037 ceph-mon[36609]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-06T08:40:23.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:22 smithi037 ceph-mon[36609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-06T08:40:23.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:22 smithi037 ceph-mon[36609]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-06-06T08:40:23.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:22 smithi037 ceph-mon[36609]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-06-06T08:40:23.874 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:23 smithi028 ceph-mon[31564]: pgmap v339: 97 pgs: 97 active+clean; 580 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-06-06T08:40:23.874 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:23 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] up:active 2024-06-06T08:40:23.874 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:23 smithi028 ceph-mon[31564]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-06T08:40:23.874 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:23 smithi028 ceph-mon[31564]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-06-06T08:40:23.874 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:23 smithi028 ceph-mon[31564]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-06-06T08:40:23.874 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:23 smithi028 ceph-mon[31564]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-06-06T08:40:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:23 smithi037 ceph-mon[36609]: pgmap v339: 97 pgs: 97 active+clean; 580 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-06-06T08:40:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:23 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] up:active 2024-06-06T08:40:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:23 smithi037 ceph-mon[36609]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-06T08:40:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:23 smithi037 ceph-mon[36609]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-06-06T08:40:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:23 smithi037 ceph-mon[36609]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-06-06T08:40:24.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:23 smithi037 ceph-mon[36609]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-06-06T08:40:24.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:23 smithi059 ceph-mon[36684]: pgmap v339: 97 pgs: 97 active+clean; 580 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-06-06T08:40:24.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:23 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] up:active 2024-06-06T08:40:24.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:23 smithi059 ceph-mon[36684]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-06T08:40:24.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:23 smithi059 ceph-mon[36684]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-06-06T08:40:24.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:23 smithi059 ceph-mon[36684]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-06-06T08:40:24.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:23 smithi059 ceph-mon[36684]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-06-06T08:40:24.913 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:24 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] up:active 2024-06-06T08:40:24.913 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:24 smithi028 ceph-mon[31564]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-06T08:40:24.913 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:24 smithi028 ceph-mon[31564]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-06-06T08:40:24.913 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:24 smithi028 ceph-mon[31564]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-06-06T08:40:24.913 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:24 smithi028 ceph-mon[31564]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-06-06T08:40:25.001 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:24 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] up:active 2024-06-06T08:40:25.001 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:24 smithi059 ceph-mon[36684]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-06T08:40:25.001 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:24 smithi059 ceph-mon[36684]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-06-06T08:40:25.001 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:24 smithi059 ceph-mon[36684]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-06-06T08:40:25.001 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:24 smithi059 ceph-mon[36684]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-06-06T08:40:25.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:24 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] up:active 2024-06-06T08:40:25.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:24 smithi037 ceph-mon[36609]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-06T08:40:25.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:24 smithi037 ceph-mon[36609]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-06-06T08:40:25.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:24 smithi037 ceph-mon[36609]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-06-06T08:40:25.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:24 smithi037 ceph-mon[36609]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-06-06T08:40:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.098+0000 7fb9a3000700 1 -- 172.21.15.28:0/1765175511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c107700 msgr2=0x7fb99c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.098+0000 7fb9a3000700 1 --2- 172.21.15.28:0/1765175511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c107700 0x7fb99c10f2d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb99400b0a0 tx=0x7fb99400b3b0 comp rx=0 tx=0).stop 2024-06-06T08:40:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.098+0000 7fb9a3000700 1 -- 172.21.15.28:0/1765175511 shutdown_connections 2024-06-06T08:40:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.098+0000 7fb9a3000700 1 --2- 172.21.15.28:0/1765175511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c107700 0x7fb99c10f2d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.098+0000 7fb9a3000700 1 --2- 172.21.15.28:0/1765175511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb99c102620 0x7fb99c102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.098+0000 7fb9a3000700 1 --2- 172.21.15.28:0/1765175511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb99c102fd0 0x7fb99c107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.098+0000 7fb9a3000700 1 -- 172.21.15.28:0/1765175511 >> 172.21.15.28:0/1765175511 conn(0x7fb99c0fdf10 msgr2=0x7fb99c100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.099+0000 7fb9a3000700 1 -- 172.21.15.28:0/1765175511 shutdown_connections 2024-06-06T08:40:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.099+0000 7fb9a3000700 1 -- 172.21.15.28:0/1765175511 wait complete. 2024-06-06T08:40:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.100+0000 7fb9a3000700 1 Processor -- start 2024-06-06T08:40:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.100+0000 7fb9a3000700 1 -- start start 2024-06-06T08:40:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.101+0000 7fb9a3000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb99c102620 0x7fb99c19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.101+0000 7fb9a3000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c102fd0 0x7fb99c19b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.101+0000 7fb9a3000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb99c107700 0x7fb99c19f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.101+0000 7fb9a3000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c112760 con 0x7fb99c107700 2024-06-06T08:40:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.101+0000 7fb9a3000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1125e0 con 0x7fb99c102fd0 2024-06-06T08:40:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.101+0000 7fb9a3000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1128e0 con 0x7fb99c102620 2024-06-06T08:40:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.101+0000 7fb9a1200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c102fd0 0x7fb99c19b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.101+0000 7fb9a1200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c102fd0 0x7fb99c19b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:36196/0 (socket says 172.21.15.28:36196) 2024-06-06T08:40:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.101+0000 7fb9a1200700 1 -- 172.21.15.28:0/448237335 learned_addr learned my addr 172.21.15.28:0/448237335 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.101+0000 7fb9a2600700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb99c107700 0x7fb99c19f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.101+0000 7fb9a1c00700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb99c102620 0x7fb99c19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.102+0000 7fb9a1200700 1 -- 172.21.15.28:0/448237335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb99c102620 msgr2=0x7fb99c19ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.102+0000 7fb9a1200700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb99c102620 0x7fb99c19ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.102+0000 7fb9a1200700 1 -- 172.21.15.28:0/448237335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb99c107700 msgr2=0x7fb99c19f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.102+0000 7fb9a1200700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb99c107700 0x7fb99c19f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.102+0000 7fb9a1200700 1 -- 172.21.15.28:0/448237335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c19fd60 con 0x7fb99c102fd0 2024-06-06T08:40:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.102+0000 7fb9a1200700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c102fd0 0x7fb99c19b290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb98800e970 tx=0x7fb98800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.102+0000 7fb99a000700 1 -- 172.21.15.28:0/448237335 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988004a30 con 0x7fb99c102fd0 2024-06-06T08:40:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.102+0000 7fb9a3000700 1 -- 172.21.15.28:0/448237335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c1a0050 con 0x7fb99c102fd0 2024-06-06T08:40:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.102+0000 7fb99a000700 1 -- 172.21.15.28:0/448237335 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb98800ccc0 con 0x7fb99c102fd0 2024-06-06T08:40:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.103+0000 7fb99a000700 1 -- 172.21.15.28:0/448237335 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988005610 con 0x7fb99c102fd0 2024-06-06T08:40:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.103+0000 7fb9a3000700 1 -- 172.21.15.28:0/448237335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99c1a78d0 con 0x7fb99c102fd0 2024-06-06T08:40:25.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.104+0000 7fb9a3000700 1 -- 172.21.15.28:0/448237335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99c069180 con 0x7fb99c102fd0 2024-06-06T08:40:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.106+0000 7fb99a000700 1 -- 172.21.15.28:0/448237335 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb988004cf0 con 0x7fb99c102fd0 2024-06-06T08:40:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.107+0000 7fb99a000700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb9840a2ca0 0x7fb9840a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.107+0000 7fb99a000700 1 -- 172.21.15.28:0/448237335 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fb9880cf030 con 0x7fb99c102fd0 2024-06-06T08:40:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.108+0000 7fb9a1c00700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb9840a2ca0 0x7fb9840a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:25.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.108+0000 7fb9a1c00700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb9840a2ca0 0x7fb9840a5160 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb990009c60 tx=0x7fb990009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:25.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.110+0000 7fb99a000700 1 -- 172.21.15.28:0/448237335 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb98809c040 con 0x7fb99c102fd0 2024-06-06T08:40:25.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.389+0000 7fb9a3000700 1 -- 172.21.15.28:0/448237335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fb99c1a7b90 con 0x7fb99c102fd0 2024-06-06T08:40:25.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.659+0000 7fb99a000700 1 -- 172.21.15.28:0/448237335 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7fb98809b940 con 0x7fb99c102fd0 2024-06-06T08:40:25.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.663+0000 7fb9a3000700 1 -- 172.21.15.28:0/448237335 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb9840a2ca0 msgr2=0x7fb9840a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:25.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.663+0000 7fb9a3000700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb9840a2ca0 0x7fb9840a5160 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb990009c60 tx=0x7fb990009260 comp rx=0 tx=0).stop 2024-06-06T08:40:25.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.663+0000 7fb9a3000700 1 -- 172.21.15.28:0/448237335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c102fd0 msgr2=0x7fb99c19b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.663+0000 7fb9a3000700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c102fd0 0x7fb99c19b290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb98800e970 tx=0x7fb98800ec80 comp rx=0 tx=0).stop 2024-06-06T08:40:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.663+0000 7fb9a3000700 1 -- 172.21.15.28:0/448237335 shutdown_connections 2024-06-06T08:40:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.663+0000 7fb9a3000700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fb9840a2ca0 0x7fb9840a5160 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.663+0000 7fb9a3000700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb99c107700 0x7fb99c19f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.663+0000 7fb9a3000700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb99c102620 0x7fb99c19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.663+0000 7fb9a3000700 1 --2- 172.21.15.28:0/448237335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c102fd0 0x7fb99c19b290 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.663+0000 7fb9a3000700 1 -- 172.21.15.28:0/448237335 >> 172.21.15.28:0/448237335 conn(0x7fb99c0fdf10 msgr2=0x7fb99c10d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.664+0000 7fb9a3000700 1 -- 172.21.15.28:0/448237335 shutdown_connections 2024-06-06T08:40:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:25.664+0000 7fb9a3000700 1 -- 172.21.15.28:0/448237335 wait complete. 2024-06-06T08:40:25.962 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:25 smithi028 ceph-mon[31564]: pgmap v340: 97 pgs: 97 active+clean; 580 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-06-06T08:40:25.962 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:25 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] up:active 2024-06-06T08:40:25.962 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:25 smithi028 ceph-mon[31564]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-06T08:40:25.963 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:25 smithi028 ceph-mon[31564]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-06T08:40:25.963 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:25 smithi028 ceph-mon[31564]: Cluster is now healthy 2024-06-06T08:40:25.963 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:25 smithi028 ceph-mon[31564]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-06-06T08:40:25.963 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:25 smithi028 ceph-mon[31564]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-06-06T08:40:25.963 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:25 smithi028 ceph-mon[31564]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-06-06T08:40:25.963 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:25 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/448237335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T08:40:25.963 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:25 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T08:40:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:25 smithi037 ceph-mon[36609]: pgmap v340: 97 pgs: 97 active+clean; 580 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-06-06T08:40:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:25 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] up:active 2024-06-06T08:40:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:25 smithi037 ceph-mon[36609]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-06T08:40:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:25 smithi037 ceph-mon[36609]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-06T08:40:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:25 smithi037 ceph-mon[36609]: Cluster is now healthy 2024-06-06T08:40:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:25 smithi037 ceph-mon[36609]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-06-06T08:40:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:25 smithi037 ceph-mon[36609]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-06-06T08:40:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:25 smithi037 ceph-mon[36609]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-06-06T08:40:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:25 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/448237335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T08:40:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:25 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T08:40:26.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:25 smithi059 ceph-mon[36684]: pgmap v340: 97 pgs: 97 active+clean; 580 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-06-06T08:40:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:25 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] up:active 2024-06-06T08:40:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:25 smithi059 ceph-mon[36684]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-06T08:40:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:25 smithi059 ceph-mon[36684]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-06T08:40:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:25 smithi059 ceph-mon[36684]: Cluster is now healthy 2024-06-06T08:40:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:25 smithi059 ceph-mon[36684]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-06-06T08:40:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:25 smithi059 ceph-mon[36684]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-06-06T08:40:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:25 smithi059 ceph-mon[36684]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-06-06T08:40:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:25 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/448237335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T08:40:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:25 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T08:40:26.413 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-06-06T08:40:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:27.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:26 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-06T08:40:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:26 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] up:active 2024-06-06T08:40:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:26 smithi028 ceph-mon[31564]: fsmap cephfs:5 7 up:standby 5 up:active 2024-06-06T08:40:27.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:26 smithi028 ceph-mon[31564]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:40:27.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:26 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-06T08:40:27.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:26 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] up:active 2024-06-06T08:40:27.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:26 smithi037 ceph-mon[36609]: fsmap cephfs:5 7 up:standby 5 up:active 2024-06-06T08:40:27.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:26 smithi037 ceph-mon[36609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:40:27.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:26 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-06T08:40:27.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:26 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] up:active 2024-06-06T08:40:27.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:26 smithi059 ceph-mon[36684]: fsmap cephfs:5 7 up:standby 5 up:active 2024-06-06T08:40:27.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:26 smithi059 ceph-mon[36684]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:40:27.956 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:27 smithi028 ceph-mon[31564]: pgmap v341: 97 pgs: 97 active+clean; 582 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-06-06T08:40:28.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:27 smithi037 ceph-mon[36609]: pgmap v341: 97 pgs: 97 active+clean; 582 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-06-06T08:40:28.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:27 smithi059 ceph-mon[36684]: pgmap v341: 97 pgs: 97 active+clean; 582 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-06-06T08:40:29.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.146+0000 7f5343e00700 1 -- 172.21.15.28:0/3393451045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53441076e0 msgr2=0x7f534410f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:29.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.146+0000 7f5343e00700 1 --2- 172.21.15.28:0/3393451045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53441076e0 0x7f534410f2b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f533c0099c0 tx=0x7f533c009cd0 comp rx=0 tx=0).stop 2024-06-06T08:40:29.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.147+0000 7f5343e00700 1 -- 172.21.15.28:0/3393451045 shutdown_connections 2024-06-06T08:40:29.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.147+0000 7f5343e00700 1 --2- 172.21.15.28:0/3393451045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53441076e0 0x7f534410f2b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:29.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.147+0000 7f5343e00700 1 --2- 172.21.15.28:0/3393451045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5344102600 0x7f53441029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:29.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.147+0000 7f5343e00700 1 --2- 172.21.15.28:0/3393451045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5344102fb0 0x7f5344107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:29.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.147+0000 7f5343e00700 1 -- 172.21.15.28:0/3393451045 >> 172.21.15.28:0/3393451045 conn(0x7f53440fdeb0 msgr2=0x7f53441002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:29.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.147+0000 7f5343e00700 1 -- 172.21.15.28:0/3393451045 shutdown_connections 2024-06-06T08:40:29.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.147+0000 7f5343e00700 1 -- 172.21.15.28:0/3393451045 wait complete. 2024-06-06T08:40:29.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.148+0000 7f5343e00700 1 Processor -- start 2024-06-06T08:40:29.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.148+0000 7f5343e00700 1 -- start start 2024-06-06T08:40:29.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.148+0000 7f5343e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5344102600 0x7f53441a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:29.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.148+0000 7f5343e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5344102fb0 0x7f53441a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:29.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5343e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53441076e0 0x7f534419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:29.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5343e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53441126d0 con 0x7f5344102600 2024-06-06T08:40:29.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5343e00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5344112550 con 0x7f5344102fb0 2024-06-06T08:40:29.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5343e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5344112850 con 0x7f53441076e0 2024-06-06T08:40:29.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5342a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5344102600 0x7f53441a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:29.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5342a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5344102600 0x7f53441a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36738/0 (socket says 172.21.15.28:36738) 2024-06-06T08:40:29.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5342a00700 1 -- 172.21.15.28:0/259012401 learned_addr learned my addr 172.21.15.28:0/259012401 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:29.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f533a000700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5344102fb0 0x7f53441a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:29.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5343400700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53441076e0 0x7f534419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:29.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5342a00700 1 -- 172.21.15.28:0/259012401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53441076e0 msgr2=0x7f534419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:29.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5342a00700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53441076e0 0x7f534419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:29.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5342a00700 1 -- 172.21.15.28:0/259012401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5344102fb0 msgr2=0x7f53441a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:29.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5342a00700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5344102fb0 0x7f53441a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:29.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.149+0000 7f5342a00700 1 -- 172.21.15.28:0/259012401 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534419b3f0 con 0x7f5344102600 2024-06-06T08:40:29.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.150+0000 7f5342a00700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5344102600 0x7f53441a0a40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f533400ef10 tx=0x7f533400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:29.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.150+0000 7f533be00700 1 -- 172.21.15.28:0/259012401 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533400c9c0 con 0x7f5344102600 2024-06-06T08:40:29.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.150+0000 7f533be00700 1 -- 172.21.15.28:0/259012401 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5334019070 con 0x7f5344102600 2024-06-06T08:40:29.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.150+0000 7f5343e00700 1 -- 172.21.15.28:0/259012401 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534419b680 con 0x7f5344102600 2024-06-06T08:40:29.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.150+0000 7f5343e00700 1 -- 172.21.15.28:0/259012401 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53441a79c0 con 0x7f5344102600 2024-06-06T08:40:29.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.150+0000 7f533be00700 1 -- 172.21.15.28:0/259012401 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334007e60 con 0x7f5344102600 2024-06-06T08:40:29.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.151+0000 7f5343e00700 1 -- 172.21.15.28:0/259012401 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5320005330 con 0x7f5344102600 2024-06-06T08:40:29.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.154+0000 7f533be00700 1 -- 172.21.15.28:0/259012401 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5334012050 con 0x7f5344102600 2024-06-06T08:40:29.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.155+0000 7f533be00700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f53280a2ca0 0x7f53280a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:29.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.155+0000 7f533be00700 1 -- 172.21.15.28:0/259012401 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f53340cf450 con 0x7f5344102600 2024-06-06T08:40:29.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.155+0000 7f533a000700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f53280a2ca0 0x7f53280a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:29.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.156+0000 7f533a000700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f53280a2ca0 0x7f53280a5160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f532c009680 tx=0x7f532c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:29.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.158+0000 7f533be00700 1 -- 172.21.15.28:0/259012401 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5334010040 con 0x7f5344102600 2024-06-06T08:40:29.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.440+0000 7f5343e00700 1 -- 172.21.15.28:0/259012401 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f5320005620 con 0x7f5344102600 2024-06-06T08:40:29.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.676+0000 7f533be00700 1 -- 172.21.15.28:0/259012401 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f533409c460 con 0x7f5344102600 2024-06-06T08:40:29.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.680+0000 7f5343e00700 1 -- 172.21.15.28:0/259012401 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f53280a2ca0 msgr2=0x7f53280a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:29.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.680+0000 7f5343e00700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f53280a2ca0 0x7f53280a5160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f532c009680 tx=0x7f532c009260 comp rx=0 tx=0).stop 2024-06-06T08:40:29.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.680+0000 7f5343e00700 1 -- 172.21.15.28:0/259012401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5344102600 msgr2=0x7f53441a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:29.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.680+0000 7f5343e00700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5344102600 0x7f53441a0a40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f533400ef10 tx=0x7f533400c3a0 comp rx=0 tx=0).stop 2024-06-06T08:40:29.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.680+0000 7f5343e00700 1 -- 172.21.15.28:0/259012401 shutdown_connections 2024-06-06T08:40:29.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.680+0000 7f5343e00700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f53280a2ca0 0x7f53280a5160 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:29.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.680+0000 7f5343e00700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53441076e0 0x7f534419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:29.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.680+0000 7f5343e00700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5344102600 0x7f53441a0a40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:29.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.680+0000 7f5343e00700 1 --2- 172.21.15.28:0/259012401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5344102fb0 0x7f53441a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:29.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.680+0000 7f5343e00700 1 -- 172.21.15.28:0/259012401 >> 172.21.15.28:0/259012401 conn(0x7f53440fdeb0 msgr2=0x7f534410db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:29.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.681+0000 7f5343e00700 1 -- 172.21.15.28:0/259012401 shutdown_connections 2024-06-06T08:40:29.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:29.681+0000 7f5343e00700 1 -- 172.21.15.28:0/259012401 wait complete. 2024-06-06T08:40:29.702 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:29 smithi028 ceph-mon[31564]: pgmap v342: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-06-06T08:40:29.702 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:29 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/259012401' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T08:40:30.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:29 smithi037 ceph-mon[36609]: pgmap v342: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-06-06T08:40:30.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:29 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/259012401' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T08:40:30.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:29 smithi059 ceph-mon[36684]: pgmap v342: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-06-06T08:40:30.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:29 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/259012401' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T08:40:30.553 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-06-06T08:40:30.554 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-06-06T08:40:30.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:30 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/259012401' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-06T08:40:30.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:30 smithi028 ceph-mon[31564]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:40:31.022 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:31.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:30 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/259012401' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-06T08:40:31.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:30 smithi037 ceph-mon[36609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:40:31.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:30 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/259012401' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-06T08:40:31.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:30 smithi059 ceph-mon[36684]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:40:31.788 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:31 smithi028 ceph-mon[31564]: pgmap v343: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-06-06T08:40:32.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:31 smithi037 ceph-mon[36609]: pgmap v343: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-06-06T08:40:32.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:31 smithi059 ceph-mon[36684]: pgmap v343: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-06-06T08:40:33.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.312+0000 7fc72fc00700 1 -- 172.21.15.28:0/1541952175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc728107840 msgr2=0x7fc72810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:33.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.312+0000 7fc72fc00700 1 --2- 172.21.15.28:0/1541952175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc728107840 0x7fc72810f3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc720009f90 tx=0x7fc72000b330 comp rx=0 tx=0).stop 2024-06-06T08:40:33.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.313+0000 7fc72fc00700 1 -- 172.21.15.28:0/1541952175 shutdown_connections 2024-06-06T08:40:33.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.313+0000 7fc72fc00700 1 --2- 172.21.15.28:0/1541952175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc728107840 0x7fc72810f3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:33.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.313+0000 7fc72fc00700 1 --2- 172.21.15.28:0/1541952175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc728102740 0x7fc728102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:33.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.313+0000 7fc72fc00700 1 --2- 172.21.15.28:0/1541952175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc7281030f0 0x7fc728107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:33.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.313+0000 7fc72fc00700 1 -- 172.21.15.28:0/1541952175 >> 172.21.15.28:0/1541952175 conn(0x7fc7280795f0 msgr2=0x7fc728079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:33.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.313+0000 7fc72fc00700 1 -- 172.21.15.28:0/1541952175 shutdown_connections 2024-06-06T08:40:33.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.313+0000 7fc72fc00700 1 -- 172.21.15.28:0/1541952175 wait complete. 2024-06-06T08:40:33.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.314+0000 7fc72fc00700 1 Processor -- start 2024-06-06T08:40:33.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.314+0000 7fc72fc00700 1 -- start start 2024-06-06T08:40:33.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.314+0000 7fc72fc00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc728102740 0x7fc72819e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:33.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.314+0000 7fc72fc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc7281030f0 0x7fc72819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:33.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.314+0000 7fc72fc00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc728107840 0x7fc728198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:33.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc72fc00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc7281127b0 con 0x7fc7281030f0 2024-06-06T08:40:33.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc72fc00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc728112630 con 0x7fc728102740 2024-06-06T08:40:33.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc72fc00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc728112930 con 0x7fc728107840 2024-06-06T08:40:33.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc71fe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc7281030f0 0x7fc72819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:33.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc71fe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc7281030f0 0x7fc72819ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36764/0 (socket says 172.21.15.28:36764) 2024-06-06T08:40:33.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc71fe00700 1 -- 172.21.15.28:0/2576463610 learned_addr learned my addr 172.21.15.28:0/2576463610 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:33.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc72d200700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc728102740 0x7fc72819e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:33.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc72dc00700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc728107840 0x7fc728198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:33.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc71fe00700 1 -- 172.21.15.28:0/2576463610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc728107840 msgr2=0x7fc728198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:33.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc71fe00700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc728107840 0x7fc728198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:33.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc71fe00700 1 -- 172.21.15.28:0/2576463610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc728102740 msgr2=0x7fc72819e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:33.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc71fe00700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc728102740 0x7fc72819e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:33.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.315+0000 7fc71fe00700 1 -- 172.21.15.28:0/2576463610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7281990d0 con 0x7fc7281030f0 2024-06-06T08:40:33.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.316+0000 7fc71fe00700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc7281030f0 0x7fc72819ecf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc71000e9c0 tx=0x7fc71000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:33.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.316+0000 7fc726000700 1 -- 172.21.15.28:0/2576463610 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710004a30 con 0x7fc7281030f0 2024-06-06T08:40:33.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.316+0000 7fc72fc00700 1 -- 172.21.15.28:0/2576463610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7281993c0 con 0x7fc7281030f0 2024-06-06T08:40:33.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.316+0000 7fc726000700 1 -- 172.21.15.28:0/2576463610 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc71000cca0 con 0x7fc7281030f0 2024-06-06T08:40:33.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.316+0000 7fc726000700 1 -- 172.21.15.28:0/2576463610 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710005610 con 0x7fc7281030f0 2024-06-06T08:40:33.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.316+0000 7fc72fc00700 1 -- 172.21.15.28:0/2576463610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7281a5680 con 0x7fc7281030f0 2024-06-06T08:40:33.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.317+0000 7fc72fc00700 1 -- 172.21.15.28:0/2576463610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc728069180 con 0x7fc7281030f0 2024-06-06T08:40:33.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.320+0000 7fc726000700 1 -- 172.21.15.28:0/2576463610 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc710004cf0 con 0x7fc7281030f0 2024-06-06T08:40:33.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.321+0000 7fc726000700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc70c0a2ca0 0x7fc70c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:33.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.321+0000 7fc726000700 1 -- 172.21.15.28:0/2576463610 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fc7100cefe0 con 0x7fc7281030f0 2024-06-06T08:40:33.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.321+0000 7fc72d200700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc70c0a2ca0 0x7fc70c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:33.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.322+0000 7fc72d200700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc70c0a2ca0 0x7fc70c0a5160 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc728199ab0 tx=0x7fc718009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:33.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.325+0000 7fc726000700 1 -- 172.21.15.28:0/2576463610 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc71009c030 con 0x7fc7281030f0 2024-06-06T08:40:33.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.589+0000 7fc72fc00700 1 -- 172.21.15.28:0/2576463610 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc7280628d0 con 0x7fc70c0a2ca0 2024-06-06T08:40:33.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.626+0000 7fc726000700 1 -- 172.21.15.28:0/2576463610 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc7280628d0 con 0x7fc70c0a2ca0 2024-06-06T08:40:33.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.629+0000 7fc72fc00700 1 -- 172.21.15.28:0/2576463610 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc70c0a2ca0 msgr2=0x7fc70c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:33.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.629+0000 7fc72fc00700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc70c0a2ca0 0x7fc70c0a5160 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc728199ab0 tx=0x7fc718009260 comp rx=0 tx=0).stop 2024-06-06T08:40:33.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.629+0000 7fc72fc00700 1 -- 172.21.15.28:0/2576463610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc7281030f0 msgr2=0x7fc72819ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:33.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.629+0000 7fc72fc00700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc7281030f0 0x7fc72819ecf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc71000e9c0 tx=0x7fc71000ecd0 comp rx=0 tx=0).stop 2024-06-06T08:40:33.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.630+0000 7fc72fc00700 1 -- 172.21.15.28:0/2576463610 shutdown_connections 2024-06-06T08:40:33.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.630+0000 7fc72fc00700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc70c0a2ca0 0x7fc70c0a5160 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:33.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.630+0000 7fc72fc00700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc728107840 0x7fc728198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:33.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.630+0000 7fc72fc00700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc728102740 0x7fc72819e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:33.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.630+0000 7fc72fc00700 1 --2- 172.21.15.28:0/2576463610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc7281030f0 0x7fc72819ecf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:33.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.630+0000 7fc72fc00700 1 -- 172.21.15.28:0/2576463610 >> 172.21.15.28:0/2576463610 conn(0x7fc7280795f0 msgr2=0x7fc7281004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:33.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.630+0000 7fc72fc00700 1 -- 172.21.15.28:0/2576463610 shutdown_connections 2024-06-06T08:40:33.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:33.630+0000 7fc72fc00700 1 -- 172.21.15.28:0/2576463610 wait complete. 2024-06-06T08:40:33.995 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:33 smithi028 ceph-mon[31564]: pgmap v344: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-06-06T08:40:33.995 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:40:33 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:40:33.597+0000 7ff47ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T08:40:33.995 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:40:33 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:40:33.597+0000 7ff47ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T08:40:33.996 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:40:33 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:40:33.597+0000 7ff47ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T08:40:33.996 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:40:33 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:40:33.597+0000 7ff47ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T08:40:33.996 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:40:33 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:40:33.597+0000 7ff47ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T08:40:34.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:33 smithi037 ceph-mon[36609]: pgmap v344: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-06-06T08:40:34.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:33 smithi059 ceph-mon[36684]: pgmap v344: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-06-06T08:40:34.426 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-06-06T08:40:34.911 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:35.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:34 smithi028 ceph-mon[31564]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:35.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:34 smithi037 ceph-mon[36609]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:35.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:34 smithi059 ceph-mon[36684]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:35.965 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:35 smithi037 ceph-mon[36609]: pgmap v345: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 KiB/s wr, 20 op/s 2024-06-06T08:40:35.965 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:35 smithi037 ceph-mon[36609]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-06-06T08:40:35.978 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:35 smithi028 ceph-mon[31564]: pgmap v345: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 KiB/s wr, 20 op/s 2024-06-06T08:40:35.978 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:35 smithi028 ceph-mon[31564]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-06-06T08:40:36.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:35 smithi059 ceph-mon[36684]: pgmap v345: 97 pgs: 97 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.7 KiB/s wr, 20 op/s 2024-06-06T08:40:36.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:35 smithi059 ceph-mon[36684]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-06-06T08:40:37.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.141+0000 7fa2f8600700 1 -- 172.21.15.28:0/1524142287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f0105070 msgr2=0x7fa2f0111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:37.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.141+0000 7fa2f8600700 1 --2- 172.21.15.28:0/1524142287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f0105070 0x7fa2f0111580 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800b0a0 tx=0x7fa2e800b3b0 comp rx=0 tx=0).stop 2024-06-06T08:40:37.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.141+0000 7fa2f8600700 1 -- 172.21.15.28:0/1524142287 shutdown_connections 2024-06-06T08:40:37.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.141+0000 7fa2f8600700 1 --2- 172.21.15.28:0/1524142287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f0105070 0x7fa2f0111580 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:37.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.141+0000 7fa2f8600700 1 --2- 172.21.15.28:0/1524142287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f010a6b0 0x7fa2f010aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:37.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.141+0000 7fa2f8600700 1 --2- 172.21.15.28:0/1524142287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f01046b0 0x7fa2f0104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:37.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.141+0000 7fa2f8600700 1 -- 172.21.15.28:0/1524142287 >> 172.21.15.28:0/1524142287 conn(0x7fa2f01001a0 msgr2=0x7fa2f01025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:37.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.141+0000 7fa2f8600700 1 -- 172.21.15.28:0/1524142287 shutdown_connections 2024-06-06T08:40:37.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.141+0000 7fa2f8600700 1 -- 172.21.15.28:0/1524142287 wait complete. 2024-06-06T08:40:37.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.142+0000 7fa2f8600700 1 Processor -- start 2024-06-06T08:40:37.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.143+0000 7fa2f8600700 1 -- start start 2024-06-06T08:40:37.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.143+0000 7fa2f8600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f01046b0 0x7fa2f019ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:37.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.143+0000 7fa2f8600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f0105070 0x7fa2f019b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:37.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.143+0000 7fa2f8600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f010a6b0 0x7fa2f019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:37.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.143+0000 7fa2f8600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f0114a50 con 0x7fa2f010a6b0 2024-06-06T08:40:37.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.143+0000 7fa2f8600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f01148d0 con 0x7fa2f0105070 2024-06-06T08:40:37.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.143+0000 7fa2f8600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f0114bd0 con 0x7fa2f01046b0 2024-06-06T08:40:37.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.143+0000 7fa2f5c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f01046b0 0x7fa2f019ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:37.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.143+0000 7fa2f5c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f01046b0 0x7fa2f019ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:32962/0 (socket says 172.21.15.28:32962) 2024-06-06T08:40:37.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.143+0000 7fa2f5c00700 1 -- 172.21.15.28:0/560998533 learned_addr learned my addr 172.21.15.28:0/560998533 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:37.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.143+0000 7fa2f6600700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f010a6b0 0x7fa2f019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:37.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.144+0000 7fa2f5200700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f0105070 0x7fa2f019b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:37.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.144+0000 7fa2f6600700 1 -- 172.21.15.28:0/560998533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f01046b0 msgr2=0x7fa2f019ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:37.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.144+0000 7fa2f6600700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f01046b0 0x7fa2f019ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:37.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.144+0000 7fa2f6600700 1 -- 172.21.15.28:0/560998533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f0105070 msgr2=0x7fa2f019b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:37.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.144+0000 7fa2f6600700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f0105070 0x7fa2f019b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:37.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.144+0000 7fa2f6600700 1 -- 172.21.15.28:0/560998533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f019fe30 con 0x7fa2f010a6b0 2024-06-06T08:40:37.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.144+0000 7fa2f6600700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f010a6b0 0x7fa2f019f6f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800b070 tx=0x7fa2e8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:37.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.145+0000 7fa2ee000700 1 -- 172.21.15.28:0/560998533 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8021070 con 0x7fa2f010a6b0 2024-06-06T08:40:37.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.145+0000 7fa2ee000700 1 -- 172.21.15.28:0/560998533 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2e8007b80 con 0x7fa2f010a6b0 2024-06-06T08:40:37.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.145+0000 7fa2ee000700 1 -- 172.21.15.28:0/560998533 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8005040 con 0x7fa2f010a6b0 2024-06-06T08:40:37.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.145+0000 7fa2f8600700 1 -- 172.21.15.28:0/560998533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f01a00c0 con 0x7fa2f010a6b0 2024-06-06T08:40:37.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.145+0000 7fa2f8600700 1 -- 172.21.15.28:0/560998533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f01a79a0 con 0x7fa2f010a6b0 2024-06-06T08:40:37.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.146+0000 7fa2f8600700 1 -- 172.21.15.28:0/560998533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f0105df0 con 0x7fa2f010a6b0 2024-06-06T08:40:37.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.148+0000 7fa2ee000700 1 -- 172.21.15.28:0/560998533 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa2e8024070 con 0x7fa2f010a6b0 2024-06-06T08:40:37.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.150+0000 7fa2ee000700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2d80a2d30 0x7fa2d80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:37.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.150+0000 7fa2ee000700 1 -- 172.21.15.28:0/560998533 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fa2e800f020 con 0x7fa2f010a6b0 2024-06-06T08:40:37.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.150+0000 7fa2f5c00700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2d80a2d30 0x7fa2d80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:37.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.151+0000 7fa2f5c00700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2d80a2d30 0x7fa2d80a51f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009ca0 tx=0x7fa2e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.154+0000 7fa2ee000700 1 -- 172.21.15.28:0/560998533 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa2e802b020 con 0x7fa2f010a6b0 2024-06-06T08:40:37.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.421+0000 7fa2f8600700 1 -- 172.21.15.28:0/560998533 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa2f0100d90 con 0x7fa2d80a2d30 2024-06-06T08:40:37.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.456+0000 7fa2ee000700 1 -- 172.21.15.28:0/560998533 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa2f0100d90 con 0x7fa2d80a2d30 2024-06-06T08:40:37.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 -- 172.21.15.28:0/560998533 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2d80a2d30 msgr2=0x7fa2d80a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:37.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2d80a2d30 0x7fa2d80a51f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009ca0 tx=0x7fa2e4009260 comp rx=0 tx=0).stop 2024-06-06T08:40:37.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 -- 172.21.15.28:0/560998533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f010a6b0 msgr2=0x7fa2f019f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:37.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f010a6b0 0x7fa2f019f6f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800b070 tx=0x7fa2e8004c80 comp rx=0 tx=0).stop 2024-06-06T08:40:37.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 -- 172.21.15.28:0/560998533 shutdown_connections 2024-06-06T08:40:37.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa2d80a2d30 0x7fa2d80a51f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:37.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f010a6b0 0x7fa2f019f6f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:37.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f01046b0 0x7fa2f019ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:37.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 --2- 172.21.15.28:0/560998533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f0105070 0x7fa2f019b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:37.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 -- 172.21.15.28:0/560998533 >> 172.21.15.28:0/560998533 conn(0x7fa2f01001a0 msgr2=0x7fa2f0100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:37.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 -- 172.21.15.28:0/560998533 shutdown_connections 2024-06-06T08:40:37.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:37.461+0000 7fa2f8600700 1 -- 172.21.15.28:0/560998533 wait complete. 2024-06-06T08:40:38.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:37 smithi028 ceph-mon[31564]: pgmap v346: 97 pgs: 97 active+clean; 591 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 KiB/s wr, 20 op/s 2024-06-06T08:40:38.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:37 smithi037 ceph-mon[36609]: pgmap v346: 97 pgs: 97 active+clean; 591 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 KiB/s wr, 20 op/s 2024-06-06T08:40:38.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:37 smithi059 ceph-mon[36684]: pgmap v346: 97 pgs: 97 active+clean; 591 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 KiB/s wr, 20 op/s 2024-06-06T08:40:38.299 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-06-06T08:40:38.774 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:39.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:38 smithi028 ceph-mon[31564]: from='client.14490 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:39.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:38 smithi037 ceph-mon[36609]: from='client.14490 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:39.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:38 smithi059 ceph-mon[36684]: from='client.14490 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:40.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:39 smithi028 ceph-mon[31564]: pgmap v347: 97 pgs: 97 active+clean; 591 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-06-06T08:40:40.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:39 smithi037 ceph-mon[36609]: pgmap v347: 97 pgs: 97 active+clean; 591 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-06-06T08:40:40.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:39 smithi059 ceph-mon[36684]: pgmap v347: 97 pgs: 97 active+clean; 591 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-06-06T08:40:40.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.897+0000 7ff44ae00700 1 -- 172.21.15.28:0/1733009608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff444109390 msgr2=0x7ff444115830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:40.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.897+0000 7ff44ae00700 1 --2- 172.21.15.28:0/1733009608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff444109390 0x7ff444115830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009990 tx=0x7ff43c009ca0 comp rx=0 tx=0).stop 2024-06-06T08:40:40.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.897+0000 7ff44ae00700 1 -- 172.21.15.28:0/1733009608 shutdown_connections 2024-06-06T08:40:40.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.897+0000 7ff44ae00700 1 --2- 172.21.15.28:0/1733009608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff444109390 0x7ff444115830 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:40.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.897+0000 7ff44ae00700 1 --2- 172.21.15.28:0/1733009608 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff44410d8a0 0x7ff44410dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:40.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.897+0000 7ff44ae00700 1 --2- 172.21.15.28:0/1733009608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4441089d0 0x7ff444108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:40.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.897+0000 7ff44ae00700 1 -- 172.21.15.28:0/1733009608 >> 172.21.15.28:0/1733009608 conn(0x7ff444078220 msgr2=0x7ff4441072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:40.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.897+0000 7ff44ae00700 1 -- 172.21.15.28:0/1733009608 shutdown_connections 2024-06-06T08:40:40.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.897+0000 7ff44ae00700 1 -- 172.21.15.28:0/1733009608 wait complete. 2024-06-06T08:40:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.898+0000 7ff44ae00700 1 Processor -- start 2024-06-06T08:40:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.898+0000 7ff44ae00700 1 -- start start 2024-06-06T08:40:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.899+0000 7ff44ae00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4441089d0 0x7ff44419f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.899+0000 7ff44ae00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff444109390 0x7ff44419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.899+0000 7ff44ae00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff44410d8a0 0x7ff4441a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.899+0000 7ff44ae00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff444118d20 con 0x7ff4441089d0 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.899+0000 7ff44ae00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff444118ba0 con 0x7ff44410d8a0 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.899+0000 7ff44ae00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff444118ea0 con 0x7ff444109390 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.899+0000 7ff449000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff444109390 0x7ff44419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.899+0000 7ff449000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff444109390 0x7ff44419f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:32972/0 (socket says 172.21.15.28:32972) 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.899+0000 7ff449000700 1 -- 172.21.15.28:0/1473810083 learned_addr learned my addr 172.21.15.28:0/1473810083 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.899+0000 7ff449a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4441089d0 0x7ff44419f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.899+0000 7ff44a400700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff44410d8a0 0x7ff4441a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.900+0000 7ff449000700 1 -- 172.21.15.28:0/1473810083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff44410d8a0 msgr2=0x7ff4441a3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.900+0000 7ff449000700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff44410d8a0 0x7ff4441a3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.900+0000 7ff449000700 1 -- 172.21.15.28:0/1473810083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4441089d0 msgr2=0x7ff44419f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:40.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.900+0000 7ff449000700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4441089d0 0x7ff44419f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:40.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.900+0000 7ff449000700 1 -- 172.21.15.28:0/1473810083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4441a4140 con 0x7ff444109390 2024-06-06T08:40:40.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.900+0000 7ff449000700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff444109390 0x7ff44419f670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff43000e9c0 tx=0x7ff43000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:40.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.900+0000 7ff442000700 1 -- 172.21.15.28:0/1473810083 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43000cbd0 con 0x7ff444109390 2024-06-06T08:40:40.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.900+0000 7ff44ae00700 1 -- 172.21.15.28:0/1473810083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4441a4430 con 0x7ff444109390 2024-06-06T08:40:40.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.900+0000 7ff442000700 1 -- 172.21.15.28:0/1473810083 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff43000ee60 con 0x7ff444109390 2024-06-06T08:40:40.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.901+0000 7ff442000700 1 -- 172.21.15.28:0/1473810083 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430005630 con 0x7ff444109390 2024-06-06T08:40:40.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.901+0000 7ff44ae00700 1 -- 172.21.15.28:0/1473810083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4441abcb0 con 0x7ff444109390 2024-06-06T08:40:40.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.902+0000 7ff44ae00700 1 -- 172.21.15.28:0/1473810083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff444069180 con 0x7ff444109390 2024-06-06T08:40:40.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.904+0000 7ff442000700 1 -- 172.21.15.28:0/1473810083 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff430044b60 con 0x7ff444109390 2024-06-06T08:40:40.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.906+0000 7ff442000700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff4280a2d30 0x7ff4280a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:40.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.906+0000 7ff442000700 1 -- 172.21.15.28:0/1473810083 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8248+0+0 (secure 0 0 0) 0x7ff4300cf420 con 0x7ff444109390 2024-06-06T08:40:40.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.906+0000 7ff449a00700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff4280a2d30 0x7ff4280a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:40.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.907+0000 7ff449a00700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff4280a2d30 0x7ff4280a51f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff43400f540 tx=0x7ff43400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:40.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:40.908+0000 7ff442000700 1 -- 172.21.15.28:0/1473810083 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff43009c1b0 con 0x7ff444109390 2024-06-06T08:40:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-06-06T08:40:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [5, 8]}]: dispatch 2024-06-06T08:40:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-06-06T08:40:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-06-06T08:40:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]: dispatch 2024-06-06T08:40:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1f", "id": [1, 2]}]: dispatch 2024-06-06T08:40:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-06-06T08:40:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]: dispatch 2024-06-06T08:40:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-06-06T08:40:41.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-06-06T08:40:41.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [5, 8]}]: dispatch 2024-06-06T08:40:41.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-06-06T08:40:41.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-06-06T08:40:41.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]: dispatch 2024-06-06T08:40:41.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1f", "id": [1, 2]}]: dispatch 2024-06-06T08:40:41.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-06-06T08:40:41.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]: dispatch 2024-06-06T08:40:41.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-06-06T08:40:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-06-06T08:40:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [5, 8]}]: dispatch 2024-06-06T08:40:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-06-06T08:40:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-06-06T08:40:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]: dispatch 2024-06-06T08:40:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1f", "id": [1, 2]}]: dispatch 2024-06-06T08:40:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-06-06T08:40:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]: dispatch 2024-06-06T08:40:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-06-06T08:40:41.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.180+0000 7ff44ae00700 1 -- 172.21.15.28:0/1473810083 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7ff4440628d0 con 0x7ff4280a2d30 2024-06-06T08:40:41.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.189+0000 7ff442000700 1 -- 172.21.15.28:0/1473810083 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ff4440628d0 con 0x7ff4280a2d30 2024-06-06T08:40:41.188 INFO:teuthology.orchestra.run.smithi028.stdout:/volumes/qa/sv_0/8e67cc8f-0745-4ab2-ac49-7bf92ec731d8 2024-06-06T08:40:41.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 -- 172.21.15.28:0/1473810083 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff4280a2d30 msgr2=0x7ff4280a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:41.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff4280a2d30 0x7ff4280a51f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff43400f540 tx=0x7ff43400b040 comp rx=0 tx=0).stop 2024-06-06T08:40:41.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 -- 172.21.15.28:0/1473810083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff444109390 msgr2=0x7ff44419f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:41.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff444109390 0x7ff44419f670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff43000e9c0 tx=0x7ff43000ecd0 comp rx=0 tx=0).stop 2024-06-06T08:40:41.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 -- 172.21.15.28:0/1473810083 shutdown_connections 2024-06-06T08:40:41.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff4280a2d30 0x7ff4280a51f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:41.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff44410d8a0 0x7ff4441a3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:41.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4441089d0 0x7ff44419f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:41.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 --2- 172.21.15.28:0/1473810083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff444109390 0x7ff44419f670 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:41.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 -- 172.21.15.28:0/1473810083 >> 172.21.15.28:0/1473810083 conn(0x7ff444078220 msgr2=0x7ff444078760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:41.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 -- 172.21.15.28:0/1473810083 shutdown_connections 2024-06-06T08:40:41.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:41.192+0000 7ff44ae00700 1 -- 172.21.15.28:0/1473810083 wait complete. 2024-06-06T08:40:41.952 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:41 smithi028 ceph-mon[31564]: pgmap v348: 97 pgs: 97 active+clean; 605 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-06-06T08:40:41.952 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-06-06T08:40:41.953 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [5, 8]}]': finished 2024-06-06T08:40:41.953 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-06-06T08:40:41.953 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-06-06T08:40:41.953 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]': finished 2024-06-06T08:40:41.953 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1f", "id": [1, 2]}]': finished 2024-06-06T08:40:41.953 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-06-06T08:40:41.953 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2024-06-06T08:40:41.953 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-06-06T08:40:41.953 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:41 smithi028 ceph-mon[31564]: osdmap e89: 12 total, 12 up, 12 in 2024-06-06T08:40:42.004 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-06-06T08:40:42.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:41 smithi037 ceph-mon[36609]: pgmap v348: 97 pgs: 97 active+clean; 605 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-06-06T08:40:42.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-06-06T08:40:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [5, 8]}]': finished 2024-06-06T08:40:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-06-06T08:40:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-06-06T08:40:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]': finished 2024-06-06T08:40:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1f", "id": [1, 2]}]': finished 2024-06-06T08:40:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-06-06T08:40:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2024-06-06T08:40:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-06-06T08:40:42.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:41 smithi037 ceph-mon[36609]: osdmap e89: 12 total, 12 up, 12 in 2024-06-06T08:40:42.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:41 smithi059 ceph-mon[36684]: pgmap v348: 97 pgs: 97 active+clean; 605 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-06-06T08:40:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-06-06T08:40:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [5, 8]}]': finished 2024-06-06T08:40:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-06-06T08:40:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-06-06T08:40:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]': finished 2024-06-06T08:40:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1f", "id": [1, 2]}]': finished 2024-06-06T08:40:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-06-06T08:40:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2024-06-06T08:40:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-06-06T08:40:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:41 smithi059 ceph-mon[36684]: osdmap e89: 12 total, 12 up, 12 in 2024-06-06T08:40:42.456 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:42.873 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:42 smithi028 ceph-mon[31564]: from='client.24619 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:42.873 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:42 smithi028 ceph-mon[31564]: osdmap e90: 12 total, 12 up, 12 in 2024-06-06T08:40:43.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:42 smithi037 ceph-mon[36609]: from='client.24619 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:43.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:42 smithi037 ceph-mon[36609]: osdmap e90: 12 total, 12 up, 12 in 2024-06-06T08:40:43.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:42 smithi059 ceph-mon[36684]: from='client.24619 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:43.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:42 smithi059 ceph-mon[36684]: osdmap e90: 12 total, 12 up, 12 in 2024-06-06T08:40:43.927 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:43 smithi028 ceph-mon[31564]: pgmap v351: 97 pgs: 5 activating, 92 active+clean; 605 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-06-06T08:40:44.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:43 smithi037 ceph-mon[36609]: pgmap v351: 97 pgs: 5 activating, 92 active+clean; 605 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-06-06T08:40:44.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:43 smithi059 ceph-mon[36684]: pgmap v351: 97 pgs: 5 activating, 92 active+clean; 605 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-06-06T08:40:44.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.802+0000 7f1b6fc00700 1 -- 172.21.15.28:0/3619934253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6810ee90 msgr2=0x7f1b68111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:44.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.802+0000 7f1b6fc00700 1 --2- 172.21.15.28:0/3619934253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6810ee90 0x7f1b68111280 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000b0a0 tx=0x7f1b6000b3b0 comp rx=0 tx=0).stop 2024-06-06T08:40:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.802+0000 7f1b6fc00700 1 -- 172.21.15.28:0/3619934253 shutdown_connections 2024-06-06T08:40:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.802+0000 7f1b6fc00700 1 --2- 172.21.15.28:0/3619934253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6810ee90 0x7f1b68111280 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.802+0000 7f1b6fc00700 1 --2- 172.21.15.28:0/3619934253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b680746c0 0x7f1b68074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.802+0000 7f1b6fc00700 1 --2- 172.21.15.28:0/3619934253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b68074fe0 0x7f1b6810e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.802+0000 7f1b6fc00700 1 -- 172.21.15.28:0/3619934253 >> 172.21.15.28:0/3619934253 conn(0x7f1b680795f0 msgr2=0x7f1b68079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.802+0000 7f1b6fc00700 1 -- 172.21.15.28:0/3619934253 shutdown_connections 2024-06-06T08:40:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.802+0000 7f1b6fc00700 1 -- 172.21.15.28:0/3619934253 wait complete. 2024-06-06T08:40:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.804+0000 7f1b6fc00700 1 Processor -- start 2024-06-06T08:40:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.804+0000 7f1b6fc00700 1 -- start start 2024-06-06T08:40:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.804+0000 7f1b6fc00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b680746c0 0x7f1b6819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.804+0000 7f1b6fc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b68074fe0 0x7f1b6819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.804+0000 7f1b6fc00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6810ee90 0x7f1b6819f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.804+0000 7f1b6fc00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b681149d0 con 0x7f1b68074fe0 2024-06-06T08:40:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.804+0000 7f1b6fc00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68114850 con 0x7f1b680746c0 2024-06-06T08:40:44.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.804+0000 7f1b6fc00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68114b50 con 0x7f1b6810ee90 2024-06-06T08:40:44.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.804+0000 7f1b67e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b68074fe0 0x7f1b6819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:44.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.804+0000 7f1b6d200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b680746c0 0x7f1b6819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:44.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.804+0000 7f1b6d200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b680746c0 0x7f1b6819ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:34088/0 (socket says 172.21.15.28:34088) 2024-06-06T08:40:44.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.805+0000 7f1b6d200700 1 -- 172.21.15.28:0/270052771 learned_addr learned my addr 172.21.15.28:0/270052771 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:44.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.805+0000 7f1b6dc00700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6810ee90 0x7f1b6819f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.805+0000 7f1b6d200700 1 -- 172.21.15.28:0/270052771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6810ee90 msgr2=0x7f1b6819f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.805+0000 7f1b6d200700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6810ee90 0x7f1b6819f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.805+0000 7f1b6d200700 1 -- 172.21.15.28:0/270052771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b68074fe0 msgr2=0x7f1b6819b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.805+0000 7f1b6d200700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b68074fe0 0x7f1b6819b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.805+0000 7f1b6d200700 1 -- 172.21.15.28:0/270052771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6819fdb0 con 0x7f1b680746c0 2024-06-06T08:40:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.805+0000 7f1b67e00700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b68074fe0 0x7f1b6819b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:40:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.805+0000 7f1b6d200700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b680746c0 0x7f1b6819ada0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00e9a0 tx=0x7f1b5c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.806+0000 7f1b65600700 1 -- 172.21.15.28:0/270052771 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00ca10 con 0x7f1b680746c0 2024-06-06T08:40:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.806+0000 7f1b65600700 1 -- 172.21.15.28:0/270052771 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b5c00cbb0 con 0x7f1b680746c0 2024-06-06T08:40:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.806+0000 7f1b6fc00700 1 -- 172.21.15.28:0/270052771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b681a00a0 con 0x7f1b680746c0 2024-06-06T08:40:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.806+0000 7f1b65600700 1 -- 172.21.15.28:0/270052771 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c018680 con 0x7f1b680746c0 2024-06-06T08:40:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.806+0000 7f1b6fc00700 1 -- 172.21.15.28:0/270052771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b681a7920 con 0x7f1b680746c0 2024-06-06T08:40:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.807+0000 7f1b6fc00700 1 -- 172.21.15.28:0/270052771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b68069180 con 0x7f1b680746c0 2024-06-06T08:40:44.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.809+0000 7f1b65600700 1 -- 172.21.15.28:0/270052771 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1b5c010430 con 0x7f1b680746c0 2024-06-06T08:40:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.810+0000 7f1b65600700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1b500a2cb0 0x7f1b500a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.811+0000 7f1b65600700 1 -- 172.21.15.28:0/270052771 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7f1b5c0cf480 con 0x7f1b680746c0 2024-06-06T08:40:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.811+0000 7f1b67e00700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1b500a2cb0 0x7f1b500a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:44.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.811+0000 7f1b67e00700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1b500a2cb0 0x7f1b500a5170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b68110a50 tx=0x7f1b54007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:44.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:44.815+0000 7f1b65600700 1 -- 172.21.15.28:0/270052771 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1b5c09c210 con 0x7f1b680746c0 2024-06-06T08:40:45.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.084+0000 7f1b6fc00700 1 -- 172.21.15.28:0/270052771 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1b680ffcd0 con 0x7f1b500a2cb0 2024-06-06T08:40:45.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.124+0000 7f1b65600700 1 -- 172.21.15.28:0/270052771 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1b680ffcd0 con 0x7f1b500a2cb0 2024-06-06T08:40:45.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 -- 172.21.15.28:0/270052771 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1b500a2cb0 msgr2=0x7f1b500a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:45.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1b500a2cb0 0x7f1b500a5170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b68110a50 tx=0x7f1b54007400 comp rx=0 tx=0).stop 2024-06-06T08:40:45.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 -- 172.21.15.28:0/270052771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b680746c0 msgr2=0x7f1b6819ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:45.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b680746c0 0x7f1b6819ada0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00e9a0 tx=0x7f1b5c00ecb0 comp rx=0 tx=0).stop 2024-06-06T08:40:45.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 -- 172.21.15.28:0/270052771 shutdown_connections 2024-06-06T08:40:45.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1b500a2cb0 0x7f1b500a5170 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:45.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6810ee90 0x7f1b6819f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:45.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b680746c0 0x7f1b6819ada0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:45.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 --2- 172.21.15.28:0/270052771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b68074fe0 0x7f1b6819b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:45.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 -- 172.21.15.28:0/270052771 >> 172.21.15.28:0/270052771 conn(0x7f1b680795f0 msgr2=0x7f1b680ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:45.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 -- 172.21.15.28:0/270052771 shutdown_connections 2024-06-06T08:40:45.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:45.128+0000 7f1b6fc00700 1 -- 172.21.15.28:0/270052771 wait complete. 2024-06-06T08:40:45.952 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-06-06T08:40:46.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:45 smithi028 ceph-mon[31564]: pgmap v352: 97 pgs: 5 activating, 92 active+clean; 605 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-06-06T08:40:46.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:45 smithi037 ceph-mon[36609]: pgmap v352: 97 pgs: 5 activating, 92 active+clean; 605 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-06-06T08:40:46.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:45 smithi059 ceph-mon[36684]: pgmap v352: 97 pgs: 5 activating, 92 active+clean; 605 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-06-06T08:40:46.395 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:46.865 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:46 smithi028 ceph-mon[31564]: from='client.24638 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:47.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:46 smithi037 ceph-mon[36609]: from='client.24638 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:47.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:46 smithi059 ceph-mon[36684]: from='client.24638 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:47.975 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:47 smithi028 ceph-mon[31564]: pgmap v353: 97 pgs: 5 activating, 92 active+clean; 611 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-06-06T08:40:48.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:47 smithi037 ceph-mon[36609]: pgmap v353: 97 pgs: 5 activating, 92 active+clean; 611 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-06-06T08:40:48.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:47 smithi059 ceph-mon[36684]: pgmap v353: 97 pgs: 5 activating, 92 active+clean; 611 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2024-06-06T08:40:48.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.579+0000 7fec01e00700 1 -- 172.21.15.28:0/2992720707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febfc10ee90 msgr2=0x7febfc111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:48.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.579+0000 7fec01e00700 1 --2- 172.21.15.28:0/2992720707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febfc10ee90 0x7febfc111280 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7febf4009f90 tx=0x7febf400b330 comp rx=0 tx=0).stop 2024-06-06T08:40:48.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.579+0000 7fec01e00700 1 -- 172.21.15.28:0/2992720707 shutdown_connections 2024-06-06T08:40:48.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.579+0000 7fec01e00700 1 --2- 172.21.15.28:0/2992720707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febfc10ee90 0x7febfc111280 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:48.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.579+0000 7fec01e00700 1 --2- 172.21.15.28:0/2992720707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febfc0746c0 0x7febfc074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:48.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.579+0000 7fec01e00700 1 --2- 172.21.15.28:0/2992720707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febfc074fe0 0x7febfc10e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:48.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.579+0000 7fec01e00700 1 -- 172.21.15.28:0/2992720707 >> 172.21.15.28:0/2992720707 conn(0x7febfc0795f0 msgr2=0x7febfc079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:48.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.579+0000 7fec01e00700 1 -- 172.21.15.28:0/2992720707 shutdown_connections 2024-06-06T08:40:48.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.579+0000 7fec01e00700 1 -- 172.21.15.28:0/2992720707 wait complete. 2024-06-06T08:40:48.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.580+0000 7fec01e00700 1 Processor -- start 2024-06-06T08:40:48.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.581+0000 7fec01e00700 1 -- start start 2024-06-06T08:40:48.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.581+0000 7fec01e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febfc0746c0 0x7febfc19ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:48.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.581+0000 7fec01e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febfc074fe0 0x7febfc19b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:48.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.581+0000 7fec01e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febfc10ee90 0x7febfc19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:48.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.581+0000 7fec01e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7febfc114970 con 0x7febfc074fe0 2024-06-06T08:40:48.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.581+0000 7fec01e00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1147f0 con 0x7febfc0746c0 2024-06-06T08:40:48.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.581+0000 7fec01e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7febfc114af0 con 0x7febfc10ee90 2024-06-06T08:40:48.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.581+0000 7febf2000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febfc074fe0 0x7febfc19b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:48.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.581+0000 7febf2000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febfc074fe0 0x7febfc19b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44238/0 (socket says 172.21.15.28:44238) 2024-06-06T08:40:48.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.581+0000 7febf2000700 1 -- 172.21.15.28:0/3834689977 learned_addr learned my addr 172.21.15.28:0/3834689977 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:48.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.581+0000 7febfaa00700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febfc0746c0 0x7febfc19ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:48.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.582+0000 7febfb400700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febfc10ee90 0x7febfc19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.582+0000 7febf2000700 1 -- 172.21.15.28:0/3834689977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febfc10ee90 msgr2=0x7febfc19f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.582+0000 7febf2000700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febfc10ee90 0x7febfc19f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.582+0000 7febf2000700 1 -- 172.21.15.28:0/3834689977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febfc0746c0 msgr2=0x7febfc19ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.582+0000 7febf2000700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febfc0746c0 0x7febfc19ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.582+0000 7febf2000700 1 -- 172.21.15.28:0/3834689977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc19fd50 con 0x7febfc074fe0 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.582+0000 7febfaa00700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febfc0746c0 0x7febfc19ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.582+0000 7febf2000700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febfc074fe0 0x7febfc19b280 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7febe400e970 tx=0x7febe400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.583+0000 7fec00a00700 1 -- 172.21.15.28:0/3834689977 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4004220 con 0x7febfc074fe0 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.583+0000 7fec00a00700 1 -- 172.21.15.28:0/3834689977 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febe40043c0 con 0x7febfc074fe0 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.583+0000 7fec01e00700 1 -- 172.21.15.28:0/3834689977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febfc1a0040 con 0x7febfc074fe0 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.583+0000 7fec00a00700 1 -- 172.21.15.28:0/3834689977 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4003dc0 con 0x7febfc074fe0 2024-06-06T08:40:48.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.583+0000 7fec01e00700 1 -- 172.21.15.28:0/3834689977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febfc1a78c0 con 0x7febfc074fe0 2024-06-06T08:40:48.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.584+0000 7fec01e00700 1 -- 172.21.15.28:0/3834689977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febfc069180 con 0x7febfc074fe0 2024-06-06T08:40:48.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.586+0000 7fec00a00700 1 -- 172.21.15.28:0/3834689977 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7febe400c7c0 con 0x7febfc074fe0 2024-06-06T08:40:48.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.587+0000 7fec00a00700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7febe00a2cb0 0x7febe00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:48.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.587+0000 7fec00a00700 1 -- 172.21.15.28:0/3834689977 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7febe40cf470 con 0x7febfc074fe0 2024-06-06T08:40:48.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.588+0000 7febfaa00700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7febe00a2cb0 0x7febe00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:48.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.588+0000 7febfaa00700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7febe00a2cb0 0x7febe00a5170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7febec005fd0 tx=0x7febec009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:48.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.592+0000 7fec00a00700 1 -- 172.21.15.28:0/3834689977 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7febe409c200 con 0x7febfc074fe0 2024-06-06T08:40:48.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.861+0000 7fec01e00700 1 -- 172.21.15.28:0/3834689977 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7febfc0ffcd0 con 0x7febe00a2cb0 2024-06-06T08:40:48.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.872+0000 7fec00a00700 1 -- 172.21.15.28:0/3834689977 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7febfc0ffcd0 con 0x7febe00a2cb0 2024-06-06T08:40:48.871 INFO:teuthology.orchestra.run.smithi028.stdout:/volumes/qa/sv_1/fe5454d2-b0dd-4679-8348-9b7b133b61ff 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.875+0000 7fec01e00700 1 -- 172.21.15.28:0/3834689977 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7febe00a2cb0 msgr2=0x7febe00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.875+0000 7fec01e00700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7febe00a2cb0 0x7febe00a5170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7febec005fd0 tx=0x7febec009310 comp rx=0 tx=0).stop 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.875+0000 7fec01e00700 1 -- 172.21.15.28:0/3834689977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febfc074fe0 msgr2=0x7febfc19b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.875+0000 7fec01e00700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febfc074fe0 0x7febfc19b280 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7febe400e970 tx=0x7febe400ec80 comp rx=0 tx=0).stop 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.876+0000 7fec01e00700 1 -- 172.21.15.28:0/3834689977 shutdown_connections 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.876+0000 7fec01e00700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7febe00a2cb0 0x7febe00a5170 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.876+0000 7fec01e00700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febfc10ee90 0x7febfc19f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.876+0000 7fec01e00700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febfc0746c0 0x7febfc19ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.876+0000 7fec01e00700 1 --2- 172.21.15.28:0/3834689977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febfc074fe0 0x7febfc19b280 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.876+0000 7fec01e00700 1 -- 172.21.15.28:0/3834689977 >> 172.21.15.28:0/3834689977 conn(0x7febfc0795f0 msgr2=0x7febfc0ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.876+0000 7fec01e00700 1 -- 172.21.15.28:0/3834689977 shutdown_connections 2024-06-06T08:40:48.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:48.876+0000 7fec01e00700 1 -- 172.21.15.28:0/3834689977 wait complete. 2024-06-06T08:40:49.839 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:40:50.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:49 smithi028 ceph-mon[31564]: pgmap v354: 97 pgs: 97 active+clean; 611 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-06-06T08:40:50.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:49 smithi028 ceph-mon[31564]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:50.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:49 smithi037 ceph-mon[36609]: pgmap v354: 97 pgs: 97 active+clean; 611 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-06-06T08:40:50.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:49 smithi037 ceph-mon[36609]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:50.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:49 smithi059 ceph-mon[36684]: pgmap v354: 97 pgs: 97 active+clean; 611 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-06-06T08:40:50.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:49 smithi059 ceph-mon[36684]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:40:50.319 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:51.957 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:51 smithi028 ceph-mon[31564]: pgmap v355: 97 pgs: 97 active+clean; 632 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-06-06T08:40:51.957 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:51 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:40:52.062 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:51 smithi059 ceph-mon[36684]: pgmap v355: 97 pgs: 97 active+clean; 632 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-06-06T08:40:52.062 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:51 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:40:52.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:51 smithi037 ceph-mon[36609]: pgmap v355: 97 pgs: 97 active+clean; 632 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-06-06T08:40:52.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:51 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:40:52.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.482+0000 7f3e05000700 1 -- 172.21.15.28:0/1186952888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e000746c0 msgr2=0x7f3e00074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:52.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.482+0000 7f3e05000700 1 --2- 172.21.15.28:0/1186952888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e000746c0 0x7f3e00074aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009990 tx=0x7f3df0009ca0 comp rx=0 tx=0).stop 2024-06-06T08:40:52.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.482+0000 7f3e05000700 1 -- 172.21.15.28:0/1186952888 shutdown_connections 2024-06-06T08:40:52.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.482+0000 7f3e05000700 1 --2- 172.21.15.28:0/1186952888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0010ee90 0x7f3e00111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:52.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.482+0000 7f3e05000700 1 --2- 172.21.15.28:0/1186952888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e000746c0 0x7f3e00074aa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:52.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.482+0000 7f3e05000700 1 --2- 172.21.15.28:0/1186952888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e00074fe0 0x7f3e0010e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:52.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.482+0000 7f3e05000700 1 -- 172.21.15.28:0/1186952888 >> 172.21.15.28:0/1186952888 conn(0x7f3e000795f0 msgr2=0x7f3e00079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:52.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.482+0000 7f3e05000700 1 -- 172.21.15.28:0/1186952888 shutdown_connections 2024-06-06T08:40:52.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.482+0000 7f3e05000700 1 -- 172.21.15.28:0/1186952888 wait complete. 2024-06-06T08:40:52.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.483+0000 7f3e05000700 1 Processor -- start 2024-06-06T08:40:52.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.484+0000 7f3e05000700 1 -- start start 2024-06-06T08:40:52.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.484+0000 7f3e05000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e000746c0 0x7f3e0019add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:52.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.484+0000 7f3e05000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e00074fe0 0x7f3e0019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:52.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.484+0000 7f3e05000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0010ee90 0x7f3e0019f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.484+0000 7f3e05000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e001149c0 con 0x7f3e00074fe0 2024-06-06T08:40:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.484+0000 7f3e05000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e00114840 con 0x7f3e0010ee90 2024-06-06T08:40:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.484+0000 7f3e05000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e00114b40 con 0x7f3e000746c0 2024-06-06T08:40:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.485+0000 7f3dfde00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e000746c0 0x7f3e0019add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.485+0000 7f3df7e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e00074fe0 0x7f3e0019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.485+0000 7f3dfe800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0010ee90 0x7f3e0019f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.485+0000 7f3dfde00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e000746c0 0x7f3e0019add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:34738/0 (socket says 172.21.15.28:34738) 2024-06-06T08:40:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.485+0000 7f3dfde00700 1 -- 172.21.15.28:0/1694559329 learned_addr learned my addr 172.21.15.28:0/1694559329 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:52.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.485+0000 7f3dfe800700 1 -- 172.21.15.28:0/1694559329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e000746c0 msgr2=0x7f3e0019add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:52.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.485+0000 7f3dfe800700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e000746c0 0x7f3e0019add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:52.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.485+0000 7f3dfe800700 1 -- 172.21.15.28:0/1694559329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e00074fe0 msgr2=0x7f3e0019b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:52.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.485+0000 7f3dfe800700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e00074fe0 0x7f3e0019b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:52.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.485+0000 7f3dfe800700 1 -- 172.21.15.28:0/1694559329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0019fde0 con 0x7f3e0010ee90 2024-06-06T08:40:52.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.485+0000 7f3dfe800700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0010ee90 0x7f3e0019f6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e0006b9f0 tx=0x7f3df800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:52.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.486+0000 7f3df6a00700 1 -- 172.21.15.28:0/1694559329 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8003a00 con 0x7f3e0010ee90 2024-06-06T08:40:52.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.486+0000 7f3df6a00700 1 -- 172.21.15.28:0/1694559329 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3df8003ba0 con 0x7f3e0010ee90 2024-06-06T08:40:52.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.486+0000 7f3e05000700 1 -- 172.21.15.28:0/1694559329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e001a00d0 con 0x7f3e0010ee90 2024-06-06T08:40:52.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.486+0000 7f3df6a00700 1 -- 172.21.15.28:0/1694559329 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df80047b0 con 0x7f3e0010ee90 2024-06-06T08:40:52.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.486+0000 7f3e05000700 1 -- 172.21.15.28:0/1694559329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e001024e0 con 0x7f3e0010ee90 2024-06-06T08:40:52.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.487+0000 7f3e05000700 1 -- 172.21.15.28:0/1694559329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e00069180 con 0x7f3e0010ee90 2024-06-06T08:40:52.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.489+0000 7f3df6a00700 1 -- 172.21.15.28:0/1694559329 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3df8012050 con 0x7f3e0010ee90 2024-06-06T08:40:52.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.490+0000 7f3df6a00700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3de40a2cb0 0x7f3de40a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:52.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.490+0000 7f3df6a00700 1 -- 172.21.15.28:0/1694559329 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7f3df80ceaf0 con 0x7f3e0010ee90 2024-06-06T08:40:52.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.491+0000 7f3dfde00700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3de40a2cb0 0x7f3de40a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:52.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.491+0000 7f3dfde00700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3de40a2cb0 0x7f3de40a5170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3df000b2e0 tx=0x7f3df0022040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:52.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.495+0000 7f3df6a00700 1 -- 172.21.15.28:0/1694559329 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3df8022060 con 0x7f3e0010ee90 2024-06-06T08:40:52.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.788+0000 7f3e05000700 1 -- 172.21.15.28:0/1694559329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e00102740 con 0x7f3e0010ee90 2024-06-06T08:40:52.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.789+0000 7f3df6a00700 1 -- 172.21.15.28:0/1694559329 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11909 (secure 0 0 0) 0x7f3df8010040 con 0x7f3e0010ee90 2024-06-06T08:40:52.788 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:40:52.789 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T08:40:05.416261+0000","modified":"2024-06-06T08:40:29.442708+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24542,"mds_1":24503,"mds_2":24499,"mds_3":24485,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14388":{"gid":14388,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6839/735176440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":735176440},{"type":"v1","addr":"172.21.15.28:6839","nonce":735176440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14400":{"gid":14400,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6841/3192274308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":3192274308},{"type":"v1","addr":"172.21.15.28:6841","nonce":3192274308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6839/771325139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":771325139},{"type":"v1","addr":"172.21.15.59:6839","nonce":771325139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.37:6839/527311102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":527311102},{"type":"v1","addr":"172.21.15.37:6839","nonce":527311102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24499,24485,24484,24503,24542]},"id":1}]} 2024-06-06T08:40:52.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 -- 172.21.15.28:0/1694559329 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3de40a2cb0 msgr2=0x7f3de40a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:52.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3de40a2cb0 0x7f3de40a5170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3df000b2e0 tx=0x7f3df0022040 comp rx=0 tx=0).stop 2024-06-06T08:40:52.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 -- 172.21.15.28:0/1694559329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0010ee90 msgr2=0x7f3e0019f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:52.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0010ee90 0x7f3e0019f6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e0006b9f0 tx=0x7f3df800c3a0 comp rx=0 tx=0).stop 2024-06-06T08:40:52.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 -- 172.21.15.28:0/1694559329 shutdown_connections 2024-06-06T08:40:52.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3de40a2cb0 0x7f3de40a5170 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:52.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0010ee90 0x7f3e0019f6a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:52.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e000746c0 0x7f3e0019add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:52.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 --2- 172.21.15.28:0/1694559329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e00074fe0 0x7f3e0019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:52.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 -- 172.21.15.28:0/1694559329 >> 172.21.15.28:0/1694559329 conn(0x7f3e000795f0 msgr2=0x7f3e001005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:52.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 -- 172.21.15.28:0/1694559329 shutdown_connections 2024-06-06T08:40:52.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:52.793+0000 7f3e05000700 1 -- 172.21.15.28:0/1694559329 wait complete. 2024-06-06T08:40:52.793 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 28 2024-06-06T08:40:53.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:52 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1694559329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:40:53.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:52 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1694559329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:40:53.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:52 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1694559329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:40:54.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:53 smithi037 ceph-mon[36609]: pgmap v356: 97 pgs: 97 active+clean; 632 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-06-06T08:40:54.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:53 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.079 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:53 smithi028 ceph-mon[31564]: pgmap v356: 97 pgs: 97 active+clean; 632 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-06-06T08:40:54.079 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.079 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.079 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.079 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:53 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.084 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T08:40:54.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:53 smithi059 ceph-mon[36684]: pgmap v356: 97 pgs: 97 active+clean; 632 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-06-06T08:40:54.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:53 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:56.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:55 smithi028 ceph-mon[31564]: pgmap v357: 97 pgs: 97 active+clean; 632 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-06-06T08:40:56.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:55 smithi059 ceph-mon[36684]: pgmap v357: 97 pgs: 97 active+clean; 632 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-06-06T08:40:56.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:55 smithi037 ceph-mon[36609]: pgmap v357: 97 pgs: 97 active+clean; 632 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-06-06T08:40:56.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.902+0000 7f43f9a00700 1 -- 172.21.15.28:0/2708734847 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43f41084e0 msgr2=0x7f43f41088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:56.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.902+0000 7f43f9a00700 1 --2- 172.21.15.28:0/2708734847 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43f41084e0 0x7f43f41088c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f43e40099c0 tx=0x7f43e4009cd0 comp rx=0 tx=0).stop 2024-06-06T08:40:56.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.902+0000 7f43f9a00700 1 -- 172.21.15.28:0/2708734847 shutdown_connections 2024-06-06T08:40:56.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.902+0000 7f43f9a00700 1 --2- 172.21.15.28:0/2708734847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43f406ab10 0x7f43f410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:56.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.902+0000 7f43f9a00700 1 --2- 172.21.15.28:0/2708734847 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43f41084e0 0x7f43f41088c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:56.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.902+0000 7f43f9a00700 1 --2- 172.21.15.28:0/2708734847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f406a170 0x7f43f406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:56.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.902+0000 7f43f9a00700 1 -- 172.21.15.28:0/2708734847 >> 172.21.15.28:0/2708734847 conn(0x7f43f40782c0 msgr2=0x7f43f40786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:56.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.902+0000 7f43f9a00700 1 -- 172.21.15.28:0/2708734847 shutdown_connections 2024-06-06T08:40:56.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.903+0000 7f43f9a00700 1 -- 172.21.15.28:0/2708734847 wait complete. 2024-06-06T08:40:56.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.904+0000 7f43f9a00700 1 Processor -- start 2024-06-06T08:40:56.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.904+0000 7f43f9a00700 1 -- start start 2024-06-06T08:40:56.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.904+0000 7f43f9a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f406a170 0x7f43f419aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.904+0000 7f43f9a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43f406ab10 0x7f43f419b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.904+0000 7f43f9a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43f41084e0 0x7f43f419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.904+0000 7f43f9a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f43f4112770 con 0x7f43f406ab10 2024-06-06T08:40:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.904+0000 7f43f9a00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f43f41125f0 con 0x7f43f406a170 2024-06-06T08:40:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.904+0000 7f43f9a00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43f41128f0 con 0x7f43f41084e0 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43f2a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f406a170 0x7f43f419aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43ebe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43f406ab10 0x7f43f419b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43f2a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f406a170 0x7f43f419aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:58932/0 (socket says 172.21.15.28:58932) 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43f3400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43f41084e0 0x7f43f419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43f2a00700 1 -- 172.21.15.28:0/1162933410 learned_addr learned my addr 172.21.15.28:0/1162933410 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43ebe00700 1 -- 172.21.15.28:0/1162933410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43f41084e0 msgr2=0x7f43f419f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43ebe00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43f41084e0 0x7f43f419f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43ebe00700 1 -- 172.21.15.28:0/1162933410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f406a170 msgr2=0x7f43f419aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43ebe00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f406a170 0x7f43f419aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43ebe00700 1 -- 172.21.15.28:0/1162933410 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f419fed0 con 0x7f43f406ab10 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43f2a00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f406a170 0x7f43f419aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:40:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.905+0000 7f43f3400700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43f41084e0 0x7f43f419f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:40:56.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.906+0000 7f43ebe00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43f406ab10 0x7f43f419b400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00e9f0 tx=0x7f43dc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:56.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.906+0000 7f43eb400700 1 -- 172.21.15.28:0/1162933410 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00c9c0 con 0x7f43f406ab10 2024-06-06T08:40:56.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.906+0000 7f43eb400700 1 -- 172.21.15.28:0/1162933410 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43dc00cb60 con 0x7f43f406ab10 2024-06-06T08:40:56.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.906+0000 7f43eb400700 1 -- 172.21.15.28:0/1162933410 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc018680 con 0x7f43f406ab10 2024-06-06T08:40:56.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.906+0000 7f43f9a00700 1 -- 172.21.15.28:0/1162933410 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f41a01c0 con 0x7f43f406ab10 2024-06-06T08:40:56.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.906+0000 7f43f9a00700 1 -- 172.21.15.28:0/1162933410 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f41a7a40 con 0x7f43f406ab10 2024-06-06T08:40:56.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.907+0000 7f43f9a00700 1 -- 172.21.15.28:0/1162933410 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f4069180 con 0x7f43f406ab10 2024-06-06T08:40:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.910+0000 7f43eb400700 1 -- 172.21.15.28:0/1162933410 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f43dc010430 con 0x7f43f406ab10 2024-06-06T08:40:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.911+0000 7f43eb400700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f43d80a2cb0 0x7f43d80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:40:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.911+0000 7f43eb400700 1 -- 172.21.15.28:0/1162933410 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7f43dc0cf4f0 con 0x7f43f406ab10 2024-06-06T08:40:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.912+0000 7f43f2a00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f43d80a2cb0 0x7f43d80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:40:56.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.913+0000 7f43f2a00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f43d80a2cb0 0x7f43d80a5170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009990 tx=0x7f43e4005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:40:56.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:56.914+0000 7f43eb400700 1 -- 172.21.15.28:0/1162933410 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f43dc09c280 con 0x7f43f406ab10 2024-06-06T08:40:57.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.148+0000 7f43f9a00700 1 -- 172.21.15.28:0/1162933410 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43f402dca0 con 0x7f43f406ab10 2024-06-06T08:40:57.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.152+0000 7f43eb400700 1 -- 172.21.15.28:0/1162933410 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22526 (secure 0 0 0) 0x7f43dc09bb80 con 0x7f43f406ab10 2024-06-06T08:40:57.189 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:40:57.189 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":90,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","created":"2024-06-06T08:30:30.991501+0000","modified":"2024-06-06T08:40:41.744831+0000","last_up_change":"2024-06-06T08:38:45.850887+0000","last_in_change":"2024-06-06T08:38:26.532528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T08:34:26.800168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T08:39:56.375661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T08:40:01.096994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7edaffea-7613-4d20-b9b8-108a17af8f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6803","nonce":2001709636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6805","nonce":2001709636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6809","nonce":2001709636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6807","nonce":2001709636}]},"public_addr":"172.21.15.28:6803/2001709636","cluster_addr":"172.21.15.28:6805/2001709636","heartbeat_back_addr":"172.21.15.28:6809/2001709636","heartbeat_front_addr":"172.21.15.28:6807/2001709636","state":["exists","up"]},{"osd":1,"uuid":"17eb7536-c2a4-4f8b-bec4-b1abb5125836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6801","nonce":593429648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6803","nonce":593429648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6807","nonce":593429648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6805","nonce":593429648}]},"public_addr":"172.21.15.37:6801/593429648","cluster_addr":"172.21.15.37:6803/593429648","heartbeat_back_addr":"172.21.15.37:6807/593429648","heartbeat_front_addr":"172.21.15.37:6805/593429648","state":["exists","up"]},{"osd":2,"uuid":"3ea64fd8-13f4-4d53-933b-07055ec72701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6801","nonce":88678886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6803","nonce":88678886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6807","nonce":88678886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6805","nonce":88678886}]},"public_addr":"172.21.15.59:6801/88678886","cluster_addr":"172.21.15.59:6803/88678886","heartbeat_back_addr":"172.21.15.59:6807/88678886","heartbeat_front_addr":"172.21.15.59:6805/88678886","state":["exists","up"]},{"osd":3,"uuid":"8be9cdb5-12a9-438e-b8cd-ce65988b0ac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6811","nonce":484290430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6813","nonce":484290430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6817","nonce":484290430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6815","nonce":484290430}]},"public_addr":"172.21.15.28:6811/484290430","cluster_addr":"172.21.15.28:6813/484290430","heartbeat_back_addr":"172.21.15.28:6817/484290430","heartbeat_front_addr":"172.21.15.28:6815/484290430","state":["exists","up"]},{"osd":4,"uuid":"ddea397d-d7b1-46f3-9a13-dd318cade055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6809","nonce":3596500266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6811","nonce":3596500266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6815","nonce":3596500266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6813","nonce":3596500266}]},"public_addr":"172.21.15.37:6809/3596500266","cluster_addr":"172.21.15.37:6811/3596500266","heartbeat_back_addr":"172.21.15.37:6815/3596500266","heartbeat_front_addr":"172.21.15.37:6813/3596500266","state":["exists","up"]},{"osd":5,"uuid":"ee19857b-b047-4d15-8b17-257b6e4966a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6809","nonce":3037648282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6811","nonce":3037648282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6815","nonce":3037648282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6813","nonce":3037648282}]},"public_addr":"172.21.15.59:6809/3037648282","cluster_addr":"172.21.15.59:6811/3037648282","heartbeat_back_addr":"172.21.15.59:6815/3037648282","heartbeat_front_addr":"172.21.15.59:6813/3037648282","state":["exists","up"]},{"osd":6,"uuid":"1d57d0ba-8e37-4ac2-87e8-40b20b24fc53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6819","nonce":3794924886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6821","nonce":3794924886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6825","nonce":3794924886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6823","nonce":3794924886}]},"public_addr":"172.21.15.28:6819/3794924886","cluster_addr":"172.21.15.28:6821/3794924886","heartbeat_back_addr":"172.21.15.28:6825/3794924886","heartbeat_front_addr":"172.21.15.28:6823/3794924886","state":["exists","up"]},{"osd":7,"uuid":"43f3c2c8-752d-4a70-99dd-2c14aeefa137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6817","nonce":724042860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6819","nonce":724042860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6823","nonce":724042860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6821","nonce":724042860}]},"public_addr":"172.21.15.37:6817/724042860","cluster_addr":"172.21.15.37:6819/724042860","heartbeat_back_addr":"172.21.15.37:6823/724042860","heartbeat_front_addr":"172.21.15.37:6821/724042860","state":["exists","up"]},{"osd":8,"uuid":"3ffc07d7-ca79-419d-88a4-2b53d07ffae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6817","nonce":1240363223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6819","nonce":1240363223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6823","nonce":1240363223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6821","nonce":1240363223}]},"public_addr":"172.21.15.59:6817/1240363223","cluster_addr":"172.21.15.59:6819/1240363223","heartbeat_back_addr":"172.21.15.59:6823/1240363223","heartbeat_front_addr":"172.21.15.59:6821/1240363223","state":["exists","up"]},{"osd":9,"uuid":"4e014fc7-1ca3-4d6c-acdd-95ca59541310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6827","nonce":2555848355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6829","nonce":2555848355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6833","nonce":2555848355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6831","nonce":2555848355}]},"public_addr":"172.21.15.28:6827/2555848355","cluster_addr":"172.21.15.28:6829/2555848355","heartbeat_back_addr":"172.21.15.28:6833/2555848355","heartbeat_front_addr":"172.21.15.28:6831/2555848355","state":["exists","up"]},{"osd":10,"uuid":"fc418661-5e89-4241-b14b-241a2be432f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6825","nonce":176857372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6827","nonce":176857372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6831","nonce":176857372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6829","nonce":176857372}]},"public_addr":"172.21.15.37:6825/176857372","cluster_addr":"172.21.15.37:6827/176857372","heartbeat_back_addr":"172.21.15.37:6831/176857372","heartbeat_front_addr":"172.21.15.37:6829/176857372","state":["exists","up"]},{"osd":11,"uuid":"e54d81ee-1461-4229-a1c0-c6e750dd66ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6825","nonce":2675673798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6827","nonce":2675673798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6831","nonce":2675673798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6829","nonce":2675673798}]},"public_addr":"172.21.15.59:6825/2675673798","cluster_addr":"172.21.15.59:6827/2675673798","heartbeat_back_addr":"172.21.15.59:6831/2675673798","heartbeat_front_addr":"172.21.15.59:6829/2675673798","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:33.904270+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:58.988528+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:22.997033+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:57.171455+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:23.594371+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:48.928423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:22.957203+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:50.599655+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:16.166981+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:50.755673+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:18.677280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:44.432598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":5,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1f","mappings":[{"from":1,"to":2}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/4230567915":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/2860387445":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/886961600":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/3217551014":"2024-06-07T08:31:40.064884+0000","172.21.15.28:0/1629731223":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/219831273":"2024-06-07T08:31:04.770627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 -- 172.21.15.28:0/1162933410 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f43d80a2cb0 msgr2=0x7f43d80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f43d80a2cb0 0x7f43d80a5170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009990 tx=0x7f43e4005ab0 comp rx=0 tx=0).stop 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 -- 172.21.15.28:0/1162933410 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43f406ab10 msgr2=0x7f43f419b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43f406ab10 0x7f43f419b400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00e9f0 tx=0x7f43dc00ed00 comp rx=0 tx=0).stop 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 -- 172.21.15.28:0/1162933410 shutdown_connections 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f43d80a2cb0 0x7f43d80a5170 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43f41084e0 0x7f43f419f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f406a170 0x7f43f419aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 --2- 172.21.15.28:0/1162933410 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43f406ab10 0x7f43f419b400 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 -- 172.21.15.28:0/1162933410 >> 172.21.15.28:0/1162933410 conn(0x7f43f40782c0 msgr2=0x7f43f410d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 -- 172.21.15.28:0/1162933410 shutdown_connections 2024-06-06T08:40:57.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:40:57.155+0000 7f43f9a00700 1 -- 172.21.15.28:0/1162933410 wait complete. 2024-06-06T08:40:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:57 smithi028 ceph-mon[31564]: pgmap v358: 97 pgs: 97 active+clean; 637 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2024-06-06T08:40:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:57 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:58.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:57 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1162933410' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:40:58.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:57 smithi037 ceph-mon[36609]: pgmap v358: 97 pgs: 97 active+clean; 637 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2024-06-06T08:40:58.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:58.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:57 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:58.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:57 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1162933410' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:40:58.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:57 smithi059 ceph-mon[36684]: pgmap v358: 97 pgs: 97 active+clean; 637 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2024-06-06T08:40:58.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:58.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:57 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:58.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:57 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1162933410' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:40:58.145 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-06T08:40:58.145 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T08:40:58.607 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:40:58.969 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:58 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:40:58.970 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:58 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:40:58.970 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:58 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:59.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:58 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:40:59.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:58 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:40:59.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:58 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:59.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:58 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:40:59.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:58 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:40:59.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:58 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:40:59.923 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:40:59 smithi028 ceph-mon[31564]: pgmap v359: 97 pgs: 97 active+clean; 637 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-06T08:41:00.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:40:59 smithi037 ceph-mon[36609]: pgmap v359: 97 pgs: 97 active+clean; 637 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-06T08:41:00.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:40:59 smithi059 ceph-mon[36684]: pgmap v359: 97 pgs: 97 active+clean; 637 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-06T08:41:00.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.750+0000 7fe1f1c00700 1 -- 172.21.15.28:0/1469499439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1ec10a6b0 msgr2=0x7fe1ec10aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:00.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.750+0000 7fe1f1c00700 1 --2- 172.21.15.28:0/1469499439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1ec10a6b0 0x7fe1ec10aa90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009990 tx=0x7fe1dc009ca0 comp rx=0 tx=0).stop 2024-06-06T08:41:00.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.750+0000 7fe1f1c00700 1 -- 172.21.15.28:0/1469499439 shutdown_connections 2024-06-06T08:41:00.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.750+0000 7fe1f1c00700 1 --2- 172.21.15.28:0/1469499439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1ec105070 0x7fe1ec111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:00.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.750+0000 7fe1f1c00700 1 --2- 172.21.15.28:0/1469499439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1ec10a6b0 0x7fe1ec10aa90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:00.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.750+0000 7fe1f1c00700 1 --2- 172.21.15.28:0/1469499439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1ec1046b0 0x7fe1ec104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:00.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.750+0000 7fe1f1c00700 1 -- 172.21.15.28:0/1469499439 >> 172.21.15.28:0/1469499439 conn(0x7fe1ec1001a0 msgr2=0x7fe1ec1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:00.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.750+0000 7fe1f1c00700 1 -- 172.21.15.28:0/1469499439 shutdown_connections 2024-06-06T08:41:00.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.750+0000 7fe1f1c00700 1 -- 172.21.15.28:0/1469499439 wait complete. 2024-06-06T08:41:00.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.751+0000 7fe1f1c00700 1 Processor -- start 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.751+0000 7fe1f1c00700 1 -- start start 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.752+0000 7fe1f1c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1ec1046b0 0x7fe1ec0769a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.752+0000 7fe1f1c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1ec105070 0x7fe1ec076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.752+0000 7fe1f1c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1ec10a6b0 0x7fe1ec077420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.752+0000 7fe1f1c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec114a00 con 0x7fe1ec105070 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.752+0000 7fe1f1c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec114880 con 0x7fe1ec10a6b0 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.752+0000 7fe1f1c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec114b80 con 0x7fe1ec1046b0 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.752+0000 7fe1eb400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1ec10a6b0 0x7fe1ec077420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.752+0000 7fe1eb400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1ec10a6b0 0x7fe1ec077420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:58944/0 (socket says 172.21.15.28:58944) 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.752+0000 7fe1eb400700 1 -- 172.21.15.28:0/3874489173 learned_addr learned my addr 172.21.15.28:0/3874489173 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.752+0000 7fe1eaa00700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1ec1046b0 0x7fe1ec0769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:00.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.752+0000 7fe1ea000700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1ec105070 0x7fe1ec076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:00.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.753+0000 7fe1eb400700 1 -- 172.21.15.28:0/3874489173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1ec1046b0 msgr2=0x7fe1ec0769a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:00.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.753+0000 7fe1eb400700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1ec1046b0 0x7fe1ec0769a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:00.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.753+0000 7fe1eb400700 1 -- 172.21.15.28:0/3874489173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1ec105070 msgr2=0x7fe1ec076ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:00.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.753+0000 7fe1eb400700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1ec105070 0x7fe1ec076ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:00.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.753+0000 7fe1eb400700 1 -- 172.21.15.28:0/3874489173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec1ab540 con 0x7fe1ec10a6b0 2024-06-06T08:41:00.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.753+0000 7fe1eb400700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1ec10a6b0 0x7fe1ec077420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400c370 tx=0x7fe1e400c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:00.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.753+0000 7fe1e3400700 1 -- 172.21.15.28:0/3874489173 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40092e0 con 0x7fe1ec10a6b0 2024-06-06T08:41:00.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.753+0000 7fe1f1c00700 1 -- 172.21.15.28:0/3874489173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ec1ab7d0 con 0x7fe1ec10a6b0 2024-06-06T08:41:00.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.753+0000 7fe1e3400700 1 -- 172.21.15.28:0/3874489173 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1e4003a00 con 0x7fe1ec10a6b0 2024-06-06T08:41:00.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.753+0000 7fe1e3400700 1 -- 172.21.15.28:0/3874489173 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40047b0 con 0x7fe1ec10a6b0 2024-06-06T08:41:00.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.753+0000 7fe1f1c00700 1 -- 172.21.15.28:0/3874489173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ec1abd10 con 0x7fe1ec10a6b0 2024-06-06T08:41:00.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.754+0000 7fe1f1c00700 1 -- 172.21.15.28:0/3874489173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1ec10cc40 con 0x7fe1ec10a6b0 2024-06-06T08:41:00.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.756+0000 7fe1e3400700 1 -- 172.21.15.28:0/3874489173 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe1e401a020 con 0x7fe1ec10a6b0 2024-06-06T08:41:00.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.758+0000 7fe1e3400700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe1d00a2ce0 0x7fe1d00a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:00.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.758+0000 7fe1e3400700 1 -- 172.21.15.28:0/3874489173 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7fe1e40cec30 con 0x7fe1ec10a6b0 2024-06-06T08:41:00.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.758+0000 7fe1eaa00700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe1d00a2ce0 0x7fe1d00a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:00.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.759+0000 7fe1eaa00700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe1d00a2ce0 0x7fe1d00a51a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00b2e0 tx=0x7fe1dc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:00.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.760+0000 7fe1e3400700 1 -- 172.21.15.28:0/3874489173 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe1e4010040 con 0x7fe1ec10a6b0 2024-06-06T08:41:00.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:00.988+0000 7fe1f1c00700 1 -- 172.21.15.28:0/3874489173 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1ec0628d0 con 0x7fe1d00a2ce0 2024-06-06T08:41:00.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.000+0000 7fe1e3400700 1 -- 172.21.15.28:0/3874489173 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259042 (secure 0 0 0) 0x7fe1ec0628d0 con 0x7fe1d00a2ce0 2024-06-06T08:41:01.000 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:41:01.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.007+0000 7fe1f1c00700 1 -- 172.21.15.28:0/3874489173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe1d00a2ce0 msgr2=0x7fe1d00a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:01.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.007+0000 7fe1f1c00700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe1d00a2ce0 0x7fe1d00a51a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00b2e0 tx=0x7fe1dc005960 comp rx=0 tx=0).stop 2024-06-06T08:41:01.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.007+0000 7fe1f1c00700 1 -- 172.21.15.28:0/3874489173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1ec10a6b0 msgr2=0x7fe1ec077420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:01.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.007+0000 7fe1f1c00700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1ec10a6b0 0x7fe1ec077420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400c370 tx=0x7fe1e400c680 comp rx=0 tx=0).stop 2024-06-06T08:41:01.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.007+0000 7fe1f1c00700 1 -- 172.21.15.28:0/3874489173 shutdown_connections 2024-06-06T08:41:01.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.007+0000 7fe1f1c00700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe1d00a2ce0 0x7fe1d00a51a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:01.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.007+0000 7fe1f1c00700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1ec10a6b0 0x7fe1ec077420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:01.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.007+0000 7fe1f1c00700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1ec1046b0 0x7fe1ec0769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:01.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.007+0000 7fe1f1c00700 1 --2- 172.21.15.28:0/3874489173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1ec105070 0x7fe1ec076ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:01.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.007+0000 7fe1f1c00700 1 -- 172.21.15.28:0/3874489173 >> 172.21.15.28:0/3874489173 conn(0x7fe1ec1001a0 msgr2=0x7fe1ec100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:01.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.008+0000 7fe1f1c00700 1 -- 172.21.15.28:0/3874489173 shutdown_connections 2024-06-06T08:41:01.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:01.008+0000 7fe1f1c00700 1 -- 172.21.15.28:0/3874489173 wait complete. 2024-06-06T08:41:01.008 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-06-06T08:41:01.860 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-06-06T08:41:00.239075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658654,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":495,"num_read_kb":371,"num_write":429,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352992,"kb_used_data":12136,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588832,"statfs":{"total":1151940427776,"available":1151578963968,"internally_reserved":0,"allocated":12427264,"data_stored":7716392,"data_compressed":177909,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19140,"internal_metadata":348894524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33158,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":104,"num_write":22,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004827"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.753102+0000","last_change":"2024-06-06T08:40:02.522544+0000","last_active":"2024-06-06T08:40:41.753102+0000","last_peered":"2024-06-06T08:40:41.753102+0000","last_clean":"2024-06-06T08:40:41.753102+0000","last_became_active":"2024-06-06T08:40:02.522223+0000","last_became_peered":"2024-06-06T08:40:02.522223+0000","last_unstale":"2024-06-06T08:40:41.753102+0000","last_undegraded":"2024-06-06T08:40:41.753102+0000","last_fullsized":"2024-06-06T08:40:41.753102+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:54:39.779392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.765934+0000","last_change":"2024-06-06T08:40:02.537841+0000","last_active":"2024-06-06T08:40:41.765934+0000","last_peered":"2024-06-06T08:40:41.765934+0000","last_clean":"2024-06-06T08:40:41.765934+0000","last_became_active":"2024-06-06T08:40:02.537418+0000","last_became_peered":"2024-06-06T08:40:02.537418+0000","last_unstale":"2024-06-06T08:40:41.765934+0000","last_undegraded":"2024-06-06T08:40:41.765934+0000","last_fullsized":"2024-06-06T08:40:41.765934+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:42:13.835530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.767609+0000","last_change":"2024-06-06T08:40:02.532747+0000","last_active":"2024-06-06T08:40:41.767609+0000","last_peered":"2024-06-06T08:40:41.767609+0000","last_clean":"2024-06-06T08:40:41.767609+0000","last_became_active":"2024-06-06T08:40:02.528275+0000","last_became_peered":"2024-06-06T08:40:02.528275+0000","last_unstale":"2024-06-06T08:40:41.767609+0000","last_undegraded":"2024-06-06T08:40:41.767609+0000","last_fullsized":"2024-06-06T08:40:41.767609+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:36:40.467396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918798+0000","last_change":"2024-06-06T08:40:02.506597+0000","last_active":"2024-06-06T08:40:41.918798+0000","last_peered":"2024-06-06T08:40:41.918798+0000","last_clean":"2024-06-06T08:40:41.918798+0000","last_became_active":"2024-06-06T08:40:02.505934+0000","last_became_peered":"2024-06-06T08:40:02.505934+0000","last_unstale":"2024-06-06T08:40:41.918798+0000","last_undegraded":"2024-06-06T08:40:41.918798+0000","last_fullsized":"2024-06-06T08:40:41.918798+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:03:19.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919802+0000","last_change":"2024-06-06T08:40:02.531151+0000","last_active":"2024-06-06T08:40:41.919802+0000","last_peered":"2024-06-06T08:40:41.919802+0000","last_clean":"2024-06-06T08:40:41.919802+0000","last_became_active":"2024-06-06T08:40:02.530742+0000","last_became_peered":"2024-06-06T08:40:02.530742+0000","last_unstale":"2024-06-06T08:40:41.919802+0000","last_undegraded":"2024-06-06T08:40:41.919802+0000","last_fullsized":"2024-06-06T08:40:41.919802+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:58:53.422609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919678+0000","last_change":"2024-06-06T08:40:02.514294+0000","last_active":"2024-06-06T08:40:41.919678+0000","last_peered":"2024-06-06T08:40:41.919678+0000","last_clean":"2024-06-06T08:40:41.919678+0000","last_became_active":"2024-06-06T08:40:02.513935+0000","last_became_peered":"2024-06-06T08:40:02.513935+0000","last_unstale":"2024-06-06T08:40:41.919678+0000","last_undegraded":"2024-06-06T08:40:41.919678+0000","last_fullsized":"2024-06-06T08:40:41.919678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:51:07.863317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920433+0000","last_change":"2024-06-06T08:40:02.508559+0000","last_active":"2024-06-06T08:40:41.920433+0000","last_peered":"2024-06-06T08:40:41.920433+0000","last_clean":"2024-06-06T08:40:41.920433+0000","last_became_active":"2024-06-06T08:40:02.508133+0000","last_became_peered":"2024-06-06T08:40:02.508133+0000","last_unstale":"2024-06-06T08:40:41.920433+0000","last_undegraded":"2024-06-06T08:40:41.920433+0000","last_fullsized":"2024-06-06T08:40:41.920433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:03:26.458397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.926229+0000","last_change":"2024-06-06T08:40:41.923413+0000","last_active":"2024-06-06T08:40:41.926229+0000","last_peered":"2024-06-06T08:40:41.926229+0000","last_clean":"2024-06-06T08:40:41.926229+0000","last_became_active":"2024-06-06T08:40:41.922347+0000","last_became_peered":"2024-06-06T08:40:41.922347+0000","last_unstale":"2024-06-06T08:40:41.926229+0000","last_undegraded":"2024-06-06T08:40:41.926229+0000","last_fullsized":"2024-06-06T08:40:41.926229+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:01:13.867302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920841+0000","last_change":"2024-06-06T08:40:02.508684+0000","last_active":"2024-06-06T08:40:41.920841+0000","last_peered":"2024-06-06T08:40:41.920841+0000","last_clean":"2024-06-06T08:40:41.920841+0000","last_became_active":"2024-06-06T08:40:02.507633+0000","last_became_peered":"2024-06-06T08:40:02.507633+0000","last_unstale":"2024-06-06T08:40:41.920841+0000","last_undegraded":"2024-06-06T08:40:41.920841+0000","last_fullsized":"2024-06-06T08:40:41.920841+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:13:44.072978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920626+0000","last_change":"2024-06-06T08:40:02.511816+0000","last_active":"2024-06-06T08:40:41.920626+0000","last_peered":"2024-06-06T08:40:41.920626+0000","last_clean":"2024-06-06T08:40:41.920626+0000","last_became_active":"2024-06-06T08:40:02.511445+0000","last_became_peered":"2024-06-06T08:40:02.511445+0000","last_unstale":"2024-06-06T08:40:41.920626+0000","last_undegraded":"2024-06-06T08:40:41.920626+0000","last_fullsized":"2024-06-06T08:40:41.920626+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:40:29.517937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921532+0000","last_change":"2024-06-06T08:40:02.502964+0000","last_active":"2024-06-06T08:40:41.921532+0000","last_peered":"2024-06-06T08:40:41.921532+0000","last_clean":"2024-06-06T08:40:41.921532+0000","last_became_active":"2024-06-06T08:40:02.502568+0000","last_became_peered":"2024-06-06T08:40:02.502568+0000","last_unstale":"2024-06-06T08:40:41.921532+0000","last_undegraded":"2024-06-06T08:40:41.921532+0000","last_fullsized":"2024-06-06T08:40:41.921532+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:53:46.243293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918691+0000","last_change":"2024-06-06T08:40:02.508686+0000","last_active":"2024-06-06T08:40:41.918691+0000","last_peered":"2024-06-06T08:40:41.918691+0000","last_clean":"2024-06-06T08:40:41.918691+0000","last_became_active":"2024-06-06T08:40:02.508318+0000","last_became_peered":"2024-06-06T08:40:02.508318+0000","last_unstale":"2024-06-06T08:40:41.918691+0000","last_undegraded":"2024-06-06T08:40:41.918691+0000","last_fullsized":"2024-06-06T08:40:41.918691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:05:55.260194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.841499+0000","last_change":"2024-06-06T08:40:02.517055+0000","last_active":"2024-06-06T08:40:41.841499+0000","last_peered":"2024-06-06T08:40:41.841499+0000","last_clean":"2024-06-06T08:40:41.841499+0000","last_became_active":"2024-06-06T08:40:02.515866+0000","last_became_peered":"2024-06-06T08:40:02.515866+0000","last_unstale":"2024-06-06T08:40:41.841499+0000","last_undegraded":"2024-06-06T08:40:41.841499+0000","last_fullsized":"2024-06-06T08:40:41.841499+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:09:50.597303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.765076+0000","last_change":"2024-06-06T08:40:02.523035+0000","last_active":"2024-06-06T08:40:41.765076+0000","last_peered":"2024-06-06T08:40:41.765076+0000","last_clean":"2024-06-06T08:40:41.765076+0000","last_became_active":"2024-06-06T08:40:02.522257+0000","last_became_peered":"2024-06-06T08:40:02.522257+0000","last_unstale":"2024-06-06T08:40:41.765076+0000","last_undegraded":"2024-06-06T08:40:41.765076+0000","last_fullsized":"2024-06-06T08:40:41.765076+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:14:08.287703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.764552+0000","last_change":"2024-06-06T08:40:02.532053+0000","last_active":"2024-06-06T08:40:41.764552+0000","last_peered":"2024-06-06T08:40:41.764552+0000","last_clean":"2024-06-06T08:40:41.764552+0000","last_became_active":"2024-06-06T08:40:02.531575+0000","last_became_peered":"2024-06-06T08:40:02.531575+0000","last_unstale":"2024-06-06T08:40:41.764552+0000","last_undegraded":"2024-06-06T08:40:41.764552+0000","last_fullsized":"2024-06-06T08:40:41.764552+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:58:13.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919706+0000","last_change":"2024-06-06T08:40:02.518220+0000","last_active":"2024-06-06T08:40:41.919706+0000","last_peered":"2024-06-06T08:40:41.919706+0000","last_clean":"2024-06-06T08:40:41.919706+0000","last_became_active":"2024-06-06T08:40:02.517771+0000","last_became_peered":"2024-06-06T08:40:02.517771+0000","last_unstale":"2024-06-06T08:40:41.919706+0000","last_undegraded":"2024-06-06T08:40:41.919706+0000","last_fullsized":"2024-06-06T08:40:41.919706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:22:13.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.753347+0000","last_change":"2024-06-06T08:40:02.537122+0000","last_active":"2024-06-06T08:40:41.753347+0000","last_peered":"2024-06-06T08:40:41.753347+0000","last_clean":"2024-06-06T08:40:41.753347+0000","last_became_active":"2024-06-06T08:40:02.536752+0000","last_became_peered":"2024-06-06T08:40:02.536752+0000","last_unstale":"2024-06-06T08:40:41.753347+0000","last_undegraded":"2024-06-06T08:40:41.753347+0000","last_fullsized":"2024-06-06T08:40:41.753347+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:03:09.537236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.760930+0000","last_change":"2024-06-06T08:40:02.515397+0000","last_active":"2024-06-06T08:40:41.760930+0000","last_peered":"2024-06-06T08:40:41.760930+0000","last_clean":"2024-06-06T08:40:41.760930+0000","last_became_active":"2024-06-06T08:40:02.514968+0000","last_became_peered":"2024-06-06T08:40:02.514968+0000","last_unstale":"2024-06-06T08:40:41.760930+0000","last_undegraded":"2024-06-06T08:40:41.760930+0000","last_fullsized":"2024-06-06T08:40:41.760930+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:41:42.724392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919235+0000","last_change":"2024-06-06T08:40:02.526875+0000","last_active":"2024-06-06T08:40:41.919235+0000","last_peered":"2024-06-06T08:40:41.919235+0000","last_clean":"2024-06-06T08:40:41.919235+0000","last_became_active":"2024-06-06T08:40:02.526583+0000","last_became_peered":"2024-06-06T08:40:02.526583+0000","last_unstale":"2024-06-06T08:40:41.919235+0000","last_undegraded":"2024-06-06T08:40:41.919235+0000","last_fullsized":"2024-06-06T08:40:41.919235+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:27:05.391768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:56.748161+0000","last_change":"2024-06-06T08:39:57.457411+0000","last_active":"2024-06-06T08:40:56.748161+0000","last_peered":"2024-06-06T08:40:56.748161+0000","last_clean":"2024-06-06T08:40:56.748161+0000","last_became_active":"2024-06-06T08:39:57.457002+0000","last_became_peered":"2024-06-06T08:39:57.457002+0000","last_unstale":"2024-06-06T08:40:56.748161+0000","last_undegraded":"2024-06-06T08:40:56.748161+0000","last_fullsized":"2024-06-06T08:40:56.748161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:03:11.538113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.755341+0000","last_change":"2024-06-06T08:40:02.527761+0000","last_active":"2024-06-06T08:40:41.755341+0000","last_peered":"2024-06-06T08:40:41.755341+0000","last_clean":"2024-06-06T08:40:41.755341+0000","last_became_active":"2024-06-06T08:40:02.527346+0000","last_became_peered":"2024-06-06T08:40:02.527346+0000","last_unstale":"2024-06-06T08:40:41.755341+0000","last_undegraded":"2024-06-06T08:40:41.755341+0000","last_fullsized":"2024-06-06T08:40:41.755341+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:25:28.443496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.756487+0000","last_change":"2024-06-06T08:39:57.664207+0000","last_active":"2024-06-06T08:40:41.756487+0000","last_peered":"2024-06-06T08:40:41.756487+0000","last_clean":"2024-06-06T08:40:41.756487+0000","last_became_active":"2024-06-06T08:39:57.663809+0000","last_became_peered":"2024-06-06T08:39:57.663809+0000","last_unstale":"2024-06-06T08:40:41.756487+0000","last_undegraded":"2024-06-06T08:40:41.756487+0000","last_fullsized":"2024-06-06T08:40:41.756487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:49.140662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.923126+0000","last_change":"2024-06-06T08:40:41.923126+0000","last_active":"2024-06-06T08:40:41.923126+0000","last_peered":"2024-06-06T08:40:41.923126+0000","last_clean":"2024-06-06T08:40:41.923126+0000","last_became_active":"2024-06-06T08:40:41.921580+0000","last_became_peered":"2024-06-06T08:40:41.921580+0000","last_unstale":"2024-06-06T08:40:41.923126+0000","last_undegraded":"2024-06-06T08:40:41.923126+0000","last_fullsized":"2024-06-06T08:40:41.923126+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:03:32.027832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,9],"acting":[0,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920901+0000","last_change":"2024-06-06T08:39:57.451584+0000","last_active":"2024-06-06T08:40:41.920901+0000","last_peered":"2024-06-06T08:40:41.920901+0000","last_clean":"2024-06-06T08:40:41.920901+0000","last_became_active":"2024-06-06T08:39:57.451213+0000","last_became_peered":"2024-06-06T08:39:57.451213+0000","last_unstale":"2024-06-06T08:40:41.920901+0000","last_undegraded":"2024-06-06T08:40:41.920901+0000","last_fullsized":"2024-06-06T08:40:41.920901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:49:14.346303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920903+0000","last_change":"2024-06-06T08:40:02.516354+0000","last_active":"2024-06-06T08:40:41.920903+0000","last_peered":"2024-06-06T08:40:41.920903+0000","last_clean":"2024-06-06T08:40:41.920903+0000","last_became_active":"2024-06-06T08:40:02.516008+0000","last_became_peered":"2024-06-06T08:40:02.516008+0000","last_unstale":"2024-06-06T08:40:41.920903+0000","last_undegraded":"2024-06-06T08:40:41.920903+0000","last_fullsized":"2024-06-06T08:40:41.920903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:21:51.826299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920362+0000","last_change":"2024-06-06T08:39:57.448570+0000","last_active":"2024-06-06T08:40:41.920362+0000","last_peered":"2024-06-06T08:40:41.920362+0000","last_clean":"2024-06-06T08:40:41.920362+0000","last_became_active":"2024-06-06T08:39:57.448183+0000","last_became_peered":"2024-06-06T08:39:57.448183+0000","last_unstale":"2024-06-06T08:40:41.920362+0000","last_undegraded":"2024-06-06T08:40:41.920362+0000","last_fullsized":"2024-06-06T08:40:41.920362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:13:17.209091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.752032+0000","last_change":"2024-06-06T08:40:02.505583+0000","last_active":"2024-06-06T08:40:41.752032+0000","last_peered":"2024-06-06T08:40:41.752032+0000","last_clean":"2024-06-06T08:40:41.752032+0000","last_became_active":"2024-06-06T08:40:02.505187+0000","last_became_peered":"2024-06-06T08:40:02.505187+0000","last_unstale":"2024-06-06T08:40:41.752032+0000","last_undegraded":"2024-06-06T08:40:41.752032+0000","last_fullsized":"2024-06-06T08:40:41.752032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:48:35.082993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:55.719738+0000","last_change":"2024-06-06T08:39:57.448670+0000","last_active":"2024-06-06T08:40:55.719738+0000","last_peered":"2024-06-06T08:40:55.719738+0000","last_clean":"2024-06-06T08:40:55.719738+0000","last_became_active":"2024-06-06T08:39:57.447870+0000","last_became_peered":"2024-06-06T08:39:57.447870+0000","last_unstale":"2024-06-06T08:40:55.719738+0000","last_undegraded":"2024-06-06T08:40:55.719738+0000","last_fullsized":"2024-06-06T08:40:55.719738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:04:35.504463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921062+0000","last_change":"2024-06-06T08:40:02.508540+0000","last_active":"2024-06-06T08:40:41.921062+0000","last_peered":"2024-06-06T08:40:41.921062+0000","last_clean":"2024-06-06T08:40:41.921062+0000","last_became_active":"2024-06-06T08:40:02.508162+0000","last_became_peered":"2024-06-06T08:40:02.508162+0000","last_unstale":"2024-06-06T08:40:41.921062+0000","last_undegraded":"2024-06-06T08:40:41.921062+0000","last_fullsized":"2024-06-06T08:40:41.921062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:21:53.273212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919554+0000","last_change":"2024-06-06T08:39:57.461796+0000","last_active":"2024-06-06T08:40:41.919554+0000","last_peered":"2024-06-06T08:40:41.919554+0000","last_clean":"2024-06-06T08:40:41.919554+0000","last_became_active":"2024-06-06T08:39:57.461334+0000","last_became_peered":"2024-06-06T08:39:57.461334+0000","last_unstale":"2024-06-06T08:40:41.919554+0000","last_undegraded":"2024-06-06T08:40:41.919554+0000","last_fullsized":"2024-06-06T08:40:41.919554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:46:41.904550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.926283+0000","last_change":"2024-06-06T08:40:41.922968+0000","last_active":"2024-06-06T08:40:41.926283+0000","last_peered":"2024-06-06T08:40:41.926283+0000","last_clean":"2024-06-06T08:40:41.926283+0000","last_became_active":"2024-06-06T08:40:41.922079+0000","last_became_peered":"2024-06-06T08:40:41.922079+0000","last_unstale":"2024-06-06T08:40:41.926283+0000","last_undegraded":"2024-06-06T08:40:41.926283+0000","last_fullsized":"2024-06-06T08:40:41.926283+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:34:22.185719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.840315+0000","last_change":"2024-06-06T08:39:57.464355+0000","last_active":"2024-06-06T08:40:41.840315+0000","last_peered":"2024-06-06T08:40:41.840315+0000","last_clean":"2024-06-06T08:40:41.840315+0000","last_became_active":"2024-06-06T08:39:57.463639+0000","last_became_peered":"2024-06-06T08:39:57.463639+0000","last_unstale":"2024-06-06T08:40:41.840315+0000","last_undegraded":"2024-06-06T08:40:41.840315+0000","last_fullsized":"2024-06-06T08:40:41.840315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:55:23.456001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.758528+0000","last_change":"2024-06-06T08:40:02.524130+0000","last_active":"2024-06-06T08:40:41.758528+0000","last_peered":"2024-06-06T08:40:41.758528+0000","last_clean":"2024-06-06T08:40:41.758528+0000","last_became_active":"2024-06-06T08:40:02.523788+0000","last_became_peered":"2024-06-06T08:40:02.523788+0000","last_unstale":"2024-06-06T08:40:41.758528+0000","last_undegraded":"2024-06-06T08:40:41.758528+0000","last_fullsized":"2024-06-06T08:40:41.758528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:39:11.300028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.750934+0000","last_change":"2024-06-06T08:39:57.447392+0000","last_active":"2024-06-06T08:40:41.750934+0000","last_peered":"2024-06-06T08:40:41.750934+0000","last_clean":"2024-06-06T08:40:41.750934+0000","last_became_active":"2024-06-06T08:39:57.446995+0000","last_became_peered":"2024-06-06T08:39:57.446995+0000","last_unstale":"2024-06-06T08:40:41.750934+0000","last_undegraded":"2024-06-06T08:40:41.750934+0000","last_fullsized":"2024-06-06T08:40:41.750934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:18:50.166795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.758999+0000","last_change":"2024-06-06T08:40:02.530192+0000","last_active":"2024-06-06T08:40:41.758999+0000","last_peered":"2024-06-06T08:40:41.758999+0000","last_clean":"2024-06-06T08:40:41.758999+0000","last_became_active":"2024-06-06T08:40:02.529801+0000","last_became_peered":"2024-06-06T08:40:02.529801+0000","last_unstale":"2024-06-06T08:40:41.758999+0000","last_undegraded":"2024-06-06T08:40:41.758999+0000","last_fullsized":"2024-06-06T08:40:41.758999+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:25:31.767403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:59.725248+0000","last_change":"2024-06-06T08:39:57.451666+0000","last_active":"2024-06-06T08:40:59.725248+0000","last_peered":"2024-06-06T08:40:59.725248+0000","last_clean":"2024-06-06T08:40:59.725248+0000","last_became_active":"2024-06-06T08:39:57.451242+0000","last_became_peered":"2024-06-06T08:39:57.451242+0000","last_unstale":"2024-06-06T08:40:59.725248+0000","last_undegraded":"2024-06-06T08:40:59.725248+0000","last_fullsized":"2024-06-06T08:40:59.725248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:42:02.614485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920973+0000","last_change":"2024-06-06T08:40:02.521368+0000","last_active":"2024-06-06T08:40:41.920973+0000","last_peered":"2024-06-06T08:40:41.920973+0000","last_clean":"2024-06-06T08:40:41.920973+0000","last_became_active":"2024-06-06T08:40:02.520948+0000","last_became_peered":"2024-06-06T08:40:02.520948+0000","last_unstale":"2024-06-06T08:40:41.920973+0000","last_undegraded":"2024-06-06T08:40:41.920973+0000","last_fullsized":"2024-06-06T08:40:41.920973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:09:29.844472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921427+0000","last_change":"2024-06-06T08:39:57.448966+0000","last_active":"2024-06-06T08:40:41.921427+0000","last_peered":"2024-06-06T08:40:41.921427+0000","last_clean":"2024-06-06T08:40:41.921427+0000","last_became_active":"2024-06-06T08:39:57.448449+0000","last_became_peered":"2024-06-06T08:39:57.448449+0000","last_unstale":"2024-06-06T08:40:41.921427+0000","last_undegraded":"2024-06-06T08:40:41.921427+0000","last_fullsized":"2024-06-06T08:40:41.921427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:48:38.313936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.765872+0000","last_change":"2024-06-06T08:40:02.531021+0000","last_active":"2024-06-06T08:40:41.765872+0000","last_peered":"2024-06-06T08:40:41.765872+0000","last_clean":"2024-06-06T08:40:41.765872+0000","last_became_active":"2024-06-06T08:40:02.530677+0000","last_became_peered":"2024-06-06T08:40:02.530677+0000","last_unstale":"2024-06-06T08:40:41.765872+0000","last_undegraded":"2024-06-06T08:40:41.765872+0000","last_fullsized":"2024-06-06T08:40:41.765872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:58:42.237943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.752075+0000","last_change":"2024-06-06T08:39:57.663293+0000","last_active":"2024-06-06T08:40:41.752075+0000","last_peered":"2024-06-06T08:40:41.752075+0000","last_clean":"2024-06-06T08:40:41.752075+0000","last_became_active":"2024-06-06T08:39:57.662865+0000","last_became_peered":"2024-06-06T08:39:57.662865+0000","last_unstale":"2024-06-06T08:40:41.752075+0000","last_undegraded":"2024-06-06T08:40:41.752075+0000","last_fullsized":"2024-06-06T08:40:41.752075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:50:57.783422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920991+0000","last_change":"2024-06-06T08:40:02.505731+0000","last_active":"2024-06-06T08:40:41.920991+0000","last_peered":"2024-06-06T08:40:41.920991+0000","last_clean":"2024-06-06T08:40:41.920991+0000","last_became_active":"2024-06-06T08:40:02.504801+0000","last_became_peered":"2024-06-06T08:40:02.504801+0000","last_unstale":"2024-06-06T08:40:41.920991+0000","last_undegraded":"2024-06-06T08:40:41.920991+0000","last_fullsized":"2024-06-06T08:40:41.920991+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:19:02.928913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'32","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:59.726906+0000","last_change":"2024-06-06T08:39:57.447508+0000","last_active":"2024-06-06T08:40:59.726906+0000","last_peered":"2024-06-06T08:40:59.726906+0000","last_clean":"2024-06-06T08:40:59.726906+0000","last_became_active":"2024-06-06T08:39:57.447118+0000","last_became_peered":"2024-06-06T08:39:57.447118+0000","last_unstale":"2024-06-06T08:40:59.726906+0000","last_undegraded":"2024-06-06T08:40:59.726906+0000","last_fullsized":"2024-06-06T08:40:59.726906+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:32:37.805274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61240,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":98,"num_write":34,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920577+0000","last_change":"2024-06-06T08:40:02.508523+0000","last_active":"2024-06-06T08:40:41.920577+0000","last_peered":"2024-06-06T08:40:41.920577+0000","last_clean":"2024-06-06T08:40:41.920577+0000","last_became_active":"2024-06-06T08:40:02.507699+0000","last_became_peered":"2024-06-06T08:40:02.507699+0000","last_unstale":"2024-06-06T08:40:41.920577+0000","last_undegraded":"2024-06-06T08:40:41.920577+0000","last_fullsized":"2024-06-06T08:40:41.920577+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:55:39.091047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918918+0000","last_change":"2024-06-06T08:39:57.446777+0000","last_active":"2024-06-06T08:40:41.918918+0000","last_peered":"2024-06-06T08:40:41.918918+0000","last_clean":"2024-06-06T08:40:41.918918+0000","last_became_active":"2024-06-06T08:39:57.446401+0000","last_became_peered":"2024-06-06T08:39:57.446401+0000","last_unstale":"2024-06-06T08:40:41.918918+0000","last_undegraded":"2024-06-06T08:40:41.918918+0000","last_fullsized":"2024-06-06T08:40:41.918918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:23:10.166458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.840239+0000","last_change":"2024-06-06T08:40:02.534562+0000","last_active":"2024-06-06T08:40:41.840239+0000","last_peered":"2024-06-06T08:40:41.840239+0000","last_clean":"2024-06-06T08:40:41.840239+0000","last_became_active":"2024-06-06T08:40:02.534204+0000","last_became_peered":"2024-06-06T08:40:02.534204+0000","last_unstale":"2024-06-06T08:40:41.840239+0000","last_undegraded":"2024-06-06T08:40:41.840239+0000","last_fullsized":"2024-06-06T08:40:41.840239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:46:53.695281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.751019+0000","last_change":"2024-06-06T08:39:57.451764+0000","last_active":"2024-06-06T08:40:41.751019+0000","last_peered":"2024-06-06T08:40:41.751019+0000","last_clean":"2024-06-06T08:40:41.751019+0000","last_became_active":"2024-06-06T08:39:57.451394+0000","last_became_peered":"2024-06-06T08:39:57.451394+0000","last_unstale":"2024-06-06T08:40:41.751019+0000","last_undegraded":"2024-06-06T08:40:41.751019+0000","last_fullsized":"2024-06-06T08:40:41.751019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:43.575913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921445+0000","last_change":"2024-06-06T08:40:02.515017+0000","last_active":"2024-06-06T08:40:41.921445+0000","last_peered":"2024-06-06T08:40:41.921445+0000","last_clean":"2024-06-06T08:40:41.921445+0000","last_became_active":"2024-06-06T08:40:02.513242+0000","last_became_peered":"2024-06-06T08:40:02.513242+0000","last_unstale":"2024-06-06T08:40:41.921445+0000","last_undegraded":"2024-06-06T08:40:41.921445+0000","last_fullsized":"2024-06-06T08:40:41.921445+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:15:13.581022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:53.733127+0000","last_change":"2024-06-06T08:39:57.451337+0000","last_active":"2024-06-06T08:40:53.733127+0000","last_peered":"2024-06-06T08:40:53.733127+0000","last_clean":"2024-06-06T08:40:53.733127+0000","last_became_active":"2024-06-06T08:39:57.450924+0000","last_became_peered":"2024-06-06T08:39:57.450924+0000","last_unstale":"2024-06-06T08:40:53.733127+0000","last_undegraded":"2024-06-06T08:40:53.733127+0000","last_fullsized":"2024-06-06T08:40:53.733127+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:18:09.022874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920199+0000","last_change":"2024-06-06T08:40:02.498665+0000","last_active":"2024-06-06T08:40:41.920199+0000","last_peered":"2024-06-06T08:40:41.920199+0000","last_clean":"2024-06-06T08:40:41.920199+0000","last_became_active":"2024-06-06T08:40:02.498261+0000","last_became_peered":"2024-06-06T08:40:02.498261+0000","last_unstale":"2024-06-06T08:40:41.920199+0000","last_undegraded":"2024-06-06T08:40:41.920199+0000","last_fullsized":"2024-06-06T08:40:41.920199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:29:03.217175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919688+0000","last_change":"2024-06-06T08:39:57.663480+0000","last_active":"2024-06-06T08:40:41.919688+0000","last_peered":"2024-06-06T08:40:41.919688+0000","last_clean":"2024-06-06T08:40:41.919688+0000","last_became_active":"2024-06-06T08:39:57.663087+0000","last_became_peered":"2024-06-06T08:39:57.663087+0000","last_unstale":"2024-06-06T08:40:41.919688+0000","last_undegraded":"2024-06-06T08:40:41.919688+0000","last_fullsized":"2024-06-06T08:40:41.919688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:56:33.556397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.750872+0000","last_change":"2024-06-06T08:40:02.503083+0000","last_active":"2024-06-06T08:40:41.750872+0000","last_peered":"2024-06-06T08:40:41.750872+0000","last_clean":"2024-06-06T08:40:41.750872+0000","last_became_active":"2024-06-06T08:40:02.502713+0000","last_became_peered":"2024-06-06T08:40:02.502713+0000","last_unstale":"2024-06-06T08:40:41.750872+0000","last_undegraded":"2024-06-06T08:40:41.750872+0000","last_fullsized":"2024-06-06T08:40:41.750872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:08:47.340528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921432+0000","last_change":"2024-06-06T08:39:57.448410+0000","last_active":"2024-06-06T08:40:41.921432+0000","last_peered":"2024-06-06T08:40:41.921432+0000","last_clean":"2024-06-06T08:40:41.921432+0000","last_became_active":"2024-06-06T08:39:57.447956+0000","last_became_peered":"2024-06-06T08:39:57.447956+0000","last_unstale":"2024-06-06T08:40:41.921432+0000","last_undegraded":"2024-06-06T08:40:41.921432+0000","last_fullsized":"2024-06-06T08:40:41.921432+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:02:15.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.923452+0000","last_change":"2024-06-06T08:40:41.923452+0000","last_active":"2024-06-06T08:40:41.923452+0000","last_peered":"2024-06-06T08:40:41.923452+0000","last_clean":"2024-06-06T08:40:41.923452+0000","last_became_active":"2024-06-06T08:40:41.922936+0000","last_became_peered":"2024-06-06T08:40:41.922936+0000","last_unstale":"2024-06-06T08:40:41.923452+0000","last_undegraded":"2024-06-06T08:40:41.923452+0000","last_fullsized":"2024-06-06T08:40:41.923452+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:25:38.840662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.760528+0000","last_change":"2024-06-06T08:39:57.666054+0000","last_active":"2024-06-06T08:40:41.760528+0000","last_peered":"2024-06-06T08:40:41.760528+0000","last_clean":"2024-06-06T08:40:41.760528+0000","last_became_active":"2024-06-06T08:39:57.665084+0000","last_became_peered":"2024-06-06T08:39:57.665084+0000","last_unstale":"2024-06-06T08:40:41.760528+0000","last_undegraded":"2024-06-06T08:40:41.760528+0000","last_fullsized":"2024-06-06T08:40:41.760528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:18:51.576755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919819+0000","last_change":"2024-06-06T08:40:02.529152+0000","last_active":"2024-06-06T08:40:41.919819+0000","last_peered":"2024-06-06T08:40:41.919819+0000","last_clean":"2024-06-06T08:40:41.919819+0000","last_became_active":"2024-06-06T08:40:02.528881+0000","last_became_peered":"2024-06-06T08:40:02.528881+0000","last_unstale":"2024-06-06T08:40:41.919819+0000","last_undegraded":"2024-06-06T08:40:41.919819+0000","last_fullsized":"2024-06-06T08:40:41.919819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:18:17.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:56.748996+0000","last_change":"2024-06-06T08:39:57.461109+0000","last_active":"2024-06-06T08:40:56.748996+0000","last_peered":"2024-06-06T08:40:56.748996+0000","last_clean":"2024-06-06T08:40:56.748996+0000","last_became_active":"2024-06-06T08:39:57.460701+0000","last_became_peered":"2024-06-06T08:39:57.460701+0000","last_unstale":"2024-06-06T08:40:56.748996+0000","last_undegraded":"2024-06-06T08:40:56.748996+0000","last_fullsized":"2024-06-06T08:40:56.748996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:40:39.834903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920446+0000","last_change":"2024-06-06T08:40:02.525590+0000","last_active":"2024-06-06T08:40:41.920446+0000","last_peered":"2024-06-06T08:40:41.920446+0000","last_clean":"2024-06-06T08:40:41.920446+0000","last_became_active":"2024-06-06T08:40:02.525242+0000","last_became_peered":"2024-06-06T08:40:02.525242+0000","last_unstale":"2024-06-06T08:40:41.920446+0000","last_undegraded":"2024-06-06T08:40:41.920446+0000","last_fullsized":"2024-06-06T08:40:41.920446+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:46:42.121170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921045+0000","last_change":"2024-06-06T08:40:41.921045+0000","last_active":"2024-06-06T08:40:41.921045+0000","last_peered":"2024-06-06T08:40:41.921045+0000","last_clean":"2024-06-06T08:40:41.921045+0000","last_became_active":"2024-06-06T08:40:41.920644+0000","last_became_peered":"2024-06-06T08:40:41.920644+0000","last_unstale":"2024-06-06T08:40:41.921045+0000","last_undegraded":"2024-06-06T08:40:41.921045+0000","last_fullsized":"2024-06-06T08:40:41.921045+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:01:26.880961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:53.732253+0000","last_change":"2024-06-06T08:39:57.658255+0000","last_active":"2024-06-06T08:40:53.732253+0000","last_peered":"2024-06-06T08:40:53.732253+0000","last_clean":"2024-06-06T08:40:53.732253+0000","last_became_active":"2024-06-06T08:39:57.657820+0000","last_became_peered":"2024-06-06T08:39:57.657820+0000","last_unstale":"2024-06-06T08:40:53.732253+0000","last_undegraded":"2024-06-06T08:40:53.732253+0000","last_fullsized":"2024-06-06T08:40:53.732253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:16:16.475843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.927007+0000","last_change":"2024-06-06T08:40:41.927007+0000","last_active":"2024-06-06T08:40:41.927007+0000","last_peered":"2024-06-06T08:40:41.927007+0000","last_clean":"2024-06-06T08:40:41.927007+0000","last_became_active":"2024-06-06T08:40:41.925980+0000","last_became_peered":"2024-06-06T08:40:41.925980+0000","last_unstale":"2024-06-06T08:40:41.927007+0000","last_undegraded":"2024-06-06T08:40:41.927007+0000","last_fullsized":"2024-06-06T08:40:41.927007+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:12:56.234260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,1],"acting":[3,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918671+0000","last_change":"2024-06-06T08:39:57.453405+0000","last_active":"2024-06-06T08:40:41.918671+0000","last_peered":"2024-06-06T08:40:41.918671+0000","last_clean":"2024-06-06T08:40:41.918671+0000","last_became_active":"2024-06-06T08:39:57.453009+0000","last_became_peered":"2024-06-06T08:39:57.453009+0000","last_unstale":"2024-06-06T08:40:41.918671+0000","last_undegraded":"2024-06-06T08:40:41.918671+0000","last_fullsized":"2024-06-06T08:40:41.918671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:07:53.568537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921134+0000","last_change":"2024-06-06T08:38:24.084478+0000","last_active":"2024-06-06T08:40:41.921134+0000","last_peered":"2024-06-06T08:40:41.921134+0000","last_clean":"2024-06-06T08:40:41.921134+0000","last_became_active":"2024-06-06T08:38:24.083876+0000","last_became_peered":"2024-06-06T08:38:24.083876+0000","last_unstale":"2024-06-06T08:40:41.921134+0000","last_undegraded":"2024-06-06T08:40:41.921134+0000","last_fullsized":"2024-06-06T08:40:41.921134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:34:26.807146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:34:26.807146+0000","last_clean_scrub_stamp":"2024-06-06T08:34:26.807146+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:35:23.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.839972+0000","last_change":"2024-06-06T08:40:02.514489+0000","last_active":"2024-06-06T08:40:41.839972+0000","last_peered":"2024-06-06T08:40:41.839972+0000","last_clean":"2024-06-06T08:40:41.839972+0000","last_became_active":"2024-06-06T08:40:02.514072+0000","last_became_peered":"2024-06-06T08:40:02.514072+0000","last_unstale":"2024-06-06T08:40:41.839972+0000","last_undegraded":"2024-06-06T08:40:41.839972+0000","last_fullsized":"2024-06-06T08:40:41.839972+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:56:05.779543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921236+0000","last_change":"2024-06-06T08:39:57.450613+0000","last_active":"2024-06-06T08:40:41.921236+0000","last_peered":"2024-06-06T08:40:41.921236+0000","last_clean":"2024-06-06T08:40:41.921236+0000","last_became_active":"2024-06-06T08:39:57.449109+0000","last_became_peered":"2024-06-06T08:39:57.449109+0000","last_unstale":"2024-06-06T08:40:41.921236+0000","last_undegraded":"2024-06-06T08:40:41.921236+0000","last_fullsized":"2024-06-06T08:40:41.921236+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:15:10.622436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920693+0000","last_change":"2024-06-06T08:39:57.659395+0000","last_active":"2024-06-06T08:40:41.920693+0000","last_peered":"2024-06-06T08:40:41.920693+0000","last_clean":"2024-06-06T08:40:41.920693+0000","last_became_active":"2024-06-06T08:39:57.659018+0000","last_became_peered":"2024-06-06T08:39:57.659018+0000","last_unstale":"2024-06-06T08:40:41.920693+0000","last_undegraded":"2024-06-06T08:40:41.920693+0000","last_fullsized":"2024-06-06T08:40:41.920693+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:15:56.037189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.840849+0000","last_change":"2024-06-06T08:40:02.522412+0000","last_active":"2024-06-06T08:40:41.840849+0000","last_peered":"2024-06-06T08:40:41.840849+0000","last_clean":"2024-06-06T08:40:41.840849+0000","last_became_active":"2024-06-06T08:40:02.521880+0000","last_became_peered":"2024-06-06T08:40:02.521880+0000","last_unstale":"2024-06-06T08:40:41.840849+0000","last_undegraded":"2024-06-06T08:40:41.840849+0000","last_fullsized":"2024-06-06T08:40:41.840849+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:31:46.611810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'16","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:51.524857+0000","last_change":"2024-06-06T08:39:57.459036+0000","last_active":"2024-06-06T08:40:51.524857+0000","last_peered":"2024-06-06T08:40:51.524857+0000","last_clean":"2024-06-06T08:40:51.524857+0000","last_became_active":"2024-06-06T08:39:57.458500+0000","last_became_peered":"2024-06-06T08:39:57.458500+0000","last_unstale":"2024-06-06T08:40:51.524857+0000","last_undegraded":"2024-06-06T08:40:51.524857+0000","last_fullsized":"2024-06-06T08:40:51.524857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:25:35.968887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.758945+0000","last_change":"2024-06-06T08:40:02.534130+0000","last_active":"2024-06-06T08:40:41.758945+0000","last_peered":"2024-06-06T08:40:41.758945+0000","last_clean":"2024-06-06T08:40:41.758945+0000","last_became_active":"2024-06-06T08:40:02.527085+0000","last_became_peered":"2024-06-06T08:40:02.527085+0000","last_unstale":"2024-06-06T08:40:41.758945+0000","last_undegraded":"2024-06-06T08:40:41.758945+0000","last_fullsized":"2024-06-06T08:40:41.758945+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:06:07.606127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920006+0000","last_change":"2024-06-06T08:39:57.507621+0000","last_active":"2024-06-06T08:40:41.920006+0000","last_peered":"2024-06-06T08:40:41.920006+0000","last_clean":"2024-06-06T08:40:41.920006+0000","last_became_active":"2024-06-06T08:39:57.507268+0000","last_became_peered":"2024-06-06T08:39:57.507268+0000","last_unstale":"2024-06-06T08:40:41.920006+0000","last_undegraded":"2024-06-06T08:40:41.920006+0000","last_fullsized":"2024-06-06T08:40:41.920006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:15:58.191318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.923084+0000","last_change":"2024-06-06T08:40:41.923084+0000","last_active":"2024-06-06T08:40:41.923084+0000","last_peered":"2024-06-06T08:40:41.923084+0000","last_clean":"2024-06-06T08:40:41.923084+0000","last_became_active":"2024-06-06T08:40:41.922562+0000","last_became_peered":"2024-06-06T08:40:41.922562+0000","last_unstale":"2024-06-06T08:40:41.923084+0000","last_undegraded":"2024-06-06T08:40:41.923084+0000","last_fullsized":"2024-06-06T08:40:41.923084+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:12:45.467112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919861+0000","last_change":"2024-06-06T08:39:57.663754+0000","last_active":"2024-06-06T08:40:41.919861+0000","last_peered":"2024-06-06T08:40:41.919861+0000","last_clean":"2024-06-06T08:40:41.919861+0000","last_became_active":"2024-06-06T08:39:57.663356+0000","last_became_peered":"2024-06-06T08:39:57.663356+0000","last_unstale":"2024-06-06T08:40:41.919861+0000","last_undegraded":"2024-06-06T08:40:41.919861+0000","last_fullsized":"2024-06-06T08:40:41.919861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:35:33.372951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919687+0000","last_change":"2024-06-06T08:40:02.508300+0000","last_active":"2024-06-06T08:40:41.919687+0000","last_peered":"2024-06-06T08:40:41.919687+0000","last_clean":"2024-06-06T08:40:41.919687+0000","last_became_active":"2024-06-06T08:40:02.507880+0000","last_became_peered":"2024-06-06T08:40:02.507880+0000","last_unstale":"2024-06-06T08:40:41.919687+0000","last_undegraded":"2024-06-06T08:40:41.919687+0000","last_fullsized":"2024-06-06T08:40:41.919687+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:08:32.068060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.759268+0000","last_change":"2024-06-06T08:39:57.456657+0000","last_active":"2024-06-06T08:40:41.759268+0000","last_peered":"2024-06-06T08:40:41.759268+0000","last_clean":"2024-06-06T08:40:41.759268+0000","last_became_active":"2024-06-06T08:39:57.455401+0000","last_became_peered":"2024-06-06T08:39:57.455401+0000","last_unstale":"2024-06-06T08:40:41.759268+0000","last_undegraded":"2024-06-06T08:40:41.759268+0000","last_fullsized":"2024-06-06T08:40:41.759268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:21:04.840297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.752714+0000","last_change":"2024-06-06T08:40:02.520755+0000","last_active":"2024-06-06T08:40:41.752714+0000","last_peered":"2024-06-06T08:40:41.752714+0000","last_clean":"2024-06-06T08:40:41.752714+0000","last_became_active":"2024-06-06T08:40:02.520349+0000","last_became_peered":"2024-06-06T08:40:02.520349+0000","last_unstale":"2024-06-06T08:40:41.752714+0000","last_undegraded":"2024-06-06T08:40:41.752714+0000","last_fullsized":"2024-06-06T08:40:41.752714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:19:09.549764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918990+0000","last_change":"2024-06-06T08:39:57.448342+0000","last_active":"2024-06-06T08:40:41.918990+0000","last_peered":"2024-06-06T08:40:41.918990+0000","last_clean":"2024-06-06T08:40:41.918990+0000","last_became_active":"2024-06-06T08:39:57.447966+0000","last_became_peered":"2024-06-06T08:39:57.447966+0000","last_unstale":"2024-06-06T08:40:41.918990+0000","last_undegraded":"2024-06-06T08:40:41.918990+0000","last_fullsized":"2024-06-06T08:40:41.918990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:49:47.211202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.756962+0000","last_change":"2024-06-06T08:40:02.527976+0000","last_active":"2024-06-06T08:40:41.756962+0000","last_peered":"2024-06-06T08:40:41.756962+0000","last_clean":"2024-06-06T08:40:41.756962+0000","last_became_active":"2024-06-06T08:40:02.526288+0000","last_became_peered":"2024-06-06T08:40:02.526288+0000","last_unstale":"2024-06-06T08:40:41.756962+0000","last_undegraded":"2024-06-06T08:40:41.756962+0000","last_fullsized":"2024-06-06T08:40:41.756962+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:21:34.363207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919924+0000","last_change":"2024-06-06T08:39:57.450301+0000","last_active":"2024-06-06T08:40:41.919924+0000","last_peered":"2024-06-06T08:40:41.919924+0000","last_clean":"2024-06-06T08:40:41.919924+0000","last_became_active":"2024-06-06T08:39:57.449867+0000","last_became_peered":"2024-06-06T08:39:57.449867+0000","last_unstale":"2024-06-06T08:40:41.919924+0000","last_undegraded":"2024-06-06T08:40:41.919924+0000","last_fullsized":"2024-06-06T08:40:41.919924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:00:53.571075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920946+0000","last_change":"2024-06-06T08:40:02.513543+0000","last_active":"2024-06-06T08:40:41.920946+0000","last_peered":"2024-06-06T08:40:41.920946+0000","last_clean":"2024-06-06T08:40:41.920946+0000","last_became_active":"2024-06-06T08:40:02.513175+0000","last_became_peered":"2024-06-06T08:40:02.513175+0000","last_unstale":"2024-06-06T08:40:41.920946+0000","last_undegraded":"2024-06-06T08:40:41.920946+0000","last_fullsized":"2024-06-06T08:40:41.920946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:31:31.032249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:54.735877+0000","last_change":"2024-06-06T08:39:57.658281+0000","last_active":"2024-06-06T08:40:54.735877+0000","last_peered":"2024-06-06T08:40:54.735877+0000","last_clean":"2024-06-06T08:40:54.735877+0000","last_became_active":"2024-06-06T08:39:57.657807+0000","last_became_peered":"2024-06-06T08:39:57.657807+0000","last_unstale":"2024-06-06T08:40:54.735877+0000","last_undegraded":"2024-06-06T08:40:54.735877+0000","last_fullsized":"2024-06-06T08:40:54.735877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:13:07.811356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921651+0000","last_change":"2024-06-06T08:40:02.507607+0000","last_active":"2024-06-06T08:40:41.921651+0000","last_peered":"2024-06-06T08:40:41.921651+0000","last_clean":"2024-06-06T08:40:41.921651+0000","last_became_active":"2024-06-06T08:40:02.507225+0000","last_became_peered":"2024-06-06T08:40:02.507225+0000","last_unstale":"2024-06-06T08:40:41.921651+0000","last_undegraded":"2024-06-06T08:40:41.921651+0000","last_fullsized":"2024-06-06T08:40:41.921651+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:18:14.161368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.751904+0000","last_change":"2024-06-06T08:39:57.455145+0000","last_active":"2024-06-06T08:40:41.751904+0000","last_peered":"2024-06-06T08:40:41.751904+0000","last_clean":"2024-06-06T08:40:41.751904+0000","last_became_active":"2024-06-06T08:39:57.454802+0000","last_became_peered":"2024-06-06T08:39:57.454802+0000","last_unstale":"2024-06-06T08:40:41.751904+0000","last_undegraded":"2024-06-06T08:40:41.751904+0000","last_fullsized":"2024-06-06T08:40:41.751904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:13:37.287584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921369+0000","last_change":"2024-06-06T08:40:02.531229+0000","last_active":"2024-06-06T08:40:41.921369+0000","last_peered":"2024-06-06T08:40:41.921369+0000","last_clean":"2024-06-06T08:40:41.921369+0000","last_became_active":"2024-06-06T08:40:02.530944+0000","last_became_peered":"2024-06-06T08:40:02.530944+0000","last_unstale":"2024-06-06T08:40:41.921369+0000","last_undegraded":"2024-06-06T08:40:41.921369+0000","last_fullsized":"2024-06-06T08:40:41.921369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:38:42.733919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.840890+0000","last_change":"2024-06-06T08:39:57.463387+0000","last_active":"2024-06-06T08:40:41.840890+0000","last_peered":"2024-06-06T08:40:41.840890+0000","last_clean":"2024-06-06T08:40:41.840890+0000","last_became_active":"2024-06-06T08:39:57.462946+0000","last_became_peered":"2024-06-06T08:39:57.462946+0000","last_unstale":"2024-06-06T08:40:41.840890+0000","last_undegraded":"2024-06-06T08:40:41.840890+0000","last_fullsized":"2024-06-06T08:40:41.840890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:42:28.270765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921625+0000","last_change":"2024-06-06T08:40:02.508752+0000","last_active":"2024-06-06T08:40:41.921625+0000","last_peered":"2024-06-06T08:40:41.921625+0000","last_clean":"2024-06-06T08:40:41.921625+0000","last_became_active":"2024-06-06T08:40:02.508395+0000","last_became_peered":"2024-06-06T08:40:02.508395+0000","last_unstale":"2024-06-06T08:40:41.921625+0000","last_undegraded":"2024-06-06T08:40:41.921625+0000","last_fullsized":"2024-06-06T08:40:41.921625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:49:11.516680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920976+0000","last_change":"2024-06-06T08:40:41.920976+0000","last_active":"2024-06-06T08:40:41.920976+0000","last_peered":"2024-06-06T08:40:41.920976+0000","last_clean":"2024-06-06T08:40:41.920976+0000","last_became_active":"2024-06-06T08:40:41.920483+0000","last_became_peered":"2024-06-06T08:40:41.920483+0000","last_unstale":"2024-06-06T08:40:41.920976+0000","last_undegraded":"2024-06-06T08:40:41.920976+0000","last_fullsized":"2024-06-06T08:40:41.920976+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:12:02.631659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919037+0000","last_change":"2024-06-06T08:40:02.509533+0000","last_active":"2024-06-06T08:40:41.919037+0000","last_peered":"2024-06-06T08:40:41.919037+0000","last_clean":"2024-06-06T08:40:41.919037+0000","last_became_active":"2024-06-06T08:40:02.508698+0000","last_became_peered":"2024-06-06T08:40:02.508698+0000","last_unstale":"2024-06-06T08:40:41.919037+0000","last_undegraded":"2024-06-06T08:40:41.919037+0000","last_fullsized":"2024-06-06T08:40:41.919037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:18:05.840254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918672+0000","last_change":"2024-06-06T08:40:02.532089+0000","last_active":"2024-06-06T08:40:41.918672+0000","last_peered":"2024-06-06T08:40:41.918672+0000","last_clean":"2024-06-06T08:40:41.918672+0000","last_became_active":"2024-06-06T08:40:02.531841+0000","last_became_peered":"2024-06-06T08:40:02.531841+0000","last_unstale":"2024-06-06T08:40:41.918672+0000","last_undegraded":"2024-06-06T08:40:41.918672+0000","last_fullsized":"2024-06-06T08:40:41.918672+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:52:04.975610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.767009+0000","last_change":"2024-06-06T08:40:02.534539+0000","last_active":"2024-06-06T08:40:41.767009+0000","last_peered":"2024-06-06T08:40:41.767009+0000","last_clean":"2024-06-06T08:40:41.767009+0000","last_became_active":"2024-06-06T08:40:02.533756+0000","last_became_peered":"2024-06-06T08:40:02.533756+0000","last_unstale":"2024-06-06T08:40:41.767009+0000","last_undegraded":"2024-06-06T08:40:41.767009+0000","last_fullsized":"2024-06-06T08:40:41.767009+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:30:19.277210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.840945+0000","last_change":"2024-06-06T08:40:02.540186+0000","last_active":"2024-06-06T08:40:41.840945+0000","last_peered":"2024-06-06T08:40:41.840945+0000","last_clean":"2024-06-06T08:40:41.840945+0000","last_became_active":"2024-06-06T08:40:02.539768+0000","last_became_peered":"2024-06-06T08:40:02.539768+0000","last_unstale":"2024-06-06T08:40:41.840945+0000","last_undegraded":"2024-06-06T08:40:41.840945+0000","last_fullsized":"2024-06-06T08:40:41.840945+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:44:41.203835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.753034+0000","last_change":"2024-06-06T08:40:02.508392+0000","last_active":"2024-06-06T08:40:41.753034+0000","last_peered":"2024-06-06T08:40:41.753034+0000","last_clean":"2024-06-06T08:40:41.753034+0000","last_became_active":"2024-06-06T08:40:02.508054+0000","last_became_peered":"2024-06-06T08:40:02.508054+0000","last_unstale":"2024-06-06T08:40:41.753034+0000","last_undegraded":"2024-06-06T08:40:41.753034+0000","last_fullsized":"2024-06-06T08:40:41.753034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:59:16.879294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919429+0000","last_change":"2024-06-06T08:40:02.508451+0000","last_active":"2024-06-06T08:40:41.919429+0000","last_peered":"2024-06-06T08:40:41.919429+0000","last_clean":"2024-06-06T08:40:41.919429+0000","last_became_active":"2024-06-06T08:40:02.505407+0000","last_became_peered":"2024-06-06T08:40:02.505407+0000","last_unstale":"2024-06-06T08:40:41.919429+0000","last_undegraded":"2024-06-06T08:40:41.919429+0000","last_fullsized":"2024-06-06T08:40:41.919429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:55:23.080525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.758629+0000","last_change":"2024-06-06T08:40:02.534845+0000","last_active":"2024-06-06T08:40:41.758629+0000","last_peered":"2024-06-06T08:40:41.758629+0000","last_clean":"2024-06-06T08:40:41.758629+0000","last_became_active":"2024-06-06T08:40:02.534463+0000","last_became_peered":"2024-06-06T08:40:02.534463+0000","last_unstale":"2024-06-06T08:40:41.758629+0000","last_undegraded":"2024-06-06T08:40:41.758629+0000","last_fullsized":"2024-06-06T08:40:41.758629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:25:17.693197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.843054+0000","last_change":"2024-06-06T08:40:41.843054+0000","last_active":"2024-06-06T08:40:41.843054+0000","last_peered":"2024-06-06T08:40:41.843054+0000","last_clean":"2024-06-06T08:40:41.843054+0000","last_became_active":"2024-06-06T08:40:41.842726+0000","last_became_peered":"2024-06-06T08:40:41.842726+0000","last_unstale":"2024-06-06T08:40:41.843054+0000","last_undegraded":"2024-06-06T08:40:41.843054+0000","last_fullsized":"2024-06-06T08:40:41.843054+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:10:46.018896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.759871+0000","last_change":"2024-06-06T08:40:02.529939+0000","last_active":"2024-06-06T08:40:41.759871+0000","last_peered":"2024-06-06T08:40:41.759871+0000","last_clean":"2024-06-06T08:40:41.759871+0000","last_became_active":"2024-06-06T08:40:02.529500+0000","last_became_peered":"2024-06-06T08:40:02.529500+0000","last_unstale":"2024-06-06T08:40:41.759871+0000","last_undegraded":"2024-06-06T08:40:41.759871+0000","last_fullsized":"2024-06-06T08:40:41.759871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:03:35.832111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920335+0000","last_change":"2024-06-06T08:40:02.536434+0000","last_active":"2024-06-06T08:40:41.920335+0000","last_peered":"2024-06-06T08:40:41.920335+0000","last_clean":"2024-06-06T08:40:41.920335+0000","last_became_active":"2024-06-06T08:40:02.536077+0000","last_became_peered":"2024-06-06T08:40:02.536077+0000","last_unstale":"2024-06-06T08:40:41.920335+0000","last_undegraded":"2024-06-06T08:40:41.920335+0000","last_fullsized":"2024-06-06T08:40:41.920335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:04:45.438724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.841237+0000","last_change":"2024-06-06T08:40:02.540402+0000","last_active":"2024-06-06T08:40:41.841237+0000","last_peered":"2024-06-06T08:40:41.841237+0000","last_clean":"2024-06-06T08:40:41.841237+0000","last_became_active":"2024-06-06T08:40:02.539884+0000","last_became_peered":"2024-06-06T08:40:02.539884+0000","last_unstale":"2024-06-06T08:40:41.841237+0000","last_undegraded":"2024-06-06T08:40:41.841237+0000","last_fullsized":"2024-06-06T08:40:41.841237+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:07:58.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.752673+0000","last_change":"2024-06-06T08:40:02.511737+0000","last_active":"2024-06-06T08:40:41.752673+0000","last_peered":"2024-06-06T08:40:41.752673+0000","last_clean":"2024-06-06T08:40:41.752673+0000","last_became_active":"2024-06-06T08:40:02.511373+0000","last_became_peered":"2024-06-06T08:40:02.511373+0000","last_unstale":"2024-06-06T08:40:41.752673+0000","last_undegraded":"2024-06-06T08:40:41.752673+0000","last_fullsized":"2024-06-06T08:40:41.752673+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:00:25.251603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284445,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68052,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":369,"num_read_kb":262,"num_write":246,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":197911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383707,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":480602,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645345,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1142784,"data_stored":1132871,"data_compressed":41954,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808871,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":480532,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070509,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":1007616,"data_stored":480910,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":1073427,"data_compressed":41954,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495672,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":995328,"data_stored":480249,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":536157,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":481588,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1073152,"data_stored":536767,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":480074,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920836,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":480110,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":1073105,"data_compressed":41954,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":57357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T08:41:01.865 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T08:41:01.983 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:01 smithi028 ceph-mon[31564]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-06-06T08:41:02.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:01 smithi037 ceph-mon[36609]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-06-06T08:41:02.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:01 smithi059 ceph-mon[36684]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-06-06T08:41:02.379 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:02.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:02 smithi028 ceph-mon[31564]: from='client.24662 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:41:03.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:02 smithi037 ceph-mon[36609]: from='client.24662 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:41:03.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:02 smithi059 ceph-mon[36684]: from='client.24662 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:41:03.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:03 smithi028 ceph-mon[31564]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-06-06T08:41:04.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:03 smithi037 ceph-mon[36609]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-06-06T08:41:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:03 smithi059 ceph-mon[36684]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-06-06T08:41:04.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.721+0000 7fa990c00700 1 -- 172.21.15.28:0/2402666002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa98c0746c0 msgr2=0x7fa98c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:04.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.721+0000 7fa990c00700 1 --2- 172.21.15.28:0/2402666002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa98c0746c0 0x7fa98c074aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00b0a0 tx=0x7fa97c00b3b0 comp rx=0 tx=0).stop 2024-06-06T08:41:04.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.721+0000 7fa990c00700 1 -- 172.21.15.28:0/2402666002 shutdown_connections 2024-06-06T08:41:04.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.721+0000 7fa990c00700 1 --2- 172.21.15.28:0/2402666002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa98c113660 0x7fa98c115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:04.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.721+0000 7fa990c00700 1 --2- 172.21.15.28:0/2402666002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa98c0746c0 0x7fa98c074aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:04.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.721+0000 7fa990c00700 1 --2- 172.21.15.28:0/2402666002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c074fe0 0x7fa98c113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:04.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.721+0000 7fa990c00700 1 -- 172.21.15.28:0/2402666002 >> 172.21.15.28:0/2402666002 conn(0x7fa98c0795f0 msgr2=0x7fa98c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:04.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.721+0000 7fa990c00700 1 -- 172.21.15.28:0/2402666002 shutdown_connections 2024-06-06T08:41:04.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.721+0000 7fa990c00700 1 -- 172.21.15.28:0/2402666002 wait complete. 2024-06-06T08:41:04.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.722+0000 7fa990c00700 1 Processor -- start 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.722+0000 7fa990c00700 1 -- start start 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.723+0000 7fa990c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa98c0746c0 0x7fa98c19f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.723+0000 7fa990c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c074fe0 0x7fa98c19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.723+0000 7fa990c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa98c113660 0x7fa98c1a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.723+0000 7fa990c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c118e00 con 0x7fa98c0746c0 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.723+0000 7fa990c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c118c80 con 0x7fa98c074fe0 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.723+0000 7fa990c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c118f80 con 0x7fa98c113660 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.723+0000 7fa989e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa98c0746c0 0x7fa98c19f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.723+0000 7fa989e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa98c0746c0 0x7fa98c19f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36000/0 (socket says 172.21.15.28:36000) 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.723+0000 7fa989e00700 1 -- 172.21.15.28:0/2125553198 learned_addr learned my addr 172.21.15.28:0/2125553198 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.723+0000 7fa981400700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c074fe0 0x7fa98c19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.723+0000 7fa98a800700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa98c113660 0x7fa98c1a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa981400700 1 -- 172.21.15.28:0/2125553198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa98c113660 msgr2=0x7fa98c1a3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:04.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa981400700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa98c113660 0x7fa98c1a3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:04.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa981400700 1 -- 172.21.15.28:0/2125553198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa98c0746c0 msgr2=0x7fa98c19f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:04.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa981400700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa98c0746c0 0x7fa98c19f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:04.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa981400700 1 -- 172.21.15.28:0/2125553198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98c1a4280 con 0x7fa98c074fe0 2024-06-06T08:41:04.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa989e00700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa98c0746c0 0x7fa98c19f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:04.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa981400700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c074fe0 0x7fa98c19f7b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa97400d750 tx=0x7fa97400da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:04.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa983400700 1 -- 172.21.15.28:0/2125553198 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974014030 con 0x7fa98c074fe0 2024-06-06T08:41:04.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa990c00700 1 -- 172.21.15.28:0/2125553198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa98c1a4570 con 0x7fa98c074fe0 2024-06-06T08:41:04.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa983400700 1 -- 172.21.15.28:0/2125553198 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa974004500 con 0x7fa98c074fe0 2024-06-06T08:41:04.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa983400700 1 -- 172.21.15.28:0/2125553198 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974005400 con 0x7fa98c074fe0 2024-06-06T08:41:04.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.724+0000 7fa990c00700 1 -- 172.21.15.28:0/2125553198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa98c1abdf0 con 0x7fa98c074fe0 2024-06-06T08:41:04.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.725+0000 7fa990c00700 1 -- 172.21.15.28:0/2125553198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa98c069180 con 0x7fa98c074fe0 2024-06-06T08:41:04.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.727+0000 7fa983400700 1 -- 172.21.15.28:0/2125553198 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa974004750 con 0x7fa98c074fe0 2024-06-06T08:41:04.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.729+0000 7fa983400700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9700a2cb0 0x7fa9700a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:04.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.729+0000 7fa983400700 1 -- 172.21.15.28:0/2125553198 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7fa9740ceb20 con 0x7fa98c074fe0 2024-06-06T08:41:04.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.729+0000 7fa989e00700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9700a2cb0 0x7fa9700a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:04.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.730+0000 7fa989e00700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9700a2cb0 0x7fa9700a5170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00b780 tx=0x7fa97c009c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:04.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.733+0000 7fa983400700 1 -- 172.21.15.28:0/2125553198 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa97409b8b0 con 0x7fa98c074fe0 2024-06-06T08:41:04.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.965+0000 7fa990c00700 1 -- 172.21.15.28:0/2125553198 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa98c112b40 con 0x7fa9700a2cb0 2024-06-06T08:41:04.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:04.991+0000 7fa983400700 1 -- 172.21.15.28:0/2125553198 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259017 (secure 0 0 0) 0x7fa98c112b40 con 0x7fa9700a2cb0 2024-06-06T08:41:04.993 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:41:04.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 -- 172.21.15.28:0/2125553198 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9700a2cb0 msgr2=0x7fa9700a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:04.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9700a2cb0 0x7fa9700a5170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00b780 tx=0x7fa97c009c40 comp rx=0 tx=0).stop 2024-06-06T08:41:05.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 -- 172.21.15.28:0/2125553198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c074fe0 msgr2=0x7fa98c19f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:05.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c074fe0 0x7fa98c19f7b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa97400d750 tx=0x7fa97400da60 comp rx=0 tx=0).stop 2024-06-06T08:41:05.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 -- 172.21.15.28:0/2125553198 shutdown_connections 2024-06-06T08:41:05.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9700a2cb0 0x7fa9700a5170 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:05.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa98c113660 0x7fa98c1a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:05.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa98c0746c0 0x7fa98c19f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:05.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 --2- 172.21.15.28:0/2125553198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c074fe0 0x7fa98c19f7b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:05.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 -- 172.21.15.28:0/2125553198 >> 172.21.15.28:0/2125553198 conn(0x7fa98c0795f0 msgr2=0x7fa98c112430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:05.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 -- 172.21.15.28:0/2125553198 shutdown_connections 2024-06-06T08:41:05.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:05.000+0000 7fa990c00700 1 -- 172.21.15.28:0/2125553198 wait complete. 2024-06-06T08:41:05.002 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-06-06T08:41:05.951 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:05 smithi028 ceph-mon[31564]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-06-06T08:41:06.023 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2024-06-06T08:41:04.240535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658654,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":525,"num_read_kb":381,"num_write":429,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353000,"kb_used_data":12144,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588824,"statfs":{"total":1151940427776,"available":1151578955776,"internally_reserved":0,"allocated":12435456,"data_stored":7728882,"data_compressed":177909,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19140,"internal_metadata":348894524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11055,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":67,"num_write":9,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004918"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.753102+0000","last_change":"2024-06-06T08:40:02.522544+0000","last_active":"2024-06-06T08:40:41.753102+0000","last_peered":"2024-06-06T08:40:41.753102+0000","last_clean":"2024-06-06T08:40:41.753102+0000","last_became_active":"2024-06-06T08:40:02.522223+0000","last_became_peered":"2024-06-06T08:40:02.522223+0000","last_unstale":"2024-06-06T08:40:41.753102+0000","last_undegraded":"2024-06-06T08:40:41.753102+0000","last_fullsized":"2024-06-06T08:40:41.753102+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:54:39.779392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.765934+0000","last_change":"2024-06-06T08:40:02.537841+0000","last_active":"2024-06-06T08:40:41.765934+0000","last_peered":"2024-06-06T08:40:41.765934+0000","last_clean":"2024-06-06T08:40:41.765934+0000","last_became_active":"2024-06-06T08:40:02.537418+0000","last_became_peered":"2024-06-06T08:40:02.537418+0000","last_unstale":"2024-06-06T08:40:41.765934+0000","last_undegraded":"2024-06-06T08:40:41.765934+0000","last_fullsized":"2024-06-06T08:40:41.765934+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:42:13.835530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.767609+0000","last_change":"2024-06-06T08:40:02.532747+0000","last_active":"2024-06-06T08:40:41.767609+0000","last_peered":"2024-06-06T08:40:41.767609+0000","last_clean":"2024-06-06T08:40:41.767609+0000","last_became_active":"2024-06-06T08:40:02.528275+0000","last_became_peered":"2024-06-06T08:40:02.528275+0000","last_unstale":"2024-06-06T08:40:41.767609+0000","last_undegraded":"2024-06-06T08:40:41.767609+0000","last_fullsized":"2024-06-06T08:40:41.767609+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:36:40.467396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918798+0000","last_change":"2024-06-06T08:40:02.506597+0000","last_active":"2024-06-06T08:40:41.918798+0000","last_peered":"2024-06-06T08:40:41.918798+0000","last_clean":"2024-06-06T08:40:41.918798+0000","last_became_active":"2024-06-06T08:40:02.505934+0000","last_became_peered":"2024-06-06T08:40:02.505934+0000","last_unstale":"2024-06-06T08:40:41.918798+0000","last_undegraded":"2024-06-06T08:40:41.918798+0000","last_fullsized":"2024-06-06T08:40:41.918798+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:03:19.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919802+0000","last_change":"2024-06-06T08:40:02.531151+0000","last_active":"2024-06-06T08:40:41.919802+0000","last_peered":"2024-06-06T08:40:41.919802+0000","last_clean":"2024-06-06T08:40:41.919802+0000","last_became_active":"2024-06-06T08:40:02.530742+0000","last_became_peered":"2024-06-06T08:40:02.530742+0000","last_unstale":"2024-06-06T08:40:41.919802+0000","last_undegraded":"2024-06-06T08:40:41.919802+0000","last_fullsized":"2024-06-06T08:40:41.919802+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:58:53.422609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919678+0000","last_change":"2024-06-06T08:40:02.514294+0000","last_active":"2024-06-06T08:40:41.919678+0000","last_peered":"2024-06-06T08:40:41.919678+0000","last_clean":"2024-06-06T08:40:41.919678+0000","last_became_active":"2024-06-06T08:40:02.513935+0000","last_became_peered":"2024-06-06T08:40:02.513935+0000","last_unstale":"2024-06-06T08:40:41.919678+0000","last_undegraded":"2024-06-06T08:40:41.919678+0000","last_fullsized":"2024-06-06T08:40:41.919678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:51:07.863317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920433+0000","last_change":"2024-06-06T08:40:02.508559+0000","last_active":"2024-06-06T08:40:41.920433+0000","last_peered":"2024-06-06T08:40:41.920433+0000","last_clean":"2024-06-06T08:40:41.920433+0000","last_became_active":"2024-06-06T08:40:02.508133+0000","last_became_peered":"2024-06-06T08:40:02.508133+0000","last_unstale":"2024-06-06T08:40:41.920433+0000","last_undegraded":"2024-06-06T08:40:41.920433+0000","last_fullsized":"2024-06-06T08:40:41.920433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:03:26.458397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.926229+0000","last_change":"2024-06-06T08:40:41.923413+0000","last_active":"2024-06-06T08:40:41.926229+0000","last_peered":"2024-06-06T08:40:41.926229+0000","last_clean":"2024-06-06T08:40:41.926229+0000","last_became_active":"2024-06-06T08:40:41.922347+0000","last_became_peered":"2024-06-06T08:40:41.922347+0000","last_unstale":"2024-06-06T08:40:41.926229+0000","last_undegraded":"2024-06-06T08:40:41.926229+0000","last_fullsized":"2024-06-06T08:40:41.926229+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:01:13.867302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920841+0000","last_change":"2024-06-06T08:40:02.508684+0000","last_active":"2024-06-06T08:40:41.920841+0000","last_peered":"2024-06-06T08:40:41.920841+0000","last_clean":"2024-06-06T08:40:41.920841+0000","last_became_active":"2024-06-06T08:40:02.507633+0000","last_became_peered":"2024-06-06T08:40:02.507633+0000","last_unstale":"2024-06-06T08:40:41.920841+0000","last_undegraded":"2024-06-06T08:40:41.920841+0000","last_fullsized":"2024-06-06T08:40:41.920841+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:13:44.072978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920626+0000","last_change":"2024-06-06T08:40:02.511816+0000","last_active":"2024-06-06T08:40:41.920626+0000","last_peered":"2024-06-06T08:40:41.920626+0000","last_clean":"2024-06-06T08:40:41.920626+0000","last_became_active":"2024-06-06T08:40:02.511445+0000","last_became_peered":"2024-06-06T08:40:02.511445+0000","last_unstale":"2024-06-06T08:40:41.920626+0000","last_undegraded":"2024-06-06T08:40:41.920626+0000","last_fullsized":"2024-06-06T08:40:41.920626+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:40:29.517937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921532+0000","last_change":"2024-06-06T08:40:02.502964+0000","last_active":"2024-06-06T08:40:41.921532+0000","last_peered":"2024-06-06T08:40:41.921532+0000","last_clean":"2024-06-06T08:40:41.921532+0000","last_became_active":"2024-06-06T08:40:02.502568+0000","last_became_peered":"2024-06-06T08:40:02.502568+0000","last_unstale":"2024-06-06T08:40:41.921532+0000","last_undegraded":"2024-06-06T08:40:41.921532+0000","last_fullsized":"2024-06-06T08:40:41.921532+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:53:46.243293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918691+0000","last_change":"2024-06-06T08:40:02.508686+0000","last_active":"2024-06-06T08:40:41.918691+0000","last_peered":"2024-06-06T08:40:41.918691+0000","last_clean":"2024-06-06T08:40:41.918691+0000","last_became_active":"2024-06-06T08:40:02.508318+0000","last_became_peered":"2024-06-06T08:40:02.508318+0000","last_unstale":"2024-06-06T08:40:41.918691+0000","last_undegraded":"2024-06-06T08:40:41.918691+0000","last_fullsized":"2024-06-06T08:40:41.918691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:05:55.260194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.841499+0000","last_change":"2024-06-06T08:40:02.517055+0000","last_active":"2024-06-06T08:40:41.841499+0000","last_peered":"2024-06-06T08:40:41.841499+0000","last_clean":"2024-06-06T08:40:41.841499+0000","last_became_active":"2024-06-06T08:40:02.515866+0000","last_became_peered":"2024-06-06T08:40:02.515866+0000","last_unstale":"2024-06-06T08:40:41.841499+0000","last_undegraded":"2024-06-06T08:40:41.841499+0000","last_fullsized":"2024-06-06T08:40:41.841499+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:09:50.597303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.765076+0000","last_change":"2024-06-06T08:40:02.523035+0000","last_active":"2024-06-06T08:40:41.765076+0000","last_peered":"2024-06-06T08:40:41.765076+0000","last_clean":"2024-06-06T08:40:41.765076+0000","last_became_active":"2024-06-06T08:40:02.522257+0000","last_became_peered":"2024-06-06T08:40:02.522257+0000","last_unstale":"2024-06-06T08:40:41.765076+0000","last_undegraded":"2024-06-06T08:40:41.765076+0000","last_fullsized":"2024-06-06T08:40:41.765076+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:14:08.287703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.764552+0000","last_change":"2024-06-06T08:40:02.532053+0000","last_active":"2024-06-06T08:40:41.764552+0000","last_peered":"2024-06-06T08:40:41.764552+0000","last_clean":"2024-06-06T08:40:41.764552+0000","last_became_active":"2024-06-06T08:40:02.531575+0000","last_became_peered":"2024-06-06T08:40:02.531575+0000","last_unstale":"2024-06-06T08:40:41.764552+0000","last_undegraded":"2024-06-06T08:40:41.764552+0000","last_fullsized":"2024-06-06T08:40:41.764552+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:58:13.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919706+0000","last_change":"2024-06-06T08:40:02.518220+0000","last_active":"2024-06-06T08:40:41.919706+0000","last_peered":"2024-06-06T08:40:41.919706+0000","last_clean":"2024-06-06T08:40:41.919706+0000","last_became_active":"2024-06-06T08:40:02.517771+0000","last_became_peered":"2024-06-06T08:40:02.517771+0000","last_unstale":"2024-06-06T08:40:41.919706+0000","last_undegraded":"2024-06-06T08:40:41.919706+0000","last_fullsized":"2024-06-06T08:40:41.919706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:22:13.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.753347+0000","last_change":"2024-06-06T08:40:02.537122+0000","last_active":"2024-06-06T08:40:41.753347+0000","last_peered":"2024-06-06T08:40:41.753347+0000","last_clean":"2024-06-06T08:40:41.753347+0000","last_became_active":"2024-06-06T08:40:02.536752+0000","last_became_peered":"2024-06-06T08:40:02.536752+0000","last_unstale":"2024-06-06T08:40:41.753347+0000","last_undegraded":"2024-06-06T08:40:41.753347+0000","last_fullsized":"2024-06-06T08:40:41.753347+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:03:09.537236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.760930+0000","last_change":"2024-06-06T08:40:02.515397+0000","last_active":"2024-06-06T08:40:41.760930+0000","last_peered":"2024-06-06T08:40:41.760930+0000","last_clean":"2024-06-06T08:40:41.760930+0000","last_became_active":"2024-06-06T08:40:02.514968+0000","last_became_peered":"2024-06-06T08:40:02.514968+0000","last_unstale":"2024-06-06T08:40:41.760930+0000","last_undegraded":"2024-06-06T08:40:41.760930+0000","last_fullsized":"2024-06-06T08:40:41.760930+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:41:42.724392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919235+0000","last_change":"2024-06-06T08:40:02.526875+0000","last_active":"2024-06-06T08:40:41.919235+0000","last_peered":"2024-06-06T08:40:41.919235+0000","last_clean":"2024-06-06T08:40:41.919235+0000","last_became_active":"2024-06-06T08:40:02.526583+0000","last_became_peered":"2024-06-06T08:40:02.526583+0000","last_unstale":"2024-06-06T08:40:41.919235+0000","last_undegraded":"2024-06-06T08:40:41.919235+0000","last_fullsized":"2024-06-06T08:40:41.919235+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:27:05.391768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":78,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:41:01.758897+0000","last_change":"2024-06-06T08:39:57.457411+0000","last_active":"2024-06-06T08:41:01.758897+0000","last_peered":"2024-06-06T08:41:01.758897+0000","last_clean":"2024-06-06T08:41:01.758897+0000","last_became_active":"2024-06-06T08:39:57.457002+0000","last_became_peered":"2024-06-06T08:39:57.457002+0000","last_unstale":"2024-06-06T08:41:01.758897+0000","last_undegraded":"2024-06-06T08:41:01.758897+0000","last_fullsized":"2024-06-06T08:41:01.758897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:03:11.538113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.755341+0000","last_change":"2024-06-06T08:40:02.527761+0000","last_active":"2024-06-06T08:40:41.755341+0000","last_peered":"2024-06-06T08:40:41.755341+0000","last_clean":"2024-06-06T08:40:41.755341+0000","last_became_active":"2024-06-06T08:40:02.527346+0000","last_became_peered":"2024-06-06T08:40:02.527346+0000","last_unstale":"2024-06-06T08:40:41.755341+0000","last_undegraded":"2024-06-06T08:40:41.755341+0000","last_fullsized":"2024-06-06T08:40:41.755341+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:25:28.443496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.756487+0000","last_change":"2024-06-06T08:39:57.664207+0000","last_active":"2024-06-06T08:40:41.756487+0000","last_peered":"2024-06-06T08:40:41.756487+0000","last_clean":"2024-06-06T08:40:41.756487+0000","last_became_active":"2024-06-06T08:39:57.663809+0000","last_became_peered":"2024-06-06T08:39:57.663809+0000","last_unstale":"2024-06-06T08:40:41.756487+0000","last_undegraded":"2024-06-06T08:40:41.756487+0000","last_fullsized":"2024-06-06T08:40:41.756487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:49.140662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.923126+0000","last_change":"2024-06-06T08:40:41.923126+0000","last_active":"2024-06-06T08:40:41.923126+0000","last_peered":"2024-06-06T08:40:41.923126+0000","last_clean":"2024-06-06T08:40:41.923126+0000","last_became_active":"2024-06-06T08:40:41.921580+0000","last_became_peered":"2024-06-06T08:40:41.921580+0000","last_unstale":"2024-06-06T08:40:41.923126+0000","last_undegraded":"2024-06-06T08:40:41.923126+0000","last_fullsized":"2024-06-06T08:40:41.923126+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:03:32.027832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,9],"acting":[0,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920901+0000","last_change":"2024-06-06T08:39:57.451584+0000","last_active":"2024-06-06T08:40:41.920901+0000","last_peered":"2024-06-06T08:40:41.920901+0000","last_clean":"2024-06-06T08:40:41.920901+0000","last_became_active":"2024-06-06T08:39:57.451213+0000","last_became_peered":"2024-06-06T08:39:57.451213+0000","last_unstale":"2024-06-06T08:40:41.920901+0000","last_undegraded":"2024-06-06T08:40:41.920901+0000","last_fullsized":"2024-06-06T08:40:41.920901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:49:14.346303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920903+0000","last_change":"2024-06-06T08:40:02.516354+0000","last_active":"2024-06-06T08:40:41.920903+0000","last_peered":"2024-06-06T08:40:41.920903+0000","last_clean":"2024-06-06T08:40:41.920903+0000","last_became_active":"2024-06-06T08:40:02.516008+0000","last_became_peered":"2024-06-06T08:40:02.516008+0000","last_unstale":"2024-06-06T08:40:41.920903+0000","last_undegraded":"2024-06-06T08:40:41.920903+0000","last_fullsized":"2024-06-06T08:40:41.920903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:21:51.826299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920362+0000","last_change":"2024-06-06T08:39:57.448570+0000","last_active":"2024-06-06T08:40:41.920362+0000","last_peered":"2024-06-06T08:40:41.920362+0000","last_clean":"2024-06-06T08:40:41.920362+0000","last_became_active":"2024-06-06T08:39:57.448183+0000","last_became_peered":"2024-06-06T08:39:57.448183+0000","last_unstale":"2024-06-06T08:40:41.920362+0000","last_undegraded":"2024-06-06T08:40:41.920362+0000","last_fullsized":"2024-06-06T08:40:41.920362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:13:17.209091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.752032+0000","last_change":"2024-06-06T08:40:02.505583+0000","last_active":"2024-06-06T08:40:41.752032+0000","last_peered":"2024-06-06T08:40:41.752032+0000","last_clean":"2024-06-06T08:40:41.752032+0000","last_became_active":"2024-06-06T08:40:02.505187+0000","last_became_peered":"2024-06-06T08:40:02.505187+0000","last_unstale":"2024-06-06T08:40:41.752032+0000","last_undegraded":"2024-06-06T08:40:41.752032+0000","last_fullsized":"2024-06-06T08:40:41.752032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:48:35.082993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":72,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:41:00.727608+0000","last_change":"2024-06-06T08:39:57.448670+0000","last_active":"2024-06-06T08:41:00.727608+0000","last_peered":"2024-06-06T08:41:00.727608+0000","last_clean":"2024-06-06T08:41:00.727608+0000","last_became_active":"2024-06-06T08:39:57.447870+0000","last_became_peered":"2024-06-06T08:39:57.447870+0000","last_unstale":"2024-06-06T08:41:00.727608+0000","last_undegraded":"2024-06-06T08:41:00.727608+0000","last_fullsized":"2024-06-06T08:41:00.727608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:04:35.504463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921062+0000","last_change":"2024-06-06T08:40:02.508540+0000","last_active":"2024-06-06T08:40:41.921062+0000","last_peered":"2024-06-06T08:40:41.921062+0000","last_clean":"2024-06-06T08:40:41.921062+0000","last_became_active":"2024-06-06T08:40:02.508162+0000","last_became_peered":"2024-06-06T08:40:02.508162+0000","last_unstale":"2024-06-06T08:40:41.921062+0000","last_undegraded":"2024-06-06T08:40:41.921062+0000","last_fullsized":"2024-06-06T08:40:41.921062+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:21:53.273212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919554+0000","last_change":"2024-06-06T08:39:57.461796+0000","last_active":"2024-06-06T08:40:41.919554+0000","last_peered":"2024-06-06T08:40:41.919554+0000","last_clean":"2024-06-06T08:40:41.919554+0000","last_became_active":"2024-06-06T08:39:57.461334+0000","last_became_peered":"2024-06-06T08:39:57.461334+0000","last_unstale":"2024-06-06T08:40:41.919554+0000","last_undegraded":"2024-06-06T08:40:41.919554+0000","last_fullsized":"2024-06-06T08:40:41.919554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:46:41.904550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.926283+0000","last_change":"2024-06-06T08:40:41.922968+0000","last_active":"2024-06-06T08:40:41.926283+0000","last_peered":"2024-06-06T08:40:41.926283+0000","last_clean":"2024-06-06T08:40:41.926283+0000","last_became_active":"2024-06-06T08:40:41.922079+0000","last_became_peered":"2024-06-06T08:40:41.922079+0000","last_unstale":"2024-06-06T08:40:41.926283+0000","last_undegraded":"2024-06-06T08:40:41.926283+0000","last_fullsized":"2024-06-06T08:40:41.926283+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:34:22.185719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.840315+0000","last_change":"2024-06-06T08:39:57.464355+0000","last_active":"2024-06-06T08:40:41.840315+0000","last_peered":"2024-06-06T08:40:41.840315+0000","last_clean":"2024-06-06T08:40:41.840315+0000","last_became_active":"2024-06-06T08:39:57.463639+0000","last_became_peered":"2024-06-06T08:39:57.463639+0000","last_unstale":"2024-06-06T08:40:41.840315+0000","last_undegraded":"2024-06-06T08:40:41.840315+0000","last_fullsized":"2024-06-06T08:40:41.840315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:55:23.456001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.758528+0000","last_change":"2024-06-06T08:40:02.524130+0000","last_active":"2024-06-06T08:40:41.758528+0000","last_peered":"2024-06-06T08:40:41.758528+0000","last_clean":"2024-06-06T08:40:41.758528+0000","last_became_active":"2024-06-06T08:40:02.523788+0000","last_became_peered":"2024-06-06T08:40:02.523788+0000","last_unstale":"2024-06-06T08:40:41.758528+0000","last_undegraded":"2024-06-06T08:40:41.758528+0000","last_fullsized":"2024-06-06T08:40:41.758528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:39:11.300028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.750934+0000","last_change":"2024-06-06T08:39:57.447392+0000","last_active":"2024-06-06T08:40:41.750934+0000","last_peered":"2024-06-06T08:40:41.750934+0000","last_clean":"2024-06-06T08:40:41.750934+0000","last_became_active":"2024-06-06T08:39:57.446995+0000","last_became_peered":"2024-06-06T08:39:57.446995+0000","last_unstale":"2024-06-06T08:40:41.750934+0000","last_undegraded":"2024-06-06T08:40:41.750934+0000","last_fullsized":"2024-06-06T08:40:41.750934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:18:50.166795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.758999+0000","last_change":"2024-06-06T08:40:02.530192+0000","last_active":"2024-06-06T08:40:41.758999+0000","last_peered":"2024-06-06T08:40:41.758999+0000","last_clean":"2024-06-06T08:40:41.758999+0000","last_became_active":"2024-06-06T08:40:02.529801+0000","last_became_peered":"2024-06-06T08:40:02.529801+0000","last_unstale":"2024-06-06T08:40:41.758999+0000","last_undegraded":"2024-06-06T08:40:41.758999+0000","last_fullsized":"2024-06-06T08:40:41.758999+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:25:31.767403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:59.725248+0000","last_change":"2024-06-06T08:39:57.451666+0000","last_active":"2024-06-06T08:40:59.725248+0000","last_peered":"2024-06-06T08:40:59.725248+0000","last_clean":"2024-06-06T08:40:59.725248+0000","last_became_active":"2024-06-06T08:39:57.451242+0000","last_became_peered":"2024-06-06T08:39:57.451242+0000","last_unstale":"2024-06-06T08:40:59.725248+0000","last_undegraded":"2024-06-06T08:40:59.725248+0000","last_fullsized":"2024-06-06T08:40:59.725248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:42:02.614485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920973+0000","last_change":"2024-06-06T08:40:02.521368+0000","last_active":"2024-06-06T08:40:41.920973+0000","last_peered":"2024-06-06T08:40:41.920973+0000","last_clean":"2024-06-06T08:40:41.920973+0000","last_became_active":"2024-06-06T08:40:02.520948+0000","last_became_peered":"2024-06-06T08:40:02.520948+0000","last_unstale":"2024-06-06T08:40:41.920973+0000","last_undegraded":"2024-06-06T08:40:41.920973+0000","last_fullsized":"2024-06-06T08:40:41.920973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:09:29.844472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921427+0000","last_change":"2024-06-06T08:39:57.448966+0000","last_active":"2024-06-06T08:40:41.921427+0000","last_peered":"2024-06-06T08:40:41.921427+0000","last_clean":"2024-06-06T08:40:41.921427+0000","last_became_active":"2024-06-06T08:39:57.448449+0000","last_became_peered":"2024-06-06T08:39:57.448449+0000","last_unstale":"2024-06-06T08:40:41.921427+0000","last_undegraded":"2024-06-06T08:40:41.921427+0000","last_fullsized":"2024-06-06T08:40:41.921427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:48:38.313936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.765872+0000","last_change":"2024-06-06T08:40:02.531021+0000","last_active":"2024-06-06T08:40:41.765872+0000","last_peered":"2024-06-06T08:40:41.765872+0000","last_clean":"2024-06-06T08:40:41.765872+0000","last_became_active":"2024-06-06T08:40:02.530677+0000","last_became_peered":"2024-06-06T08:40:02.530677+0000","last_unstale":"2024-06-06T08:40:41.765872+0000","last_undegraded":"2024-06-06T08:40:41.765872+0000","last_fullsized":"2024-06-06T08:40:41.765872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:58:42.237943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.752075+0000","last_change":"2024-06-06T08:39:57.663293+0000","last_active":"2024-06-06T08:40:41.752075+0000","last_peered":"2024-06-06T08:40:41.752075+0000","last_clean":"2024-06-06T08:40:41.752075+0000","last_became_active":"2024-06-06T08:39:57.662865+0000","last_became_peered":"2024-06-06T08:39:57.662865+0000","last_unstale":"2024-06-06T08:40:41.752075+0000","last_undegraded":"2024-06-06T08:40:41.752075+0000","last_fullsized":"2024-06-06T08:40:41.752075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:50:57.783422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920991+0000","last_change":"2024-06-06T08:40:02.505731+0000","last_active":"2024-06-06T08:40:41.920991+0000","last_peered":"2024-06-06T08:40:41.920991+0000","last_clean":"2024-06-06T08:40:41.920991+0000","last_became_active":"2024-06-06T08:40:02.504801+0000","last_became_peered":"2024-06-06T08:40:02.504801+0000","last_unstale":"2024-06-06T08:40:41.920991+0000","last_undegraded":"2024-06-06T08:40:41.920991+0000","last_fullsized":"2024-06-06T08:40:41.920991+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:19:02.928913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'32","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:59.726906+0000","last_change":"2024-06-06T08:39:57.447508+0000","last_active":"2024-06-06T08:40:59.726906+0000","last_peered":"2024-06-06T08:40:59.726906+0000","last_clean":"2024-06-06T08:40:59.726906+0000","last_became_active":"2024-06-06T08:39:57.447118+0000","last_became_peered":"2024-06-06T08:39:57.447118+0000","last_unstale":"2024-06-06T08:40:59.726906+0000","last_undegraded":"2024-06-06T08:40:59.726906+0000","last_fullsized":"2024-06-06T08:40:59.726906+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:32:37.805274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61240,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":98,"num_write":34,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920577+0000","last_change":"2024-06-06T08:40:02.508523+0000","last_active":"2024-06-06T08:40:41.920577+0000","last_peered":"2024-06-06T08:40:41.920577+0000","last_clean":"2024-06-06T08:40:41.920577+0000","last_became_active":"2024-06-06T08:40:02.507699+0000","last_became_peered":"2024-06-06T08:40:02.507699+0000","last_unstale":"2024-06-06T08:40:41.920577+0000","last_undegraded":"2024-06-06T08:40:41.920577+0000","last_fullsized":"2024-06-06T08:40:41.920577+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:55:39.091047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918918+0000","last_change":"2024-06-06T08:39:57.446777+0000","last_active":"2024-06-06T08:40:41.918918+0000","last_peered":"2024-06-06T08:40:41.918918+0000","last_clean":"2024-06-06T08:40:41.918918+0000","last_became_active":"2024-06-06T08:39:57.446401+0000","last_became_peered":"2024-06-06T08:39:57.446401+0000","last_unstale":"2024-06-06T08:40:41.918918+0000","last_undegraded":"2024-06-06T08:40:41.918918+0000","last_fullsized":"2024-06-06T08:40:41.918918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:23:10.166458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.840239+0000","last_change":"2024-06-06T08:40:02.534562+0000","last_active":"2024-06-06T08:40:41.840239+0000","last_peered":"2024-06-06T08:40:41.840239+0000","last_clean":"2024-06-06T08:40:41.840239+0000","last_became_active":"2024-06-06T08:40:02.534204+0000","last_became_peered":"2024-06-06T08:40:02.534204+0000","last_unstale":"2024-06-06T08:40:41.840239+0000","last_undegraded":"2024-06-06T08:40:41.840239+0000","last_fullsized":"2024-06-06T08:40:41.840239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:46:53.695281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.751019+0000","last_change":"2024-06-06T08:39:57.451764+0000","last_active":"2024-06-06T08:40:41.751019+0000","last_peered":"2024-06-06T08:40:41.751019+0000","last_clean":"2024-06-06T08:40:41.751019+0000","last_became_active":"2024-06-06T08:39:57.451394+0000","last_became_peered":"2024-06-06T08:39:57.451394+0000","last_unstale":"2024-06-06T08:40:41.751019+0000","last_undegraded":"2024-06-06T08:40:41.751019+0000","last_fullsized":"2024-06-06T08:40:41.751019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:43.575913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921445+0000","last_change":"2024-06-06T08:40:02.515017+0000","last_active":"2024-06-06T08:40:41.921445+0000","last_peered":"2024-06-06T08:40:41.921445+0000","last_clean":"2024-06-06T08:40:41.921445+0000","last_became_active":"2024-06-06T08:40:02.513242+0000","last_became_peered":"2024-06-06T08:40:02.513242+0000","last_unstale":"2024-06-06T08:40:41.921445+0000","last_undegraded":"2024-06-06T08:40:41.921445+0000","last_fullsized":"2024-06-06T08:40:41.921445+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:15:13.581022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:58.744137+0000","last_change":"2024-06-06T08:39:57.451337+0000","last_active":"2024-06-06T08:40:58.744137+0000","last_peered":"2024-06-06T08:40:58.744137+0000","last_clean":"2024-06-06T08:40:58.744137+0000","last_became_active":"2024-06-06T08:39:57.450924+0000","last_became_peered":"2024-06-06T08:39:57.450924+0000","last_unstale":"2024-06-06T08:40:58.744137+0000","last_undegraded":"2024-06-06T08:40:58.744137+0000","last_fullsized":"2024-06-06T08:40:58.744137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:18:09.022874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920199+0000","last_change":"2024-06-06T08:40:02.498665+0000","last_active":"2024-06-06T08:40:41.920199+0000","last_peered":"2024-06-06T08:40:41.920199+0000","last_clean":"2024-06-06T08:40:41.920199+0000","last_became_active":"2024-06-06T08:40:02.498261+0000","last_became_peered":"2024-06-06T08:40:02.498261+0000","last_unstale":"2024-06-06T08:40:41.920199+0000","last_undegraded":"2024-06-06T08:40:41.920199+0000","last_fullsized":"2024-06-06T08:40:41.920199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:29:03.217175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919688+0000","last_change":"2024-06-06T08:39:57.663480+0000","last_active":"2024-06-06T08:40:41.919688+0000","last_peered":"2024-06-06T08:40:41.919688+0000","last_clean":"2024-06-06T08:40:41.919688+0000","last_became_active":"2024-06-06T08:39:57.663087+0000","last_became_peered":"2024-06-06T08:39:57.663087+0000","last_unstale":"2024-06-06T08:40:41.919688+0000","last_undegraded":"2024-06-06T08:40:41.919688+0000","last_fullsized":"2024-06-06T08:40:41.919688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:56:33.556397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.750872+0000","last_change":"2024-06-06T08:40:02.503083+0000","last_active":"2024-06-06T08:40:41.750872+0000","last_peered":"2024-06-06T08:40:41.750872+0000","last_clean":"2024-06-06T08:40:41.750872+0000","last_became_active":"2024-06-06T08:40:02.502713+0000","last_became_peered":"2024-06-06T08:40:02.502713+0000","last_unstale":"2024-06-06T08:40:41.750872+0000","last_undegraded":"2024-06-06T08:40:41.750872+0000","last_fullsized":"2024-06-06T08:40:41.750872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:08:47.340528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921432+0000","last_change":"2024-06-06T08:39:57.448410+0000","last_active":"2024-06-06T08:40:41.921432+0000","last_peered":"2024-06-06T08:40:41.921432+0000","last_clean":"2024-06-06T08:40:41.921432+0000","last_became_active":"2024-06-06T08:39:57.447956+0000","last_became_peered":"2024-06-06T08:39:57.447956+0000","last_unstale":"2024-06-06T08:40:41.921432+0000","last_undegraded":"2024-06-06T08:40:41.921432+0000","last_fullsized":"2024-06-06T08:40:41.921432+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:02:15.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.923452+0000","last_change":"2024-06-06T08:40:41.923452+0000","last_active":"2024-06-06T08:40:41.923452+0000","last_peered":"2024-06-06T08:40:41.923452+0000","last_clean":"2024-06-06T08:40:41.923452+0000","last_became_active":"2024-06-06T08:40:41.922936+0000","last_became_peered":"2024-06-06T08:40:41.922936+0000","last_unstale":"2024-06-06T08:40:41.923452+0000","last_undegraded":"2024-06-06T08:40:41.923452+0000","last_fullsized":"2024-06-06T08:40:41.923452+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:25:38.840662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.760528+0000","last_change":"2024-06-06T08:39:57.666054+0000","last_active":"2024-06-06T08:40:41.760528+0000","last_peered":"2024-06-06T08:40:41.760528+0000","last_clean":"2024-06-06T08:40:41.760528+0000","last_became_active":"2024-06-06T08:39:57.665084+0000","last_became_peered":"2024-06-06T08:39:57.665084+0000","last_unstale":"2024-06-06T08:40:41.760528+0000","last_undegraded":"2024-06-06T08:40:41.760528+0000","last_fullsized":"2024-06-06T08:40:41.760528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:18:51.576755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919819+0000","last_change":"2024-06-06T08:40:02.529152+0000","last_active":"2024-06-06T08:40:41.919819+0000","last_peered":"2024-06-06T08:40:41.919819+0000","last_clean":"2024-06-06T08:40:41.919819+0000","last_became_active":"2024-06-06T08:40:02.528881+0000","last_became_peered":"2024-06-06T08:40:02.528881+0000","last_unstale":"2024-06-06T08:40:41.919819+0000","last_undegraded":"2024-06-06T08:40:41.919819+0000","last_fullsized":"2024-06-06T08:40:41.919819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:18:17.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:41:01.759936+0000","last_change":"2024-06-06T08:39:57.461109+0000","last_active":"2024-06-06T08:41:01.759936+0000","last_peered":"2024-06-06T08:41:01.759936+0000","last_clean":"2024-06-06T08:41:01.759936+0000","last_became_active":"2024-06-06T08:39:57.460701+0000","last_became_peered":"2024-06-06T08:39:57.460701+0000","last_unstale":"2024-06-06T08:41:01.759936+0000","last_undegraded":"2024-06-06T08:41:01.759936+0000","last_fullsized":"2024-06-06T08:41:01.759936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:40:39.834903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920446+0000","last_change":"2024-06-06T08:40:02.525590+0000","last_active":"2024-06-06T08:40:41.920446+0000","last_peered":"2024-06-06T08:40:41.920446+0000","last_clean":"2024-06-06T08:40:41.920446+0000","last_became_active":"2024-06-06T08:40:02.525242+0000","last_became_peered":"2024-06-06T08:40:02.525242+0000","last_unstale":"2024-06-06T08:40:41.920446+0000","last_undegraded":"2024-06-06T08:40:41.920446+0000","last_fullsized":"2024-06-06T08:40:41.920446+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:46:42.121170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921045+0000","last_change":"2024-06-06T08:40:41.921045+0000","last_active":"2024-06-06T08:40:41.921045+0000","last_peered":"2024-06-06T08:40:41.921045+0000","last_clean":"2024-06-06T08:40:41.921045+0000","last_became_active":"2024-06-06T08:40:41.920644+0000","last_became_peered":"2024-06-06T08:40:41.920644+0000","last_unstale":"2024-06-06T08:40:41.921045+0000","last_undegraded":"2024-06-06T08:40:41.921045+0000","last_fullsized":"2024-06-06T08:40:41.921045+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:01:26.880961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:58.743115+0000","last_change":"2024-06-06T08:39:57.658255+0000","last_active":"2024-06-06T08:40:58.743115+0000","last_peered":"2024-06-06T08:40:58.743115+0000","last_clean":"2024-06-06T08:40:58.743115+0000","last_became_active":"2024-06-06T08:39:57.657820+0000","last_became_peered":"2024-06-06T08:39:57.657820+0000","last_unstale":"2024-06-06T08:40:58.743115+0000","last_undegraded":"2024-06-06T08:40:58.743115+0000","last_fullsized":"2024-06-06T08:40:58.743115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:16:16.475843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.927007+0000","last_change":"2024-06-06T08:40:41.927007+0000","last_active":"2024-06-06T08:40:41.927007+0000","last_peered":"2024-06-06T08:40:41.927007+0000","last_clean":"2024-06-06T08:40:41.927007+0000","last_became_active":"2024-06-06T08:40:41.925980+0000","last_became_peered":"2024-06-06T08:40:41.925980+0000","last_unstale":"2024-06-06T08:40:41.927007+0000","last_undegraded":"2024-06-06T08:40:41.927007+0000","last_fullsized":"2024-06-06T08:40:41.927007+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:12:56.234260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,1],"acting":[3,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918671+0000","last_change":"2024-06-06T08:39:57.453405+0000","last_active":"2024-06-06T08:40:41.918671+0000","last_peered":"2024-06-06T08:40:41.918671+0000","last_clean":"2024-06-06T08:40:41.918671+0000","last_became_active":"2024-06-06T08:39:57.453009+0000","last_became_peered":"2024-06-06T08:39:57.453009+0000","last_unstale":"2024-06-06T08:40:41.918671+0000","last_undegraded":"2024-06-06T08:40:41.918671+0000","last_fullsized":"2024-06-06T08:40:41.918671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:07:53.568537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921134+0000","last_change":"2024-06-06T08:38:24.084478+0000","last_active":"2024-06-06T08:40:41.921134+0000","last_peered":"2024-06-06T08:40:41.921134+0000","last_clean":"2024-06-06T08:40:41.921134+0000","last_became_active":"2024-06-06T08:38:24.083876+0000","last_became_peered":"2024-06-06T08:38:24.083876+0000","last_unstale":"2024-06-06T08:40:41.921134+0000","last_undegraded":"2024-06-06T08:40:41.921134+0000","last_fullsized":"2024-06-06T08:40:41.921134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:34:26.807146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:34:26.807146+0000","last_clean_scrub_stamp":"2024-06-06T08:34:26.807146+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:35:23.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.839972+0000","last_change":"2024-06-06T08:40:02.514489+0000","last_active":"2024-06-06T08:40:41.839972+0000","last_peered":"2024-06-06T08:40:41.839972+0000","last_clean":"2024-06-06T08:40:41.839972+0000","last_became_active":"2024-06-06T08:40:02.514072+0000","last_became_peered":"2024-06-06T08:40:02.514072+0000","last_unstale":"2024-06-06T08:40:41.839972+0000","last_undegraded":"2024-06-06T08:40:41.839972+0000","last_fullsized":"2024-06-06T08:40:41.839972+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:56:05.779543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921236+0000","last_change":"2024-06-06T08:39:57.450613+0000","last_active":"2024-06-06T08:40:41.921236+0000","last_peered":"2024-06-06T08:40:41.921236+0000","last_clean":"2024-06-06T08:40:41.921236+0000","last_became_active":"2024-06-06T08:39:57.449109+0000","last_became_peered":"2024-06-06T08:39:57.449109+0000","last_unstale":"2024-06-06T08:40:41.921236+0000","last_undegraded":"2024-06-06T08:40:41.921236+0000","last_fullsized":"2024-06-06T08:40:41.921236+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:15:10.622436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920693+0000","last_change":"2024-06-06T08:39:57.659395+0000","last_active":"2024-06-06T08:40:41.920693+0000","last_peered":"2024-06-06T08:40:41.920693+0000","last_clean":"2024-06-06T08:40:41.920693+0000","last_became_active":"2024-06-06T08:39:57.659018+0000","last_became_peered":"2024-06-06T08:39:57.659018+0000","last_unstale":"2024-06-06T08:40:41.920693+0000","last_undegraded":"2024-06-06T08:40:41.920693+0000","last_fullsized":"2024-06-06T08:40:41.920693+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:15:56.037189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.840849+0000","last_change":"2024-06-06T08:40:02.522412+0000","last_active":"2024-06-06T08:40:41.840849+0000","last_peered":"2024-06-06T08:40:41.840849+0000","last_clean":"2024-06-06T08:40:41.840849+0000","last_became_active":"2024-06-06T08:40:02.521880+0000","last_became_peered":"2024-06-06T08:40:02.521880+0000","last_unstale":"2024-06-06T08:40:41.840849+0000","last_undegraded":"2024-06-06T08:40:41.840849+0000","last_fullsized":"2024-06-06T08:40:41.840849+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:31:46.611810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'16","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:51.524857+0000","last_change":"2024-06-06T08:39:57.459036+0000","last_active":"2024-06-06T08:40:51.524857+0000","last_peered":"2024-06-06T08:40:51.524857+0000","last_clean":"2024-06-06T08:40:51.524857+0000","last_became_active":"2024-06-06T08:39:57.458500+0000","last_became_peered":"2024-06-06T08:39:57.458500+0000","last_unstale":"2024-06-06T08:40:51.524857+0000","last_undegraded":"2024-06-06T08:40:51.524857+0000","last_fullsized":"2024-06-06T08:40:51.524857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:25:35.968887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.758945+0000","last_change":"2024-06-06T08:40:02.534130+0000","last_active":"2024-06-06T08:40:41.758945+0000","last_peered":"2024-06-06T08:40:41.758945+0000","last_clean":"2024-06-06T08:40:41.758945+0000","last_became_active":"2024-06-06T08:40:02.527085+0000","last_became_peered":"2024-06-06T08:40:02.527085+0000","last_unstale":"2024-06-06T08:40:41.758945+0000","last_undegraded":"2024-06-06T08:40:41.758945+0000","last_fullsized":"2024-06-06T08:40:41.758945+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:06:07.606127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920006+0000","last_change":"2024-06-06T08:39:57.507621+0000","last_active":"2024-06-06T08:40:41.920006+0000","last_peered":"2024-06-06T08:40:41.920006+0000","last_clean":"2024-06-06T08:40:41.920006+0000","last_became_active":"2024-06-06T08:39:57.507268+0000","last_became_peered":"2024-06-06T08:39:57.507268+0000","last_unstale":"2024-06-06T08:40:41.920006+0000","last_undegraded":"2024-06-06T08:40:41.920006+0000","last_fullsized":"2024-06-06T08:40:41.920006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:15:58.191318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.923084+0000","last_change":"2024-06-06T08:40:41.923084+0000","last_active":"2024-06-06T08:40:41.923084+0000","last_peered":"2024-06-06T08:40:41.923084+0000","last_clean":"2024-06-06T08:40:41.923084+0000","last_became_active":"2024-06-06T08:40:41.922562+0000","last_became_peered":"2024-06-06T08:40:41.922562+0000","last_unstale":"2024-06-06T08:40:41.923084+0000","last_undegraded":"2024-06-06T08:40:41.923084+0000","last_fullsized":"2024-06-06T08:40:41.923084+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:12:45.467112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919861+0000","last_change":"2024-06-06T08:39:57.663754+0000","last_active":"2024-06-06T08:40:41.919861+0000","last_peered":"2024-06-06T08:40:41.919861+0000","last_clean":"2024-06-06T08:40:41.919861+0000","last_became_active":"2024-06-06T08:39:57.663356+0000","last_became_peered":"2024-06-06T08:39:57.663356+0000","last_unstale":"2024-06-06T08:40:41.919861+0000","last_undegraded":"2024-06-06T08:40:41.919861+0000","last_fullsized":"2024-06-06T08:40:41.919861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:35:33.372951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919687+0000","last_change":"2024-06-06T08:40:02.508300+0000","last_active":"2024-06-06T08:40:41.919687+0000","last_peered":"2024-06-06T08:40:41.919687+0000","last_clean":"2024-06-06T08:40:41.919687+0000","last_became_active":"2024-06-06T08:40:02.507880+0000","last_became_peered":"2024-06-06T08:40:02.507880+0000","last_unstale":"2024-06-06T08:40:41.919687+0000","last_undegraded":"2024-06-06T08:40:41.919687+0000","last_fullsized":"2024-06-06T08:40:41.919687+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:08:32.068060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.759268+0000","last_change":"2024-06-06T08:39:57.456657+0000","last_active":"2024-06-06T08:40:41.759268+0000","last_peered":"2024-06-06T08:40:41.759268+0000","last_clean":"2024-06-06T08:40:41.759268+0000","last_became_active":"2024-06-06T08:39:57.455401+0000","last_became_peered":"2024-06-06T08:39:57.455401+0000","last_unstale":"2024-06-06T08:40:41.759268+0000","last_undegraded":"2024-06-06T08:40:41.759268+0000","last_fullsized":"2024-06-06T08:40:41.759268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:21:04.840297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.752714+0000","last_change":"2024-06-06T08:40:02.520755+0000","last_active":"2024-06-06T08:40:41.752714+0000","last_peered":"2024-06-06T08:40:41.752714+0000","last_clean":"2024-06-06T08:40:41.752714+0000","last_became_active":"2024-06-06T08:40:02.520349+0000","last_became_peered":"2024-06-06T08:40:02.520349+0000","last_unstale":"2024-06-06T08:40:41.752714+0000","last_undegraded":"2024-06-06T08:40:41.752714+0000","last_fullsized":"2024-06-06T08:40:41.752714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:19:09.549764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918990+0000","last_change":"2024-06-06T08:39:57.448342+0000","last_active":"2024-06-06T08:40:41.918990+0000","last_peered":"2024-06-06T08:40:41.918990+0000","last_clean":"2024-06-06T08:40:41.918990+0000","last_became_active":"2024-06-06T08:39:57.447966+0000","last_became_peered":"2024-06-06T08:39:57.447966+0000","last_unstale":"2024-06-06T08:40:41.918990+0000","last_undegraded":"2024-06-06T08:40:41.918990+0000","last_fullsized":"2024-06-06T08:40:41.918990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:49:47.211202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.756962+0000","last_change":"2024-06-06T08:40:02.527976+0000","last_active":"2024-06-06T08:40:41.756962+0000","last_peered":"2024-06-06T08:40:41.756962+0000","last_clean":"2024-06-06T08:40:41.756962+0000","last_became_active":"2024-06-06T08:40:02.526288+0000","last_became_peered":"2024-06-06T08:40:02.526288+0000","last_unstale":"2024-06-06T08:40:41.756962+0000","last_undegraded":"2024-06-06T08:40:41.756962+0000","last_fullsized":"2024-06-06T08:40:41.756962+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:21:34.363207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919924+0000","last_change":"2024-06-06T08:39:57.450301+0000","last_active":"2024-06-06T08:40:41.919924+0000","last_peered":"2024-06-06T08:40:41.919924+0000","last_clean":"2024-06-06T08:40:41.919924+0000","last_became_active":"2024-06-06T08:39:57.449867+0000","last_became_peered":"2024-06-06T08:39:57.449867+0000","last_unstale":"2024-06-06T08:40:41.919924+0000","last_undegraded":"2024-06-06T08:40:41.919924+0000","last_fullsized":"2024-06-06T08:40:41.919924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:00:53.571075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920946+0000","last_change":"2024-06-06T08:40:02.513543+0000","last_active":"2024-06-06T08:40:41.920946+0000","last_peered":"2024-06-06T08:40:41.920946+0000","last_clean":"2024-06-06T08:40:41.920946+0000","last_became_active":"2024-06-06T08:40:02.513175+0000","last_became_peered":"2024-06-06T08:40:02.513175+0000","last_unstale":"2024-06-06T08:40:41.920946+0000","last_undegraded":"2024-06-06T08:40:41.920946+0000","last_fullsized":"2024-06-06T08:40:41.920946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:31:31.032249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:59.745981+0000","last_change":"2024-06-06T08:39:57.658281+0000","last_active":"2024-06-06T08:40:59.745981+0000","last_peered":"2024-06-06T08:40:59.745981+0000","last_clean":"2024-06-06T08:40:59.745981+0000","last_became_active":"2024-06-06T08:39:57.657807+0000","last_became_peered":"2024-06-06T08:39:57.657807+0000","last_unstale":"2024-06-06T08:40:59.745981+0000","last_undegraded":"2024-06-06T08:40:59.745981+0000","last_fullsized":"2024-06-06T08:40:59.745981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:13:07.811356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921651+0000","last_change":"2024-06-06T08:40:02.507607+0000","last_active":"2024-06-06T08:40:41.921651+0000","last_peered":"2024-06-06T08:40:41.921651+0000","last_clean":"2024-06-06T08:40:41.921651+0000","last_became_active":"2024-06-06T08:40:02.507225+0000","last_became_peered":"2024-06-06T08:40:02.507225+0000","last_unstale":"2024-06-06T08:40:41.921651+0000","last_undegraded":"2024-06-06T08:40:41.921651+0000","last_fullsized":"2024-06-06T08:40:41.921651+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:18:14.161368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.751904+0000","last_change":"2024-06-06T08:39:57.455145+0000","last_active":"2024-06-06T08:40:41.751904+0000","last_peered":"2024-06-06T08:40:41.751904+0000","last_clean":"2024-06-06T08:40:41.751904+0000","last_became_active":"2024-06-06T08:39:57.454802+0000","last_became_peered":"2024-06-06T08:39:57.454802+0000","last_unstale":"2024-06-06T08:40:41.751904+0000","last_undegraded":"2024-06-06T08:40:41.751904+0000","last_fullsized":"2024-06-06T08:40:41.751904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:13:37.287584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921369+0000","last_change":"2024-06-06T08:40:02.531229+0000","last_active":"2024-06-06T08:40:41.921369+0000","last_peered":"2024-06-06T08:40:41.921369+0000","last_clean":"2024-06-06T08:40:41.921369+0000","last_became_active":"2024-06-06T08:40:02.530944+0000","last_became_peered":"2024-06-06T08:40:02.530944+0000","last_unstale":"2024-06-06T08:40:41.921369+0000","last_undegraded":"2024-06-06T08:40:41.921369+0000","last_fullsized":"2024-06-06T08:40:41.921369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:38:42.733919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.840890+0000","last_change":"2024-06-06T08:39:57.463387+0000","last_active":"2024-06-06T08:40:41.840890+0000","last_peered":"2024-06-06T08:40:41.840890+0000","last_clean":"2024-06-06T08:40:41.840890+0000","last_became_active":"2024-06-06T08:39:57.462946+0000","last_became_peered":"2024-06-06T08:39:57.462946+0000","last_unstale":"2024-06-06T08:40:41.840890+0000","last_undegraded":"2024-06-06T08:40:41.840890+0000","last_fullsized":"2024-06-06T08:40:41.840890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:42:28.270765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.921625+0000","last_change":"2024-06-06T08:40:02.508752+0000","last_active":"2024-06-06T08:40:41.921625+0000","last_peered":"2024-06-06T08:40:41.921625+0000","last_clean":"2024-06-06T08:40:41.921625+0000","last_became_active":"2024-06-06T08:40:02.508395+0000","last_became_peered":"2024-06-06T08:40:02.508395+0000","last_unstale":"2024-06-06T08:40:41.921625+0000","last_undegraded":"2024-06-06T08:40:41.921625+0000","last_fullsized":"2024-06-06T08:40:41.921625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:49:11.516680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920976+0000","last_change":"2024-06-06T08:40:41.920976+0000","last_active":"2024-06-06T08:40:41.920976+0000","last_peered":"2024-06-06T08:40:41.920976+0000","last_clean":"2024-06-06T08:40:41.920976+0000","last_became_active":"2024-06-06T08:40:41.920483+0000","last_became_peered":"2024-06-06T08:40:41.920483+0000","last_unstale":"2024-06-06T08:40:41.920976+0000","last_undegraded":"2024-06-06T08:40:41.920976+0000","last_fullsized":"2024-06-06T08:40:41.920976+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:12:02.631659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919037+0000","last_change":"2024-06-06T08:40:02.509533+0000","last_active":"2024-06-06T08:40:41.919037+0000","last_peered":"2024-06-06T08:40:41.919037+0000","last_clean":"2024-06-06T08:40:41.919037+0000","last_became_active":"2024-06-06T08:40:02.508698+0000","last_became_peered":"2024-06-06T08:40:02.508698+0000","last_unstale":"2024-06-06T08:40:41.919037+0000","last_undegraded":"2024-06-06T08:40:41.919037+0000","last_fullsized":"2024-06-06T08:40:41.919037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:18:05.840254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.918672+0000","last_change":"2024-06-06T08:40:02.532089+0000","last_active":"2024-06-06T08:40:41.918672+0000","last_peered":"2024-06-06T08:40:41.918672+0000","last_clean":"2024-06-06T08:40:41.918672+0000","last_became_active":"2024-06-06T08:40:02.531841+0000","last_became_peered":"2024-06-06T08:40:02.531841+0000","last_unstale":"2024-06-06T08:40:41.918672+0000","last_undegraded":"2024-06-06T08:40:41.918672+0000","last_fullsized":"2024-06-06T08:40:41.918672+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:52:04.975610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.767009+0000","last_change":"2024-06-06T08:40:02.534539+0000","last_active":"2024-06-06T08:40:41.767009+0000","last_peered":"2024-06-06T08:40:41.767009+0000","last_clean":"2024-06-06T08:40:41.767009+0000","last_became_active":"2024-06-06T08:40:02.533756+0000","last_became_peered":"2024-06-06T08:40:02.533756+0000","last_unstale":"2024-06-06T08:40:41.767009+0000","last_undegraded":"2024-06-06T08:40:41.767009+0000","last_fullsized":"2024-06-06T08:40:41.767009+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:30:19.277210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.840945+0000","last_change":"2024-06-06T08:40:02.540186+0000","last_active":"2024-06-06T08:40:41.840945+0000","last_peered":"2024-06-06T08:40:41.840945+0000","last_clean":"2024-06-06T08:40:41.840945+0000","last_became_active":"2024-06-06T08:40:02.539768+0000","last_became_peered":"2024-06-06T08:40:02.539768+0000","last_unstale":"2024-06-06T08:40:41.840945+0000","last_undegraded":"2024-06-06T08:40:41.840945+0000","last_fullsized":"2024-06-06T08:40:41.840945+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:44:41.203835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.753034+0000","last_change":"2024-06-06T08:40:02.508392+0000","last_active":"2024-06-06T08:40:41.753034+0000","last_peered":"2024-06-06T08:40:41.753034+0000","last_clean":"2024-06-06T08:40:41.753034+0000","last_became_active":"2024-06-06T08:40:02.508054+0000","last_became_peered":"2024-06-06T08:40:02.508054+0000","last_unstale":"2024-06-06T08:40:41.753034+0000","last_undegraded":"2024-06-06T08:40:41.753034+0000","last_fullsized":"2024-06-06T08:40:41.753034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:59:16.879294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.919429+0000","last_change":"2024-06-06T08:40:02.508451+0000","last_active":"2024-06-06T08:40:41.919429+0000","last_peered":"2024-06-06T08:40:41.919429+0000","last_clean":"2024-06-06T08:40:41.919429+0000","last_became_active":"2024-06-06T08:40:02.505407+0000","last_became_peered":"2024-06-06T08:40:02.505407+0000","last_unstale":"2024-06-06T08:40:41.919429+0000","last_undegraded":"2024-06-06T08:40:41.919429+0000","last_fullsized":"2024-06-06T08:40:41.919429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:55:23.080525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.758629+0000","last_change":"2024-06-06T08:40:02.534845+0000","last_active":"2024-06-06T08:40:41.758629+0000","last_peered":"2024-06-06T08:40:41.758629+0000","last_clean":"2024-06-06T08:40:41.758629+0000","last_became_active":"2024-06-06T08:40:02.534463+0000","last_became_peered":"2024-06-06T08:40:02.534463+0000","last_unstale":"2024-06-06T08:40:41.758629+0000","last_undegraded":"2024-06-06T08:40:41.758629+0000","last_fullsized":"2024-06-06T08:40:41.758629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:25:17.693197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.843054+0000","last_change":"2024-06-06T08:40:41.843054+0000","last_active":"2024-06-06T08:40:41.843054+0000","last_peered":"2024-06-06T08:40:41.843054+0000","last_clean":"2024-06-06T08:40:41.843054+0000","last_became_active":"2024-06-06T08:40:41.842726+0000","last_became_peered":"2024-06-06T08:40:41.842726+0000","last_unstale":"2024-06-06T08:40:41.843054+0000","last_undegraded":"2024-06-06T08:40:41.843054+0000","last_fullsized":"2024-06-06T08:40:41.843054+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:10:46.018896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.759871+0000","last_change":"2024-06-06T08:40:02.529939+0000","last_active":"2024-06-06T08:40:41.759871+0000","last_peered":"2024-06-06T08:40:41.759871+0000","last_clean":"2024-06-06T08:40:41.759871+0000","last_became_active":"2024-06-06T08:40:02.529500+0000","last_became_peered":"2024-06-06T08:40:02.529500+0000","last_unstale":"2024-06-06T08:40:41.759871+0000","last_undegraded":"2024-06-06T08:40:41.759871+0000","last_fullsized":"2024-06-06T08:40:41.759871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:03:35.832111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.920335+0000","last_change":"2024-06-06T08:40:02.536434+0000","last_active":"2024-06-06T08:40:41.920335+0000","last_peered":"2024-06-06T08:40:41.920335+0000","last_clean":"2024-06-06T08:40:41.920335+0000","last_became_active":"2024-06-06T08:40:02.536077+0000","last_became_peered":"2024-06-06T08:40:02.536077+0000","last_unstale":"2024-06-06T08:40:41.920335+0000","last_undegraded":"2024-06-06T08:40:41.920335+0000","last_fullsized":"2024-06-06T08:40:41.920335+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:04:45.438724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.841237+0000","last_change":"2024-06-06T08:40:02.540402+0000","last_active":"2024-06-06T08:40:41.841237+0000","last_peered":"2024-06-06T08:40:41.841237+0000","last_clean":"2024-06-06T08:40:41.841237+0000","last_became_active":"2024-06-06T08:40:02.539884+0000","last_became_peered":"2024-06-06T08:40:02.539884+0000","last_unstale":"2024-06-06T08:40:41.841237+0000","last_undegraded":"2024-06-06T08:40:41.841237+0000","last_fullsized":"2024-06-06T08:40:41.841237+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:07:58.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-06T08:40:41.752673+0000","last_change":"2024-06-06T08:40:02.511737+0000","last_active":"2024-06-06T08:40:41.752673+0000","last_peered":"2024-06-06T08:40:41.752673+0000","last_clean":"2024-06-06T08:40:41.752673+0000","last_became_active":"2024-06-06T08:40:02.511373+0000","last_became_peered":"2024-06-06T08:40:02.511373+0000","last_unstale":"2024-06-06T08:40:41.752673+0000","last_undegraded":"2024-06-06T08:40:41.752673+0000","last_fullsized":"2024-06-06T08:40:41.752673+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:00:25.251603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284445,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68052,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":399,"num_read_kb":272,"num_write":246,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383708,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":480602,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645345,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1142784,"data_stored":1132871,"data_compressed":41954,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":480532,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070510,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":1007616,"data_stored":480910,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332147,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":1073427,"data_compressed":41954,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495673,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":995328,"data_stored":480249,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":542402,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":481588,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":543012,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":480074,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920837,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":480110,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":1073105,"data_compressed":41954,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T08:41:06.029 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-06T08:41:06.029 INFO:tasks.cephadm:Setting up client nodes... 2024-06-06T08:41:06.030 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-06T08:41:06.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:05 smithi037 ceph-mon[36609]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-06-06T08:41:06.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:05 smithi059 ceph-mon[36684]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-06-06T08:41:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:06.963 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:06 smithi028 ceph-mon[31564]: from='client.24668 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:41:07.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:06 smithi037 ceph-mon[36609]: from='client.24668 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:41:07.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:06 smithi059 ceph-mon[36684]: from='client.24668 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:41:07.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:07 smithi028 ceph-mon[31564]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-06T08:41:08.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:07 smithi037 ceph-mon[36609]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-06T08:41:08.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:07 smithi059 ceph-mon[36684]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-06T08:41:08.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.792+0000 7fbefe600700 1 -- 172.21.15.28:0/1090133840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbef8102510 msgr2=0x7fbef8102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:08.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.792+0000 7fbefe600700 1 --2- 172.21.15.28:0/1090133840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbef8102510 0x7fbef8102930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbee80099c0 tx=0x7fbee8009cd0 comp rx=0 tx=0).stop 2024-06-06T08:41:08.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.792+0000 7fbefe600700 1 -- 172.21.15.28:0/1090133840 shutdown_connections 2024-06-06T08:41:08.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.792+0000 7fbefe600700 1 --2- 172.21.15.28:0/1090133840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef81040b0 0x7fbef810a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:08.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.792+0000 7fbefe600700 1 --2- 172.21.15.28:0/1090133840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbef8102510 0x7fbef8102930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:08.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.792+0000 7fbefe600700 1 --2- 172.21.15.28:0/1090133840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef8103710 0x7fbef8103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:08.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.792+0000 7fbefe600700 1 -- 172.21.15.28:0/1090133840 >> 172.21.15.28:0/1090133840 conn(0x7fbef80fdab0 msgr2=0x7fbef80ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:08.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.792+0000 7fbefe600700 1 -- 172.21.15.28:0/1090133840 shutdown_connections 2024-06-06T08:41:08.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.792+0000 7fbefe600700 1 -- 172.21.15.28:0/1090133840 wait complete. 2024-06-06T08:41:08.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.793+0000 7fbefe600700 1 Processor -- start 2024-06-06T08:41:08.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.794+0000 7fbefe600700 1 -- start start 2024-06-06T08:41:08.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.794+0000 7fbefe600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbef8102510 0x7fbef8076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:08.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.794+0000 7fbefe600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef8103710 0x7fbef8074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:08.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.794+0000 7fbefe600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef81040b0 0x7fbef8074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:08.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.794+0000 7fbefe600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbef810e130 con 0x7fbef8102510 2024-06-06T08:41:08.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.794+0000 7fbefe600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbef810dfb0 con 0x7fbef81040b0 2024-06-06T08:41:08.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.794+0000 7fbefe600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbef810e2b0 con 0x7fbef8103710 2024-06-06T08:41:08.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.794+0000 7fbef6a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef8103710 0x7fbef8074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:08.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.794+0000 7fbef6a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef8103710 0x7fbef8074880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:56638/0 (socket says 172.21.15.28:56638) 2024-06-06T08:41:08.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.794+0000 7fbef6a00700 1 -- 172.21.15.28:0/3149498238 learned_addr learned my addr 172.21.15.28:0/3149498238 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:08.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.794+0000 7fbef7400700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbef8102510 0x7fbef8076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:08.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.795+0000 7fbef7e00700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef81040b0 0x7fbef8074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:08.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.795+0000 7fbef6a00700 1 -- 172.21.15.28:0/3149498238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef81040b0 msgr2=0x7fbef8074dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:08.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.795+0000 7fbef6a00700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef81040b0 0x7fbef8074dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:08.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.795+0000 7fbef6a00700 1 -- 172.21.15.28:0/3149498238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbef8102510 msgr2=0x7fbef8076230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:08.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.795+0000 7fbef6a00700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbef8102510 0x7fbef8076230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:08.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.795+0000 7fbef6a00700 1 -- 172.21.15.28:0/3149498238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef8075670 con 0x7fbef8103710 2024-06-06T08:41:08.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.795+0000 7fbef6a00700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef8103710 0x7fbef8074880 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbee400e9a0 tx=0x7fbee400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:08.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.796+0000 7fbeefe00700 1 -- 172.21.15.28:0/3149498238 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee400c9c0 con 0x7fbef8103710 2024-06-06T08:41:08.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.796+0000 7fbeefe00700 1 -- 172.21.15.28:0/3149498238 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbee400cb60 con 0x7fbef8103710 2024-06-06T08:41:08.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.796+0000 7fbeefe00700 1 -- 172.21.15.28:0/3149498238 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4018660 con 0x7fbef8103710 2024-06-06T08:41:08.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.796+0000 7fbefe600700 1 -- 172.21.15.28:0/3149498238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef81a2870 con 0x7fbef8103710 2024-06-06T08:41:08.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.796+0000 7fbefe600700 1 -- 172.21.15.28:0/3149498238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef81a2db0 con 0x7fbef8103710 2024-06-06T08:41:08.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.797+0000 7fbefe600700 1 -- 172.21.15.28:0/3149498238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef8050a00 con 0x7fbef8103710 2024-06-06T08:41:08.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.800+0000 7fbeefe00700 1 -- 172.21.15.28:0/3149498238 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbee400cd10 con 0x7fbef8103710 2024-06-06T08:41:08.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.801+0000 7fbeefe00700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbedc0a2de0 0x7fbedc0a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:08.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.801+0000 7fbeefe00700 1 -- 172.21.15.28:0/3149498238 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7fbee40cf680 con 0x7fbef8103710 2024-06-06T08:41:08.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.801+0000 7fbef7400700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbedc0a2de0 0x7fbedc0a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:08.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.802+0000 7fbef7400700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbedc0a2de0 0x7fbedc0a52a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbee800b580 tx=0x7fbee8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:08.803+0000 7fbeefe00700 1 -- 172.21.15.28:0/3149498238 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbee409c410 con 0x7fbef8103710 2024-06-06T08:41:09.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.131+0000 7fbefe600700 1 -- 172.21.15.28:0/3149498238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fbef80630a0 con 0x7fbef8103710 2024-06-06T08:41:09.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.139+0000 7fbeefe00700 1 -- 172.21.15.28:0/3149498238 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fbee409bd10 con 0x7fbef8103710 2024-06-06T08:41:09.139 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-06-06T08:41:09.140 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAldmFm/bUFCBAAUVG6jnfnTMtZM6/+zNI7gA== 2024-06-06T08:41:09.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.143+0000 7fbefe600700 1 -- 172.21.15.28:0/3149498238 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbedc0a2de0 msgr2=0x7fbedc0a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:09.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.143+0000 7fbefe600700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbedc0a2de0 0x7fbedc0a52a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbee800b580 tx=0x7fbee8005fb0 comp rx=0 tx=0).stop 2024-06-06T08:41:09.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.143+0000 7fbefe600700 1 -- 172.21.15.28:0/3149498238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef8103710 msgr2=0x7fbef8074880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:09.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.143+0000 7fbefe600700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef8103710 0x7fbef8074880 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbee400e9a0 tx=0x7fbee400ecb0 comp rx=0 tx=0).stop 2024-06-06T08:41:09.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.143+0000 7fbefe600700 1 -- 172.21.15.28:0/3149498238 shutdown_connections 2024-06-06T08:41:09.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.143+0000 7fbefe600700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbedc0a2de0 0x7fbedc0a52a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:09.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.143+0000 7fbefe600700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef81040b0 0x7fbef8074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:09.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.143+0000 7fbefe600700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbef8102510 0x7fbef8076230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:09.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.143+0000 7fbefe600700 1 --2- 172.21.15.28:0/3149498238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef8103710 0x7fbef8074880 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:09.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.143+0000 7fbefe600700 1 -- 172.21.15.28:0/3149498238 >> 172.21.15.28:0/3149498238 conn(0x7fbef80fdab0 msgr2=0x7fbef81069b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:09.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.144+0000 7fbefe600700 1 -- 172.21.15.28:0/3149498238 shutdown_connections 2024-06-06T08:41:09.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:09.144+0000 7fbefe600700 1 -- 172.21.15.28:0/3149498238 wait complete. 2024-06-06T08:41:09.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:09 smithi028 ceph-mon[31564]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-06-06T08:41:09.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:09 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/3149498238' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T08:41:09.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:09 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T08:41:09.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:09 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-06T08:41:10.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:09 smithi037 ceph-mon[36609]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-06-06T08:41:10.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:09 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/3149498238' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T08:41:10.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:09 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T08:41:10.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:09 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-06T08:41:10.074 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:41:10.074 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-06-06T08:41:10.074 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-06T08:41:10.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:09 smithi059 ceph-mon[36684]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-06-06T08:41:10.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:09 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/3149498238' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T08:41:10.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:09 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T08:41:10.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:09 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-06T08:41:10.221 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-06T08:41:10.221 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-06-06T08:41:10.222 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph mgr dump --format=json 2024-06-06T08:41:10.743 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:12.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:11 smithi028 ceph-mon[31564]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-06-06T08:41:12.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:11 smithi037 ceph-mon[36609]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-06-06T08:41:12.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:11 smithi059 ceph-mon[36684]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-06-06T08:41:13.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.061+0000 7f4a2d600700 1 -- 172.21.15.28:0/2262152528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a281030f0 msgr2=0x7f4a28107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:13.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.061+0000 7f4a2d600700 1 --2- 172.21.15.28:0/2262152528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a281030f0 0x7f4a28107110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a140098f0 tx=0x7f4a14009c00 comp rx=0 tx=0).stop 2024-06-06T08:41:13.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.061+0000 7f4a2d600700 1 -- 172.21.15.28:0/2262152528 shutdown_connections 2024-06-06T08:41:13.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.061+0000 7f4a2d600700 1 --2- 172.21.15.28:0/2262152528 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a28107840 0x7f4a2810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:13.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.061+0000 7f4a2d600700 1 --2- 172.21.15.28:0/2262152528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a28102740 0x7f4a28102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:13.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.061+0000 7f4a2d600700 1 --2- 172.21.15.28:0/2262152528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a281030f0 0x7f4a28107110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:13.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.061+0000 7f4a2d600700 1 -- 172.21.15.28:0/2262152528 >> 172.21.15.28:0/2262152528 conn(0x7f4a280795f0 msgr2=0x7f4a28079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:13.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.061+0000 7f4a2d600700 1 -- 172.21.15.28:0/2262152528 shutdown_connections 2024-06-06T08:41:13.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.061+0000 7f4a2d600700 1 -- 172.21.15.28:0/2262152528 wait complete. 2024-06-06T08:41:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.062+0000 7f4a2d600700 1 Processor -- start 2024-06-06T08:41:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a2d600700 1 -- start start 2024-06-06T08:41:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a2d600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a28102740 0x7f4a2819ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a2d600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a281030f0 0x7f4a2819b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a2d600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a28107840 0x7f4a2819f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a2d600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4a28112750 con 0x7f4a28102740 2024-06-06T08:41:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a2d600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4a281125d0 con 0x7f4a281030f0 2024-06-06T08:41:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a2d600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4a281128d0 con 0x7f4a28107840 2024-06-06T08:41:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a26a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a28102740 0x7f4a2819ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:13.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a26000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a281030f0 0x7f4a2819b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a26000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a281030f0 0x7f4a2819b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:47252/0 (socket says 172.21.15.28:47252) 2024-06-06T08:41:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a26000700 1 -- 172.21.15.28:0/467497965 learned_addr learned my addr 172.21.15.28:0/467497965 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.063+0000 7f4a26a00700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a28102740 0x7f4a2819ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53000/0 (socket says 172.21.15.28:53000) 2024-06-06T08:41:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.064+0000 7f4a27400700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a28107840 0x7f4a2819f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.064+0000 7f4a26000700 1 -- 172.21.15.28:0/467497965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a28107840 msgr2=0x7f4a2819f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.064+0000 7f4a26000700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a28107840 0x7f4a2819f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.064+0000 7f4a26000700 1 -- 172.21.15.28:0/467497965 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a28102740 msgr2=0x7f4a2819ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.064+0000 7f4a26000700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a28102740 0x7f4a2819ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.064+0000 7f4a26000700 1 -- 172.21.15.28:0/467497965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2819fe20 con 0x7f4a281030f0 2024-06-06T08:41:13.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.064+0000 7f4a26000700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a281030f0 0x7f4a2819b350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009230 tx=0x7f4a1400ff20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:13.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.064+0000 7f4a1f400700 1 -- 172.21.15.28:0/467497965 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14005490 con 0x7f4a281030f0 2024-06-06T08:41:13.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.065+0000 7f4a2d600700 1 -- 172.21.15.28:0/467497965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a281a00b0 con 0x7f4a281030f0 2024-06-06T08:41:13.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.065+0000 7f4a1f400700 1 -- 172.21.15.28:0/467497965 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a14005630 con 0x7f4a281030f0 2024-06-06T08:41:13.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.065+0000 7f4a1f400700 1 -- 172.21.15.28:0/467497965 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14003de0 con 0x7f4a281030f0 2024-06-06T08:41:13.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.065+0000 7f4a2d600700 1 -- 172.21.15.28:0/467497965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a281a7990 con 0x7f4a281030f0 2024-06-06T08:41:13.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.066+0000 7f4a2d600700 1 -- 172.21.15.28:0/467497965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a28069180 con 0x7f4a281030f0 2024-06-06T08:41:13.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.068+0000 7f4a1f400700 1 -- 172.21.15.28:0/467497965 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4a1404bb10 con 0x7f4a281030f0 2024-06-06T08:41:13.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.070+0000 7f4a1f400700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4a0c0a2d30 0x7f4a0c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:13.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.070+0000 7f4a1f400700 1 -- 172.21.15.28:0/467497965 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7f4a140cfae0 con 0x7f4a281030f0 2024-06-06T08:41:13.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.070+0000 7f4a26a00700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4a0c0a2d30 0x7f4a0c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:13.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.071+0000 7f4a26a00700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4a0c0a2d30 0x7f4a0c0a51f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009c60 tx=0x7f4a18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:13.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.072+0000 7f4a1f400700 1 -- 172.21.15.28:0/467497965 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4a14013030 con 0x7f4a281030f0 2024-06-06T08:41:13.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.371+0000 7f4a2d600700 1 -- 172.21.15.28:0/467497965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4a281a7b60 con 0x7f4a281030f0 2024-06-06T08:41:13.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.378+0000 7f4a1f400700 1 -- 172.21.15.28:0/467497965 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263200 (secure 0 0 0) 0x7f4a1401f3b0 con 0x7f4a281030f0 2024-06-06T08:41:13.382 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:41:13.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.383+0000 7f4a2d600700 1 -- 172.21.15.28:0/467497965 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4a0c0a2d30 msgr2=0x7f4a0c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:13.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.383+0000 7f4a2d600700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4a0c0a2d30 0x7f4a0c0a51f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009c60 tx=0x7f4a18009260 comp rx=0 tx=0).stop 2024-06-06T08:41:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.383+0000 7f4a2d600700 1 -- 172.21.15.28:0/467497965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a281030f0 msgr2=0x7f4a2819b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.383+0000 7f4a2d600700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a281030f0 0x7f4a2819b350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009230 tx=0x7f4a1400ff20 comp rx=0 tx=0).stop 2024-06-06T08:41:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.383+0000 7f4a2d600700 1 -- 172.21.15.28:0/467497965 shutdown_connections 2024-06-06T08:41:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.383+0000 7f4a2d600700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4a0c0a2d30 0x7f4a0c0a51f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.383+0000 7f4a2d600700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a28107840 0x7f4a2819f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.383+0000 7f4a2d600700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a28102740 0x7f4a2819ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.383+0000 7f4a2d600700 1 --2- 172.21.15.28:0/467497965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a281030f0 0x7f4a2819b350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.383+0000 7f4a2d600700 1 -- 172.21.15.28:0/467497965 >> 172.21.15.28:0/467497965 conn(0x7f4a280795f0 msgr2=0x7f4a28100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.384+0000 7f4a2d600700 1 -- 172.21.15.28:0/467497965 shutdown_connections 2024-06-06T08:41:13.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:13.384+0000 7f4a2d600700 1 -- 172.21.15.28:0/467497965 wait complete. 2024-06-06T08:41:14.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:13 smithi028 ceph-mon[31564]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:14.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:13 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/467497965' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-06T08:41:14.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:13 smithi037 ceph-mon[36609]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:14.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:13 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/467497965' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-06T08:41:14.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:13 smithi059 ceph-mon[36684]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:14.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:13 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/467497965' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-06T08:41:14.332 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2061522436},{"type":"v1","addr":"172.21.15.28:6801","nonce":2061522436}]},"active_addr":"172.21.15.28:6801/2061522436","active_change":"2024-06-06T08:31:40.065096+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.28:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":4187213908}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":1020264644}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":393570134}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":2055894821}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":3526993340}]}]} 2024-06-06T08:41:14.338 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-06-06T08:41:14.338 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-06-06T08:41:14.338 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T08:41:14.796 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:15.988 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:15 smithi028 ceph-mon[31564]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:16.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:15 smithi037 ceph-mon[36609]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:16.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:15 smithi059 ceph-mon[36684]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:16.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.931+0000 7fe652200700 1 -- 172.21.15.28:0/2039144687 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe64c1030f0 msgr2=0x7fe64c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:16.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.931+0000 7fe652200700 1 --2- 172.21.15.28:0/2039144687 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe64c1030f0 0x7fe64c107110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe6380099c0 tx=0x7fe638009cd0 comp rx=0 tx=0).stop 2024-06-06T08:41:16.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.931+0000 7fe652200700 1 -- 172.21.15.28:0/2039144687 shutdown_connections 2024-06-06T08:41:16.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.931+0000 7fe652200700 1 --2- 172.21.15.28:0/2039144687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c107840 0x7fe64c10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:16.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.931+0000 7fe652200700 1 --2- 172.21.15.28:0/2039144687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe64c102740 0x7fe64c102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:16.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.931+0000 7fe652200700 1 --2- 172.21.15.28:0/2039144687 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe64c1030f0 0x7fe64c107110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:16.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.931+0000 7fe652200700 1 -- 172.21.15.28:0/2039144687 >> 172.21.15.28:0/2039144687 conn(0x7fe64c0795f0 msgr2=0x7fe64c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:16.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.931+0000 7fe652200700 1 -- 172.21.15.28:0/2039144687 shutdown_connections 2024-06-06T08:41:16.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.931+0000 7fe652200700 1 -- 172.21.15.28:0/2039144687 wait complete. 2024-06-06T08:41:16.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.933+0000 7fe652200700 1 Processor -- start 2024-06-06T08:41:16.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.933+0000 7fe652200700 1 -- start start 2024-06-06T08:41:16.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.933+0000 7fe652200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c102740 0x7fe64c19e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:16.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.933+0000 7fe652200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe64c1030f0 0x7fe64c19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:16.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.933+0000 7fe652200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe64c107840 0x7fe64c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:16.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.933+0000 7fe652200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c112770 con 0x7fe64c1030f0 2024-06-06T08:41:16.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.933+0000 7fe652200700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c1125f0 con 0x7fe64c107840 2024-06-06T08:41:16.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.933+0000 7fe652200700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c1128f0 con 0x7fe64c102740 2024-06-06T08:41:16.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.934+0000 7fe64aa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe64c1030f0 0x7fe64c19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:16.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.934+0000 7fe64aa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe64c1030f0 0x7fe64c19ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56190/0 (socket says 172.21.15.28:56190) 2024-06-06T08:41:16.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.934+0000 7fe64aa00700 1 -- 172.21.15.28:0/3627729644 learned_addr learned my addr 172.21.15.28:0/3627729644 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:16.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.934+0000 7fe64b400700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c102740 0x7fe64c19e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:16.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.934+0000 7fe64be00700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe64c107840 0x7fe64c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:16.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.934+0000 7fe64aa00700 1 -- 172.21.15.28:0/3627729644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c102740 msgr2=0x7fe64c19e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:16.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.934+0000 7fe64aa00700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c102740 0x7fe64c19e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:16.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.934+0000 7fe64aa00700 1 -- 172.21.15.28:0/3627729644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe64c107840 msgr2=0x7fe64c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:16.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.934+0000 7fe64aa00700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe64c107840 0x7fe64c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:16.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.934+0000 7fe64aa00700 1 -- 172.21.15.28:0/3627729644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c1990d0 con 0x7fe64c1030f0 2024-06-06T08:41:16.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.935+0000 7fe64aa00700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe64c1030f0 0x7fe64c19ecf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe638006010 tx=0x7fe638003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:16.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.935+0000 7fe643e00700 1 -- 172.21.15.28:0/3627729644 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638003680 con 0x7fe64c1030f0 2024-06-06T08:41:16.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.935+0000 7fe643e00700 1 -- 172.21.15.28:0/3627729644 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe638003e50 con 0x7fe64c1030f0 2024-06-06T08:41:16.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.935+0000 7fe652200700 1 -- 172.21.15.28:0/3627729644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64c199360 con 0x7fe64c1030f0 2024-06-06T08:41:16.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.935+0000 7fe643e00700 1 -- 172.21.15.28:0/3627729644 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63800fe10 con 0x7fe64c1030f0 2024-06-06T08:41:16.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.935+0000 7fe652200700 1 -- 172.21.15.28:0/3627729644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe64c0746c0 con 0x7fe64c1030f0 2024-06-06T08:41:16.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.936+0000 7fe652200700 1 -- 172.21.15.28:0/3627729644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe64c069180 con 0x7fe64c1030f0 2024-06-06T08:41:16.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.940+0000 7fe643e00700 1 -- 172.21.15.28:0/3627729644 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe63800f460 con 0x7fe64c1030f0 2024-06-06T08:41:16.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.941+0000 7fe643e00700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe6300a2ed0 0x7fe6300a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.941+0000 7fe643e00700 1 -- 172.21.15.28:0/3627729644 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7fe6380cff00 con 0x7fe64c1030f0 2024-06-06T08:41:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.941+0000 7fe64b400700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe6300a2ed0 0x7fe6300a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.942+0000 7fe64b400700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe6300a2ed0 0x7fe6300a5390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe64c199ab0 tx=0x7fe63c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:16.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:16.944+0000 7fe643e00700 1 -- 172.21.15.28:0/3627729644 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe638013070 con 0x7fe64c1030f0 2024-06-06T08:41:17.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.176+0000 7fe652200700 1 -- 172.21.15.28:0/3627729644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe64c02dca0 con 0x7fe64c1030f0 2024-06-06T08:41:17.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.180+0000 7fe643e00700 1 -- 172.21.15.28:0/3627729644 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22526 (secure 0 0 0) 0x7fe63809cd20 con 0x7fe64c1030f0 2024-06-06T08:41:17.179 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:41:17.179 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":90,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","created":"2024-06-06T08:30:30.991501+0000","modified":"2024-06-06T08:40:41.744831+0000","last_up_change":"2024-06-06T08:38:45.850887+0000","last_in_change":"2024-06-06T08:38:26.532528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T08:34:26.800168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T08:39:56.375661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T08:40:01.096994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7edaffea-7613-4d20-b9b8-108a17af8f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6803","nonce":2001709636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6805","nonce":2001709636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6809","nonce":2001709636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6807","nonce":2001709636}]},"public_addr":"172.21.15.28:6803/2001709636","cluster_addr":"172.21.15.28:6805/2001709636","heartbeat_back_addr":"172.21.15.28:6809/2001709636","heartbeat_front_addr":"172.21.15.28:6807/2001709636","state":["exists","up"]},{"osd":1,"uuid":"17eb7536-c2a4-4f8b-bec4-b1abb5125836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6801","nonce":593429648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6803","nonce":593429648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6807","nonce":593429648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6805","nonce":593429648}]},"public_addr":"172.21.15.37:6801/593429648","cluster_addr":"172.21.15.37:6803/593429648","heartbeat_back_addr":"172.21.15.37:6807/593429648","heartbeat_front_addr":"172.21.15.37:6805/593429648","state":["exists","up"]},{"osd":2,"uuid":"3ea64fd8-13f4-4d53-933b-07055ec72701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6801","nonce":88678886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6803","nonce":88678886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6807","nonce":88678886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6805","nonce":88678886}]},"public_addr":"172.21.15.59:6801/88678886","cluster_addr":"172.21.15.59:6803/88678886","heartbeat_back_addr":"172.21.15.59:6807/88678886","heartbeat_front_addr":"172.21.15.59:6805/88678886","state":["exists","up"]},{"osd":3,"uuid":"8be9cdb5-12a9-438e-b8cd-ce65988b0ac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6811","nonce":484290430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6813","nonce":484290430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6817","nonce":484290430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6815","nonce":484290430}]},"public_addr":"172.21.15.28:6811/484290430","cluster_addr":"172.21.15.28:6813/484290430","heartbeat_back_addr":"172.21.15.28:6817/484290430","heartbeat_front_addr":"172.21.15.28:6815/484290430","state":["exists","up"]},{"osd":4,"uuid":"ddea397d-d7b1-46f3-9a13-dd318cade055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6809","nonce":3596500266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6811","nonce":3596500266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6815","nonce":3596500266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6813","nonce":3596500266}]},"public_addr":"172.21.15.37:6809/3596500266","cluster_addr":"172.21.15.37:6811/3596500266","heartbeat_back_addr":"172.21.15.37:6815/3596500266","heartbeat_front_addr":"172.21.15.37:6813/3596500266","state":["exists","up"]},{"osd":5,"uuid":"ee19857b-b047-4d15-8b17-257b6e4966a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6809","nonce":3037648282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6811","nonce":3037648282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6815","nonce":3037648282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6813","nonce":3037648282}]},"public_addr":"172.21.15.59:6809/3037648282","cluster_addr":"172.21.15.59:6811/3037648282","heartbeat_back_addr":"172.21.15.59:6815/3037648282","heartbeat_front_addr":"172.21.15.59:6813/3037648282","state":["exists","up"]},{"osd":6,"uuid":"1d57d0ba-8e37-4ac2-87e8-40b20b24fc53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6819","nonce":3794924886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6821","nonce":3794924886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6825","nonce":3794924886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6823","nonce":3794924886}]},"public_addr":"172.21.15.28:6819/3794924886","cluster_addr":"172.21.15.28:6821/3794924886","heartbeat_back_addr":"172.21.15.28:6825/3794924886","heartbeat_front_addr":"172.21.15.28:6823/3794924886","state":["exists","up"]},{"osd":7,"uuid":"43f3c2c8-752d-4a70-99dd-2c14aeefa137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6817","nonce":724042860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6819","nonce":724042860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6823","nonce":724042860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6821","nonce":724042860}]},"public_addr":"172.21.15.37:6817/724042860","cluster_addr":"172.21.15.37:6819/724042860","heartbeat_back_addr":"172.21.15.37:6823/724042860","heartbeat_front_addr":"172.21.15.37:6821/724042860","state":["exists","up"]},{"osd":8,"uuid":"3ffc07d7-ca79-419d-88a4-2b53d07ffae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6817","nonce":1240363223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6819","nonce":1240363223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6823","nonce":1240363223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6821","nonce":1240363223}]},"public_addr":"172.21.15.59:6817/1240363223","cluster_addr":"172.21.15.59:6819/1240363223","heartbeat_back_addr":"172.21.15.59:6823/1240363223","heartbeat_front_addr":"172.21.15.59:6821/1240363223","state":["exists","up"]},{"osd":9,"uuid":"4e014fc7-1ca3-4d6c-acdd-95ca59541310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6827","nonce":2555848355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6829","nonce":2555848355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6833","nonce":2555848355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6831","nonce":2555848355}]},"public_addr":"172.21.15.28:6827/2555848355","cluster_addr":"172.21.15.28:6829/2555848355","heartbeat_back_addr":"172.21.15.28:6833/2555848355","heartbeat_front_addr":"172.21.15.28:6831/2555848355","state":["exists","up"]},{"osd":10,"uuid":"fc418661-5e89-4241-b14b-241a2be432f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6825","nonce":176857372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6827","nonce":176857372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6831","nonce":176857372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6829","nonce":176857372}]},"public_addr":"172.21.15.37:6825/176857372","cluster_addr":"172.21.15.37:6827/176857372","heartbeat_back_addr":"172.21.15.37:6831/176857372","heartbeat_front_addr":"172.21.15.37:6829/176857372","state":["exists","up"]},{"osd":11,"uuid":"e54d81ee-1461-4229-a1c0-c6e750dd66ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6825","nonce":2675673798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6827","nonce":2675673798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6831","nonce":2675673798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6829","nonce":2675673798}]},"public_addr":"172.21.15.59:6825/2675673798","cluster_addr":"172.21.15.59:6827/2675673798","heartbeat_back_addr":"172.21.15.59:6831/2675673798","heartbeat_front_addr":"172.21.15.59:6829/2675673798","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:33.904270+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:58.988528+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:22.997033+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:57.171455+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:23.594371+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:48.928423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:22.957203+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:50.599655+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:16.166981+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:50.755673+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:18.677280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:44.432598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":5,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1f","mappings":[{"from":1,"to":2}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/4230567915":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/2860387445":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/886961600":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/3217551014":"2024-06-07T08:31:40.064884+0000","172.21.15.28:0/1629731223":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/219831273":"2024-06-07T08:31:04.770627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T08:41:17.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.183+0000 7fe652200700 1 -- 172.21.15.28:0/3627729644 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe6300a2ed0 msgr2=0x7fe6300a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:17.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.183+0000 7fe652200700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe6300a2ed0 0x7fe6300a5390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe64c199ab0 tx=0x7fe63c009260 comp rx=0 tx=0).stop 2024-06-06T08:41:17.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.183+0000 7fe652200700 1 -- 172.21.15.28:0/3627729644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe64c1030f0 msgr2=0x7fe64c19ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:17.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.183+0000 7fe652200700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe64c1030f0 0x7fe64c19ecf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe638006010 tx=0x7fe638003a90 comp rx=0 tx=0).stop 2024-06-06T08:41:17.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.183+0000 7fe652200700 1 -- 172.21.15.28:0/3627729644 shutdown_connections 2024-06-06T08:41:17.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.183+0000 7fe652200700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe6300a2ed0 0x7fe6300a5390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:17.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.183+0000 7fe652200700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe64c107840 0x7fe64c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:17.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.183+0000 7fe652200700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe64c102740 0x7fe64c19e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:17.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.183+0000 7fe652200700 1 --2- 172.21.15.28:0/3627729644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe64c1030f0 0x7fe64c19ecf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:17.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.183+0000 7fe652200700 1 -- 172.21.15.28:0/3627729644 >> 172.21.15.28:0/3627729644 conn(0x7fe64c0795f0 msgr2=0x7fe64c1006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:17.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.184+0000 7fe652200700 1 -- 172.21.15.28:0/3627729644 shutdown_connections 2024-06-06T08:41:17.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:17.184+0000 7fe652200700 1 -- 172.21.15.28:0/3627729644 wait complete. 2024-06-06T08:41:18.034 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:17 smithi028 ceph-mon[31564]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-06T08:41:18.034 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:17 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/3627729644' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:41:18.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:17 smithi037 ceph-mon[36609]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-06T08:41:18.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:17 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/3627729644' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:41:18.096 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-06-06T08:41:18.097 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T08:41:18.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:17 smithi059 ceph-mon[36684]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-06T08:41:18.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:17 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/3627729644' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:41:18.581 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:20.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:19 smithi028 ceph-mon[31564]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:41:20.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:19 smithi037 ceph-mon[36609]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:41:20.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:19 smithi059 ceph-mon[36684]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:41:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.956+0000 7fd867c00700 1 -- 172.21.15.28:0/3474178460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd86010a6b0 msgr2=0x7fd86010aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.956+0000 7fd867c00700 1 --2- 172.21.15.28:0/3474178460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd86010a6b0 0x7fd86010aa90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd854009990 tx=0x7fd854009ca0 comp rx=0 tx=0).stop 2024-06-06T08:41:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.956+0000 7fd867c00700 1 -- 172.21.15.28:0/3474178460 shutdown_connections 2024-06-06T08:41:20.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.956+0000 7fd867c00700 1 --2- 172.21.15.28:0/3474178460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd860105070 0x7fd860111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:20.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.956+0000 7fd867c00700 1 --2- 172.21.15.28:0/3474178460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd86010a6b0 0x7fd86010aa90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:20.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.956+0000 7fd867c00700 1 --2- 172.21.15.28:0/3474178460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8601046b0 0x7fd860104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:20.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.956+0000 7fd867c00700 1 -- 172.21.15.28:0/3474178460 >> 172.21.15.28:0/3474178460 conn(0x7fd8601001a0 msgr2=0x7fd8601025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:20.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.956+0000 7fd867c00700 1 -- 172.21.15.28:0/3474178460 shutdown_connections 2024-06-06T08:41:20.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.956+0000 7fd867c00700 1 -- 172.21.15.28:0/3474178460 wait complete. 2024-06-06T08:41:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.957+0000 7fd867c00700 1 Processor -- start 2024-06-06T08:41:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.958+0000 7fd867c00700 1 -- start start 2024-06-06T08:41:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.958+0000 7fd867c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8601046b0 0x7fd8600769a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.958+0000 7fd867c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd860105070 0x7fd860076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.958+0000 7fd867c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd86010a6b0 0x7fd860077420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.958+0000 7fd867c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd860114a50 con 0x7fd86010a6b0 2024-06-06T08:41:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.958+0000 7fd867c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd8601148d0 con 0x7fd8601046b0 2024-06-06T08:41:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.958+0000 7fd867c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd860114bd0 con 0x7fd860105070 2024-06-06T08:41:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd85fe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd860105070 0x7fd860076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:20.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd865200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8601046b0 0x7fd8600769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd865c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd86010a6b0 0x7fd860077420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd85fe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd860105070 0x7fd860076ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:39392/0 (socket says 172.21.15.28:39392) 2024-06-06T08:41:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd85fe00700 1 -- 172.21.15.28:0/2882153068 learned_addr learned my addr 172.21.15.28:0/2882153068 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd85fe00700 1 -- 172.21.15.28:0/2882153068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8601046b0 msgr2=0x7fd8600769a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd85fe00700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8601046b0 0x7fd8600769a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd85fe00700 1 -- 172.21.15.28:0/2882153068 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd86010a6b0 msgr2=0x7fd860077420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd85fe00700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd86010a6b0 0x7fd860077420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd85fe00700 1 -- 172.21.15.28:0/2882153068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8601ab550 con 0x7fd860105070 2024-06-06T08:41:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd865200700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8601046b0 0x7fd8600769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.959+0000 7fd85fe00700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd860105070 0x7fd860076ee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00e9d0 tx=0x7fd84c00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.960+0000 7fd85d600700 1 -- 172.21.15.28:0/2882153068 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00cbd0 con 0x7fd860105070 2024-06-06T08:41:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.960+0000 7fd85d600700 1 -- 172.21.15.28:0/2882153068 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd84c00ee70 con 0x7fd860105070 2024-06-06T08:41:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.960+0000 7fd867c00700 1 -- 172.21.15.28:0/2882153068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8601ab840 con 0x7fd860105070 2024-06-06T08:41:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.960+0000 7fd85d600700 1 -- 172.21.15.28:0/2882153068 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c018660 con 0x7fd860105070 2024-06-06T08:41:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.960+0000 7fd867c00700 1 -- 172.21.15.28:0/2882153068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8601abdd0 con 0x7fd860105070 2024-06-06T08:41:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.961+0000 7fd867c00700 1 -- 172.21.15.28:0/2882153068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd86010cc40 con 0x7fd860105070 2024-06-06T08:41:20.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.963+0000 7fd85d600700 1 -- 172.21.15.28:0/2882153068 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd84c010430 con 0x7fd860105070 2024-06-06T08:41:20.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.964+0000 7fd85d600700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8480a2d60 0x7fd8480a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:20.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.965+0000 7fd85d600700 1 -- 172.21.15.28:0/2882153068 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7fd84c0cf3a0 con 0x7fd860105070 2024-06-06T08:41:20.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.965+0000 7fd865200700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8480a2d60 0x7fd8480a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:20.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.965+0000 7fd865200700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8480a2d60 0x7fd8480a5220 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd85400b2e0 tx=0x7fd854005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:20.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:20.969+0000 7fd85d600700 1 -- 172.21.15.28:0/2882153068 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd84c09c130 con 0x7fd860105070 2024-06-06T08:41:21.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.200+0000 7fd867c00700 1 -- 172.21.15.28:0/2882153068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd86010c620 con 0x7fd860105070 2024-06-06T08:41:21.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.202+0000 7fd85d600700 1 -- 172.21.15.28:0/2882153068 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22526 (secure 0 0 0) 0x7fd84c00cd70 con 0x7fd860105070 2024-06-06T08:41:21.201 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:41:21.201 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":90,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","created":"2024-06-06T08:30:30.991501+0000","modified":"2024-06-06T08:40:41.744831+0000","last_up_change":"2024-06-06T08:38:45.850887+0000","last_in_change":"2024-06-06T08:38:26.532528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T08:34:26.800168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T08:39:56.375661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T08:40:01.096994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7edaffea-7613-4d20-b9b8-108a17af8f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6803","nonce":2001709636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6805","nonce":2001709636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6809","nonce":2001709636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6807","nonce":2001709636}]},"public_addr":"172.21.15.28:6803/2001709636","cluster_addr":"172.21.15.28:6805/2001709636","heartbeat_back_addr":"172.21.15.28:6809/2001709636","heartbeat_front_addr":"172.21.15.28:6807/2001709636","state":["exists","up"]},{"osd":1,"uuid":"17eb7536-c2a4-4f8b-bec4-b1abb5125836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6801","nonce":593429648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6803","nonce":593429648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6807","nonce":593429648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6805","nonce":593429648}]},"public_addr":"172.21.15.37:6801/593429648","cluster_addr":"172.21.15.37:6803/593429648","heartbeat_back_addr":"172.21.15.37:6807/593429648","heartbeat_front_addr":"172.21.15.37:6805/593429648","state":["exists","up"]},{"osd":2,"uuid":"3ea64fd8-13f4-4d53-933b-07055ec72701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6801","nonce":88678886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6803","nonce":88678886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6807","nonce":88678886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6805","nonce":88678886}]},"public_addr":"172.21.15.59:6801/88678886","cluster_addr":"172.21.15.59:6803/88678886","heartbeat_back_addr":"172.21.15.59:6807/88678886","heartbeat_front_addr":"172.21.15.59:6805/88678886","state":["exists","up"]},{"osd":3,"uuid":"8be9cdb5-12a9-438e-b8cd-ce65988b0ac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6811","nonce":484290430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6813","nonce":484290430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6817","nonce":484290430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6815","nonce":484290430}]},"public_addr":"172.21.15.28:6811/484290430","cluster_addr":"172.21.15.28:6813/484290430","heartbeat_back_addr":"172.21.15.28:6817/484290430","heartbeat_front_addr":"172.21.15.28:6815/484290430","state":["exists","up"]},{"osd":4,"uuid":"ddea397d-d7b1-46f3-9a13-dd318cade055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6809","nonce":3596500266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6811","nonce":3596500266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6815","nonce":3596500266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6813","nonce":3596500266}]},"public_addr":"172.21.15.37:6809/3596500266","cluster_addr":"172.21.15.37:6811/3596500266","heartbeat_back_addr":"172.21.15.37:6815/3596500266","heartbeat_front_addr":"172.21.15.37:6813/3596500266","state":["exists","up"]},{"osd":5,"uuid":"ee19857b-b047-4d15-8b17-257b6e4966a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6809","nonce":3037648282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6811","nonce":3037648282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6815","nonce":3037648282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6813","nonce":3037648282}]},"public_addr":"172.21.15.59:6809/3037648282","cluster_addr":"172.21.15.59:6811/3037648282","heartbeat_back_addr":"172.21.15.59:6815/3037648282","heartbeat_front_addr":"172.21.15.59:6813/3037648282","state":["exists","up"]},{"osd":6,"uuid":"1d57d0ba-8e37-4ac2-87e8-40b20b24fc53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6819","nonce":3794924886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6821","nonce":3794924886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6825","nonce":3794924886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6823","nonce":3794924886}]},"public_addr":"172.21.15.28:6819/3794924886","cluster_addr":"172.21.15.28:6821/3794924886","heartbeat_back_addr":"172.21.15.28:6825/3794924886","heartbeat_front_addr":"172.21.15.28:6823/3794924886","state":["exists","up"]},{"osd":7,"uuid":"43f3c2c8-752d-4a70-99dd-2c14aeefa137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6817","nonce":724042860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6819","nonce":724042860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6823","nonce":724042860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6821","nonce":724042860}]},"public_addr":"172.21.15.37:6817/724042860","cluster_addr":"172.21.15.37:6819/724042860","heartbeat_back_addr":"172.21.15.37:6823/724042860","heartbeat_front_addr":"172.21.15.37:6821/724042860","state":["exists","up"]},{"osd":8,"uuid":"3ffc07d7-ca79-419d-88a4-2b53d07ffae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6817","nonce":1240363223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6819","nonce":1240363223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6823","nonce":1240363223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6821","nonce":1240363223}]},"public_addr":"172.21.15.59:6817/1240363223","cluster_addr":"172.21.15.59:6819/1240363223","heartbeat_back_addr":"172.21.15.59:6823/1240363223","heartbeat_front_addr":"172.21.15.59:6821/1240363223","state":["exists","up"]},{"osd":9,"uuid":"4e014fc7-1ca3-4d6c-acdd-95ca59541310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6827","nonce":2555848355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6829","nonce":2555848355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6833","nonce":2555848355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6831","nonce":2555848355}]},"public_addr":"172.21.15.28:6827/2555848355","cluster_addr":"172.21.15.28:6829/2555848355","heartbeat_back_addr":"172.21.15.28:6833/2555848355","heartbeat_front_addr":"172.21.15.28:6831/2555848355","state":["exists","up"]},{"osd":10,"uuid":"fc418661-5e89-4241-b14b-241a2be432f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6825","nonce":176857372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6827","nonce":176857372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6831","nonce":176857372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6829","nonce":176857372}]},"public_addr":"172.21.15.37:6825/176857372","cluster_addr":"172.21.15.37:6827/176857372","heartbeat_back_addr":"172.21.15.37:6831/176857372","heartbeat_front_addr":"172.21.15.37:6829/176857372","state":["exists","up"]},{"osd":11,"uuid":"e54d81ee-1461-4229-a1c0-c6e750dd66ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6825","nonce":2675673798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6827","nonce":2675673798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6831","nonce":2675673798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6829","nonce":2675673798}]},"public_addr":"172.21.15.59:6825/2675673798","cluster_addr":"172.21.15.59:6827/2675673798","heartbeat_back_addr":"172.21.15.59:6831/2675673798","heartbeat_front_addr":"172.21.15.59:6829/2675673798","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:33.904270+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:58.988528+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:22.997033+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:57.171455+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:23.594371+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:48.928423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:22.957203+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:50.599655+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:16.166981+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:50.755673+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:18.677280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:44.432598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":5,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1f","mappings":[{"from":1,"to":2}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/4230567915":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/2860387445":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/886961600":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/3217551014":"2024-06-07T08:31:40.064884+0000","172.21.15.28:0/1629731223":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/219831273":"2024-06-07T08:31:04.770627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T08:41:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.205+0000 7fd867c00700 1 -- 172.21.15.28:0/2882153068 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8480a2d60 msgr2=0x7fd8480a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.205+0000 7fd867c00700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8480a2d60 0x7fd8480a5220 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd85400b2e0 tx=0x7fd854005fd0 comp rx=0 tx=0).stop 2024-06-06T08:41:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.205+0000 7fd867c00700 1 -- 172.21.15.28:0/2882153068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd860105070 msgr2=0x7fd860076ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.205+0000 7fd867c00700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd860105070 0x7fd860076ee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00e9d0 tx=0x7fd84c00ece0 comp rx=0 tx=0).stop 2024-06-06T08:41:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.205+0000 7fd867c00700 1 -- 172.21.15.28:0/2882153068 shutdown_connections 2024-06-06T08:41:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.205+0000 7fd867c00700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8480a2d60 0x7fd8480a5220 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.205+0000 7fd867c00700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd86010a6b0 0x7fd860077420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.205+0000 7fd867c00700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8601046b0 0x7fd8600769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.205+0000 7fd867c00700 1 --2- 172.21.15.28:0/2882153068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd860105070 0x7fd860076ee0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:21.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.205+0000 7fd867c00700 1 -- 172.21.15.28:0/2882153068 >> 172.21.15.28:0/2882153068 conn(0x7fd8601001a0 msgr2=0x7fd860100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:21.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.205+0000 7fd867c00700 1 -- 172.21.15.28:0/2882153068 shutdown_connections 2024-06-06T08:41:21.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:21.206+0000 7fd867c00700 1 -- 172.21.15.28:0/2882153068 wait complete. 2024-06-06T08:41:22.003 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:21 smithi028 ceph-mon[31564]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:41:22.003 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:21 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2882153068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:41:22.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:21 smithi037 ceph-mon[36609]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:41:22.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:21 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2882153068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:41:22.084 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-06-06T08:41:22.084 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-06-06T08:41:22.085 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-06-06T08:41:22.085 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-06-06T08:41:22.086 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-06-06T08:41:22.086 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-06-06T08:41:22.089 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-06-06T08:41:22.089 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-06-06T08:41:22.090 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-06-06T08:41:22.090 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-06-06T08:41:22.091 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-06-06T08:41:22.091 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-06-06T08:41:22.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:21 smithi059 ceph-mon[36684]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:41:22.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:21 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2882153068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:41:23.095 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:23.111 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:23.946 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:23 smithi028 ceph-mon[31564]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:23 smithi037 ceph-mon[36609]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:24.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:23 smithi059 ceph-mon[36684]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:24.763 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:24.768 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:24.768 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:24.772 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:24.783 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:24.806 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:24.810 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:24.811 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:25.971 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:25 smithi028 ceph-mon[31564]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:25 smithi037 ceph-mon[36609]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:26.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:25 smithi059 ceph-mon[36684]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.026+0000 7fde86600700 1 -- 172.21.15.28:0/1242872579 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8010eef0 msgr2=0x7fde801112e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.026+0000 7fde86600700 1 --2- 172.21.15.28:0/1242872579 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8010eef0 0x7fde801112e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fde78009990 tx=0x7fde78009ca0 comp rx=0 tx=0).stop 2024-06-06T08:41:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.026+0000 7fde86600700 1 -- 172.21.15.28:0/1242872579 shutdown_connections 2024-06-06T08:41:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.026+0000 7fde86600700 1 --2- 172.21.15.28:0/1242872579 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8010eef0 0x7fde801112e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.026+0000 7fde86600700 1 --2- 172.21.15.28:0/1242872579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde800746c0 0x7fde80074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.026+0000 7fde86600700 1 --2- 172.21.15.28:0/1242872579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde80074fe0 0x7fde8010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.026+0000 7fde86600700 1 -- 172.21.15.28:0/1242872579 >> 172.21.15.28:0/1242872579 conn(0x7fde800795f0 msgr2=0x7fde80079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.026+0000 7fde86600700 1 -- 172.21.15.28:0/1242872579 shutdown_connections 2024-06-06T08:41:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.026+0000 7fde86600700 1 -- 172.21.15.28:0/1242872579 wait complete. 2024-06-06T08:41:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.027+0000 7fde86600700 1 Processor -- start 2024-06-06T08:41:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.027+0000 7fde86600700 1 -- start start 2024-06-06T08:41:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.027+0000 7fde86600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800746c0 0x7fde8019adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde86600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde80074fe0 0x7fde8019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde86600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde8010eef0 0x7fde8019f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde86600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fde80114a20 con 0x7fde80074fe0 2024-06-06T08:41:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde86600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde801148a0 con 0x7fde8010eef0 2024-06-06T08:41:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde86600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde80114ba0 con 0x7fde800746c0 2024-06-06T08:41:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde77e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde80074fe0 0x7fde8019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde7f400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800746c0 0x7fde8019adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde77e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde80074fe0 0x7fde8019b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45852/0 (socket says 172.21.15.28:45852) 2024-06-06T08:41:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde77e00700 1 -- 172.21.15.28:0/4180321031 learned_addr learned my addr 172.21.15.28:0/4180321031 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde7fe00700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde8010eef0 0x7fde8019f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde7f400700 1 -- 172.21.15.28:0/4180321031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde8010eef0 msgr2=0x7fde8019f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde7f400700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde8010eef0 0x7fde8019f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde7f400700 1 -- 172.21.15.28:0/4180321031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde80074fe0 msgr2=0x7fde8019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde7f400700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde80074fe0 0x7fde8019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde7f400700 1 -- 172.21.15.28:0/4180321031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8019fdb0 con 0x7fde800746c0 2024-06-06T08:41:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde77e00700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde80074fe0 0x7fde8019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.028+0000 7fde7fe00700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde8010eef0 0x7fde8019f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.029+0000 7fde7f400700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800746c0 0x7fde8019adf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fde7000ef10 tx=0x7fde7000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.029+0000 7fde7cc00700 1 -- 172.21.15.28:0/4180321031 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7000c9c0 con 0x7fde800746c0 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.029+0000 7fde7cc00700 1 -- 172.21.15.28:0/4180321031 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde70019070 con 0x7fde800746c0 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.029+0000 7fde86600700 1 -- 172.21.15.28:0/4180321031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde801a0040 con 0x7fde800746c0 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.029+0000 7fde7cc00700 1 -- 172.21.15.28:0/4180321031 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde700146e0 con 0x7fde800746c0 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.029+0000 7fde86600700 1 -- 172.21.15.28:0/4180321031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde801a7920 con 0x7fde800746c0 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.030+0000 7fde86600700 1 -- 172.21.15.28:0/4180321031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde80100020 con 0x7fde800746c0 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.032+0000 7fde7cc00700 1 -- 172.21.15.28:0/4180321031 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fde70012050 con 0x7fde800746c0 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.034+0000 7fde7cc00700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fde640a2cb0 0x7fde640a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.034+0000 7fde7cc00700 1 -- 172.21.15.28:0/4180321031 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7fde700cf220 con 0x7fde800746c0 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.034+0000 7fde77e00700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fde640a2cb0 0x7fde640a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.034+0000 7fde7cc00700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282] conn(0x7fde640ac870 0x7fde640aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.034+0000 7fde7cc00700 1 -- 172.21.15.28:0/4180321031 --> [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde70008ec0 con 0x7fde640ac870 2024-06-06T08:41:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.034+0000 7fde7cc00700 1 -- 172.21.15.28:0/4180321031 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fde700d6050 con 0x7fde800746c0 2024-06-06T08:41:27.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.035+0000 7fde77e00700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fde640a2cb0 0x7fde640a5170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fde801109d0 tx=0x7fde68009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:27.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.035+0000 7fde7fe00700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282] conn(0x7fde640ac870 0x7fde640aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:27.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.035+0000 7fde7fe00700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282] conn(0x7fde640ac870 0x7fde640aed10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:27.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.036+0000 7fde7cc00700 1 -- 172.21.15.28:0/4180321031 <== osd.5 v2:172.21.15.59:6808/3037648282 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde70008ec0 con 0x7fde640ac870 2024-06-06T08:41:27.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.054+0000 7fde86600700 1 -- 172.21.15.28:0/4180321031 --> [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fde80075da0 con 0x7fde640ac870 2024-06-06T08:41:27.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.055+0000 7fde7cc00700 1 -- 172.21.15.28:0/4180321031 <== osd.5 v2:172.21.15.59:6808/3037648282 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fde80075da0 con 0x7fde640ac870 2024-06-06T08:41:27.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.055+0000 7fde86600700 1 -- 172.21.15.28:0/4180321031 >> [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282] conn(0x7fde640ac870 msgr2=0x7fde640aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:27.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.055+0000 7fde86600700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282] conn(0x7fde640ac870 0x7fde640aed10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:27.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.056+0000 7fde86600700 1 -- 172.21.15.28:0/4180321031 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fde640a2cb0 msgr2=0x7fde640a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:27.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.056+0000 7fde86600700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fde640a2cb0 0x7fde640a5170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fde801109d0 tx=0x7fde68009260 comp rx=0 tx=0).stop 2024-06-06T08:41:27.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.056+0000 7fde86600700 1 -- 172.21.15.28:0/4180321031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800746c0 msgr2=0x7fde8019adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:27.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.056+0000 7fde86600700 1 --2- 172.21.15.28:0/4180321031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800746c0 0x7fde8019adf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fde7000ef10 tx=0x7fde7000c3a0 comp rx=0 tx=0).stop 2024-06-06T08:41:27.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.056+0000 7fde7fe00700 1 -- 172.21.15.28:0/4180321031 reap_dead start 2024-06-06T08:41:27.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.056+0000 7fde86600700 1 -- 172.21.15.28:0/4180321031 shutdown_connections 2024-06-06T08:41:27.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.056+0000 7fde86600700 1 -- 172.21.15.28:0/4180321031 >> 172.21.15.28:0/4180321031 conn(0x7fde800795f0 msgr2=0x7fde800ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:27.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.056+0000 7fde86600700 1 -- 172.21.15.28:0/4180321031 shutdown_connections 2024-06-06T08:41:27.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:27.056+0000 7fde86600700 1 -- 172.21.15.28:0/4180321031 wait complete. 2024-06-06T08:41:27.890 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:27 smithi028 ceph-mon[31564]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-06T08:41:28.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:27 smithi037 ceph-mon[36609]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-06T08:41:28.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:27 smithi059 ceph-mon[36684]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-06T08:41:29.300 INFO:teuthology.orchestra.run.smithi028.stdout:163208757319 2024-06-06T08:41:29.300 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-06-06T08:41:29.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:29 smithi028 ceph-mon[31564]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:41:30.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:29 smithi037 ceph-mon[36609]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:41:30.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:29 smithi059 ceph-mon[36684]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:41:32.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:31 smithi028 ceph-mon[31564]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:41:32.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:31 smithi037 ceph-mon[36609]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:41:32.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:31 smithi059 ceph-mon[36684]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:41:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.950+0000 7fada4000700 1 -- 172.21.15.28:0/3227236396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c10ee90 msgr2=0x7fad9c111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.950+0000 7fada4000700 1 --2- 172.21.15.28:0/3227236396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c10ee90 0x7fad9c111280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fad94009f90 tx=0x7fad9400b330 comp rx=0 tx=0).stop 2024-06-06T08:41:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.951+0000 7fada4000700 1 -- 172.21.15.28:0/3227236396 shutdown_connections 2024-06-06T08:41:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.951+0000 7fada4000700 1 --2- 172.21.15.28:0/3227236396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c10ee90 0x7fad9c111280 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.951+0000 7fada4000700 1 --2- 172.21.15.28:0/3227236396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9c0746c0 0x7fad9c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.951+0000 7fada4000700 1 --2- 172.21.15.28:0/3227236396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad9c074fe0 0x7fad9c10e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.951+0000 7fada4000700 1 -- 172.21.15.28:0/3227236396 >> 172.21.15.28:0/3227236396 conn(0x7fad9c0795f0 msgr2=0x7fad9c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.951+0000 7fada4000700 1 -- 172.21.15.28:0/3227236396 shutdown_connections 2024-06-06T08:41:33.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.951+0000 7fada4000700 1 -- 172.21.15.28:0/3227236396 wait complete. 2024-06-06T08:41:33.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.952+0000 7fada4000700 1 Processor -- start 2024-06-06T08:41:33.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.952+0000 7fada4000700 1 -- start start 2024-06-06T08:41:33.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada4000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad9c0746c0 0x7fad9c19ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:33.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada4000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9c074fe0 0x7fad9c19b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:33.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada4000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c10ee90 0x7fad9c19f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:33.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada4000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c1149d0 con 0x7fad9c0746c0 2024-06-06T08:41:33.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada4000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c114850 con 0x7fad9c074fe0 2024-06-06T08:41:33.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada4000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c114b50 con 0x7fad9c10ee90 2024-06-06T08:41:33.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada1600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad9c0746c0 0x7fad9c19ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada1600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad9c0746c0 0x7fad9c19ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45866/0 (socket says 172.21.15.28:45866) 2024-06-06T08:41:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada1600700 1 -- 172.21.15.28:0/1046810870 learned_addr learned my addr 172.21.15.28:0/1046810870 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada0c00700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9c074fe0 0x7fad9c19b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada2000700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c10ee90 0x7fad9c19f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada1600700 1 -- 172.21.15.28:0/1046810870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c10ee90 msgr2=0x7fad9c19f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada1600700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c10ee90 0x7fad9c19f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada1600700 1 -- 172.21.15.28:0/1046810870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9c074fe0 msgr2=0x7fad9c19b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada1600700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9c074fe0 0x7fad9c19b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada1600700 1 -- 172.21.15.28:0/1046810870 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c19fdc0 con 0x7fad9c0746c0 2024-06-06T08:41:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.953+0000 7fada0c00700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9c074fe0 0x7fad9c19b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.954+0000 7fada1600700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad9c0746c0 0x7fad9c19ae00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e9a0 tx=0x7fad9000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.954+0000 7fad9a000700 1 -- 172.21.15.28:0/1046810870 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9000ca10 con 0x7fad9c0746c0 2024-06-06T08:41:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.954+0000 7fada4000700 1 -- 172.21.15.28:0/1046810870 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9c1a00b0 con 0x7fad9c0746c0 2024-06-06T08:41:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.954+0000 7fad9a000700 1 -- 172.21.15.28:0/1046810870 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad9000cbb0 con 0x7fad9c0746c0 2024-06-06T08:41:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.954+0000 7fad9a000700 1 -- 172.21.15.28:0/1046810870 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad90018680 con 0x7fad9c0746c0 2024-06-06T08:41:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.954+0000 7fada4000700 1 -- 172.21.15.28:0/1046810870 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9c1a7930 con 0x7fad9c0746c0 2024-06-06T08:41:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.955+0000 7fada4000700 1 -- 172.21.15.28:0/1046810870 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad9c100060 con 0x7fad9c0746c0 2024-06-06T08:41:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.957+0000 7fad9a000700 1 -- 172.21.15.28:0/1046810870 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fad90010430 con 0x7fad9c0746c0 2024-06-06T08:41:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.959+0000 7fad9a000700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fad840a2d30 0x7fad840a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.959+0000 7fad9a000700 1 -- 172.21.15.28:0/1046810870 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7fad900cfc00 con 0x7fad9c0746c0 2024-06-06T08:41:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.959+0000 7fada0c00700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fad840a2d30 0x7fad840a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.959+0000 7fad9a000700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648] conn(0x7fad840ac8f0 0x7fad840aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.959+0000 7fad9a000700 1 -- 172.21.15.28:0/1046810870 --> [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad9001bec0 con 0x7fad840ac8f0 2024-06-06T08:41:33.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.959+0000 7fad9a000700 1 -- 172.21.15.28:0/1046810870 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fad900cffb0 con 0x7fad9c0746c0 2024-06-06T08:41:33.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.960+0000 7fada2000700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648] conn(0x7fad840ac8f0 0x7fad840aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:33.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.960+0000 7fada0c00700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fad840a2d30 0x7fad840a51f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fad88009750 tx=0x7fad88009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:33.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.960+0000 7fada2000700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648] conn(0x7fad840ac8f0 0x7fad840aed90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:33.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.961+0000 7fad9a000700 1 -- 172.21.15.28:0/1046810870 <== osd.1 v2:172.21.15.37:6800/593429648 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad9001bec0 con 0x7fad840ac8f0 2024-06-06T08:41:33.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.980+0000 7fada4000700 1 -- 172.21.15.28:0/1046810870 --> [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad9c075db0 con 0x7fad840ac8f0 2024-06-06T08:41:33.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.980+0000 7fad9a000700 1 -- 172.21.15.28:0/1046810870 <== osd.1 v2:172.21.15.37:6800/593429648 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fad9c075db0 con 0x7fad840ac8f0 2024-06-06T08:41:33.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.981+0000 7fada4000700 1 -- 172.21.15.28:0/1046810870 >> [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648] conn(0x7fad840ac8f0 msgr2=0x7fad840aed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:33.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.981+0000 7fada4000700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648] conn(0x7fad840ac8f0 0x7fad840aed90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:33.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.981+0000 7fada4000700 1 -- 172.21.15.28:0/1046810870 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fad840a2d30 msgr2=0x7fad840a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:33.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.981+0000 7fada4000700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fad840a2d30 0x7fad840a51f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fad88009750 tx=0x7fad88009310 comp rx=0 tx=0).stop 2024-06-06T08:41:33.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.981+0000 7fada4000700 1 -- 172.21.15.28:0/1046810870 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad9c0746c0 msgr2=0x7fad9c19ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:33.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.981+0000 7fada4000700 1 --2- 172.21.15.28:0/1046810870 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad9c0746c0 0x7fad9c19ae00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e9a0 tx=0x7fad9000ecb0 comp rx=0 tx=0).stop 2024-06-06T08:41:33.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.981+0000 7fada2000700 1 -- 172.21.15.28:0/1046810870 reap_dead start 2024-06-06T08:41:33.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.981+0000 7fada4000700 1 -- 172.21.15.28:0/1046810870 shutdown_connections 2024-06-06T08:41:33.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.981+0000 7fada4000700 1 -- 172.21.15.28:0/1046810870 >> 172.21.15.28:0/1046810870 conn(0x7fad9c0795f0 msgr2=0x7fad9c0ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:33.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.982+0000 7fada4000700 1 -- 172.21.15.28:0/1046810870 shutdown_connections 2024-06-06T08:41:33.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:33.982+0000 7fada4000700 1 -- 172.21.15.28:0/1046810870 wait complete. 2024-06-06T08:41:34.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:33 smithi028 ceph-mon[31564]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:34.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:33 smithi037 ceph-mon[36609]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:34.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:33 smithi059 ceph-mon[36684]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:36.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:35 smithi028 ceph-mon[31564]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:36.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:35 smithi037 ceph-mon[36609]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:36.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:35 smithi059 ceph-mon[36684]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:41:37.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.107+0000 7f5ae3e00700 1 -- 172.21.15.28:0/316148021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ae4074830 msgr2=0x7f5ae4074c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.107+0000 7f5ae3e00700 1 --2- 172.21.15.28:0/316148021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ae4074830 0x7f5ae4074c10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400b0a0 tx=0x7f5ad400b3b0 comp rx=0 tx=0).stop 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.107+0000 7f5ae3e00700 1 -- 172.21.15.28:0/316148021 shutdown_connections 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.107+0000 7f5ae3e00700 1 --2- 172.21.15.28:0/316148021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae41133c0 0x7f5ae41157b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.107+0000 7f5ae3e00700 1 --2- 172.21.15.28:0/316148021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ae4074830 0x7f5ae4074c10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.107+0000 7f5ae3e00700 1 --2- 172.21.15.28:0/316148021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae4075150 0x7f5ae4112e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.107+0000 7f5ae3e00700 1 -- 172.21.15.28:0/316148021 >> 172.21.15.28:0/316148021 conn(0x7f5ae40fdea0 msgr2=0x7f5ae41002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.107+0000 7f5ae3e00700 1 -- 172.21.15.28:0/316148021 shutdown_connections 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.107+0000 7f5ae3e00700 1 -- 172.21.15.28:0/316148021 wait complete. 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.108+0000 7f5ae3e00700 1 Processor -- start 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.108+0000 7f5ae3e00700 1 -- start start 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.109+0000 7f5ae3e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ae4074830 0x7f5ae419f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:37.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.109+0000 7f5ae3e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae4075150 0x7f5ae419f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.109+0000 7f5ae3e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae41133c0 0x7f5ae41a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.109+0000 7f5ae3e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae4118d30 con 0x7f5ae4074830 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.109+0000 7f5ae3e00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae4118bb0 con 0x7f5ae4075150 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.109+0000 7f5ae3e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae4118eb0 con 0x7f5ae41133c0 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.109+0000 7f5ada000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae4075150 0x7f5ae419f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.109+0000 7f5ae2a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ae4074830 0x7f5ae419f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.109+0000 7f5ada000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae4075150 0x7f5ae419f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:41256/0 (socket says 172.21.15.28:41256) 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.109+0000 7f5ada000700 1 -- 172.21.15.28:0/3153749898 learned_addr learned my addr 172.21.15.28:0/3153749898 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.109+0000 7f5ae3400700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae41133c0 0x7f5ae41a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.110+0000 7f5ada000700 1 -- 172.21.15.28:0/3153749898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae41133c0 msgr2=0x7f5ae41a3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.110+0000 7f5ada000700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae41133c0 0x7f5ae41a3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.110+0000 7f5ada000700 1 -- 172.21.15.28:0/3153749898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ae4074830 msgr2=0x7f5ae419f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:37.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.110+0000 7f5ada000700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ae4074830 0x7f5ae419f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:37.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.110+0000 7f5ada000700 1 -- 172.21.15.28:0/3153749898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae41a41f0 con 0x7f5ae4075150 2024-06-06T08:41:37.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.110+0000 7f5ae3400700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae41133c0 0x7f5ae41a3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:37.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.110+0000 7f5ae2a00700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ae4074830 0x7f5ae419f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:37.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.110+0000 7f5ada000700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae4075150 0x7f5ae419f720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00e9a0 tx=0x7f5acc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:37.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.110+0000 7f5adbe00700 1 -- 172.21.15.28:0/3153749898 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00ca10 con 0x7f5ae4075150 2024-06-06T08:41:37.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.111+0000 7f5ae3e00700 1 -- 172.21.15.28:0/3153749898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae41a44e0 con 0x7f5ae4075150 2024-06-06T08:41:37.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.111+0000 7f5adbe00700 1 -- 172.21.15.28:0/3153749898 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5acc00cbb0 con 0x7f5ae4075150 2024-06-06T08:41:37.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.111+0000 7f5adbe00700 1 -- 172.21.15.28:0/3153749898 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc018680 con 0x7f5ae4075150 2024-06-06T08:41:37.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.111+0000 7f5ae3e00700 1 -- 172.21.15.28:0/3153749898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae41abd60 con 0x7f5ae4075150 2024-06-06T08:41:37.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.111+0000 7f5ae3e00700 1 -- 172.21.15.28:0/3153749898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ae4062be0 con 0x7f5ae4075150 2024-06-06T08:41:37.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.114+0000 7f5adbe00700 1 -- 172.21.15.28:0/3153749898 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5acc010430 con 0x7f5ae4075150 2024-06-06T08:41:37.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.115+0000 7f5adbe00700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5ac80a2cb0 0x7f5ac80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:37.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.115+0000 7f5adbe00700 1 -- 172.21.15.28:0/3153749898 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7f5acc0cfc90 con 0x7f5ae4075150 2024-06-06T08:41:37.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.115+0000 7f5ae2a00700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5ac80a2cb0 0x7f5ac80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:37.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.116+0000 7f5adbe00700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886] conn(0x7f5ac80ac870 0x7f5ac80aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:37.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.116+0000 7f5adbe00700 1 -- 172.21.15.28:0/3153749898 --> [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5acc01bec0 con 0x7f5ac80ac870 2024-06-06T08:41:37.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.116+0000 7f5adbe00700 1 -- 172.21.15.28:0/3153749898 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f5acc0d0040 con 0x7f5ae4075150 2024-06-06T08:41:37.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.116+0000 7f5ae3400700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886] conn(0x7f5ac80ac870 0x7f5ac80aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:37.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.116+0000 7f5ae2a00700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5ac80a2cb0 0x7f5ac80a5170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009fd0 tx=0x7f5ad4006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:37.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.117+0000 7f5ae3400700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886] conn(0x7f5ac80ac870 0x7f5ac80aed10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.118+0000 7f5adbe00700 1 -- 172.21.15.28:0/3153749898 <== osd.2 v2:172.21.15.59:6800/88678886 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5acc01bec0 con 0x7f5ac80ac870 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.136+0000 7f5ae3e00700 1 -- 172.21.15.28:0/3153749898 --> [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ae4062fe0 con 0x7f5ac80ac870 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.137+0000 7f5adbe00700 1 -- 172.21.15.28:0/3153749898 <== osd.2 v2:172.21.15.59:6800/88678886 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5ae4062fe0 con 0x7f5ac80ac870 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.137+0000 7f5ae3e00700 1 -- 172.21.15.28:0/3153749898 >> [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886] conn(0x7f5ac80ac870 msgr2=0x7f5ac80aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.137+0000 7f5ae3e00700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886] conn(0x7f5ac80ac870 0x7f5ac80aed10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.137+0000 7f5ae3e00700 1 -- 172.21.15.28:0/3153749898 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5ac80a2cb0 msgr2=0x7f5ac80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.137+0000 7f5ae3e00700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5ac80a2cb0 0x7f5ac80a5170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009fd0 tx=0x7f5ad4006210 comp rx=0 tx=0).stop 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.137+0000 7f5ae3e00700 1 -- 172.21.15.28:0/3153749898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae4075150 msgr2=0x7f5ae419f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.137+0000 7f5ae3e00700 1 --2- 172.21.15.28:0/3153749898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae4075150 0x7f5ae419f720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00e9a0 tx=0x7f5acc00ecb0 comp rx=0 tx=0).stop 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.137+0000 7f5ae3400700 1 -- 172.21.15.28:0/3153749898 reap_dead start 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.137+0000 7f5ae3e00700 1 -- 172.21.15.28:0/3153749898 shutdown_connections 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.137+0000 7f5ae3e00700 1 -- 172.21.15.28:0/3153749898 >> 172.21.15.28:0/3153749898 conn(0x7f5ae40fdea0 msgr2=0x7f5ae40feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:37.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.138+0000 7f5ae3e00700 1 -- 172.21.15.28:0/3153749898 shutdown_connections 2024-06-06T08:41:37.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:37.138+0000 7f5ae3e00700 1 -- 172.21.15.28:0/3153749898 wait complete. 2024-06-06T08:41:38.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:37 smithi028 ceph-mon[31564]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-06T08:41:38.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:37 smithi037 ceph-mon[36609]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-06T08:41:38.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:37 smithi059 ceph-mon[36684]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-06T08:41:38.643 INFO:teuthology.orchestra.run.smithi028.stdout:77309411418 2024-06-06T08:41:38.643 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-06-06T08:41:38.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.439+0000 7f6d33600700 1 -- 172.21.15.28:0/1896393715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d2c06a6e0 msgr2=0x7f6d2c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:38.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.439+0000 7f6d33600700 1 --2- 172.21.15.28:0/1896393715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d2c06a6e0 0x7f6d2c06ab40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009990 tx=0x7f6d18009ca0 comp rx=0 tx=0).stop 2024-06-06T08:41:38.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.439+0000 7f6d33600700 1 -- 172.21.15.28:0/1896393715 shutdown_connections 2024-06-06T08:41:38.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.439+0000 7f6d33600700 1 --2- 172.21.15.28:0/1896393715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d2c104ed0 0x7f6d2c105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:38.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.439+0000 7f6d33600700 1 --2- 172.21.15.28:0/1896393715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2c1073c0 0x7f6d2c06a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:38.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.439+0000 7f6d33600700 1 --2- 172.21.15.28:0/1896393715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d2c06a6e0 0x7f6d2c06ab40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:38.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.439+0000 7f6d33600700 1 -- 172.21.15.28:0/1896393715 >> 172.21.15.28:0/1896393715 conn(0x7f6d2c078340 msgr2=0x7f6d2c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.439+0000 7f6d33600700 1 -- 172.21.15.28:0/1896393715 shutdown_connections 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.439+0000 7f6d33600700 1 -- 172.21.15.28:0/1896393715 wait complete. 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.441+0000 7f6d33600700 1 Processor -- start 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.441+0000 7f6d33600700 1 -- start start 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d33600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d2c06a6e0 0x7f6d2c19f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d33600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2c104ed0 0x7f6d2c19f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d33600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d2c1073c0 0x7f6d2c1a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d33600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c118de0 con 0x7f6d2c06a6e0 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d33600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c118c60 con 0x7f6d2c1073c0 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d33600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c118f60 con 0x7f6d2c104ed0 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d30c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d2c06a6e0 0x7f6d2c19f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:38.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d31600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d2c1073c0 0x7f6d2c1a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d30c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d2c06a6e0 0x7f6d2c19f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49168/0 (socket says 172.21.15.28:49168) 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d31600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d2c1073c0 0x7f6d2c1a3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:41274/0 (socket says 172.21.15.28:41274) 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d30c00700 1 -- 172.21.15.28:0/555507206 learned_addr learned my addr 172.21.15.28:0/555507206 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d2be00700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2c104ed0 0x7f6d2c19f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d31600700 1 -- 172.21.15.28:0/555507206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2c104ed0 msgr2=0x7f6d2c19f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d31600700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2c104ed0 0x7f6d2c19f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d31600700 1 -- 172.21.15.28:0/555507206 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d2c06a6e0 msgr2=0x7f6d2c19f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d31600700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d2c06a6e0 0x7f6d2c19f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.442+0000 7f6d31600700 1 -- 172.21.15.28:0/555507206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c1a42a0 con 0x7f6d2c1073c0 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.443+0000 7f6d31600700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d2c1073c0 0x7f6d2c1a3b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400efc0 tx=0x7f6d2400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.443+0000 7f6d29600700 1 -- 172.21.15.28:0/555507206 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d240092e0 con 0x7f6d2c1073c0 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.443+0000 7f6d29600700 1 -- 172.21.15.28:0/555507206 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d24004bb0 con 0x7f6d2c1073c0 2024-06-06T08:41:38.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.443+0000 7f6d29600700 1 -- 172.21.15.28:0/555507206 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24004280 con 0x7f6d2c1073c0 2024-06-06T08:41:38.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.443+0000 7f6d33600700 1 -- 172.21.15.28:0/555507206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2c1a4530 con 0x7f6d2c1073c0 2024-06-06T08:41:38.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.443+0000 7f6d33600700 1 -- 172.21.15.28:0/555507206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2c1abe10 con 0x7f6d2c1073c0 2024-06-06T08:41:38.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.444+0000 7f6d33600700 1 -- 172.21.15.28:0/555507206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6d2c104910 con 0x7f6d2c1073c0 2024-06-06T08:41:38.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.446+0000 7f6d29600700 1 -- 172.21.15.28:0/555507206 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6d2401b030 con 0x7f6d2c1073c0 2024-06-06T08:41:38.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.448+0000 7f6d29600700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6d140a2d30 0x7f6d140a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:38.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.448+0000 7f6d29600700 1 -- 172.21.15.28:0/555507206 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7f6d240cf6d0 con 0x7f6d2c1073c0 2024-06-06T08:41:38.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.448+0000 7f6d30c00700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6d140a2d30 0x7f6d140a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:38.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.448+0000 7f6d29600700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223] conn(0x7f6d140ac8f0 0x7f6d140aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:38.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.448+0000 7f6d29600700 1 -- 172.21.15.28:0/555507206 --> [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d2401fe50 con 0x7f6d140ac8f0 2024-06-06T08:41:38.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.448+0000 7f6d29600700 1 -- 172.21.15.28:0/555507206 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f6d240cfa80 con 0x7f6d2c1073c0 2024-06-06T08:41:38.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.449+0000 7f6d2be00700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223] conn(0x7f6d140ac8f0 0x7f6d140aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:38.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.449+0000 7f6d30c00700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6d140a2d30 0x7f6d140a51f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009ce0 tx=0x7f6d20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:38.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.449+0000 7f6d2be00700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223] conn(0x7f6d140ac8f0 0x7f6d140aed90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:38.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.450+0000 7f6d29600700 1 -- 172.21.15.28:0/555507206 <== osd.8 v2:172.21.15.59:6816/1240363223 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d2401fe50 con 0x7f6d140ac8f0 2024-06-06T08:41:38.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.469+0000 7f6d33600700 1 -- 172.21.15.28:0/555507206 --> [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6d2c1019b0 con 0x7f6d140ac8f0 2024-06-06T08:41:38.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.470+0000 7f6d29600700 1 -- 172.21.15.28:0/555507206 <== osd.8 v2:172.21.15.59:6816/1240363223 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6d2c1019b0 con 0x7f6d140ac8f0 2024-06-06T08:41:38.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.470+0000 7f6d33600700 1 -- 172.21.15.28:0/555507206 >> [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223] conn(0x7f6d140ac8f0 msgr2=0x7f6d140aed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:38.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.470+0000 7f6d33600700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223] conn(0x7f6d140ac8f0 0x7f6d140aed90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:38.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.470+0000 7f6d33600700 1 -- 172.21.15.28:0/555507206 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6d140a2d30 msgr2=0x7f6d140a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:38.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.470+0000 7f6d33600700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6d140a2d30 0x7f6d140a51f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009ce0 tx=0x7f6d20009260 comp rx=0 tx=0).stop 2024-06-06T08:41:38.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.470+0000 7f6d33600700 1 -- 172.21.15.28:0/555507206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d2c1073c0 msgr2=0x7f6d2c1a3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:38.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.470+0000 7f6d33600700 1 --2- 172.21.15.28:0/555507206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d2c1073c0 0x7f6d2c1a3b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400efc0 tx=0x7f6d2400c3a0 comp rx=0 tx=0).stop 2024-06-06T08:41:38.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.471+0000 7f6d31600700 1 -- 172.21.15.28:0/555507206 reap_dead start 2024-06-06T08:41:38.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.471+0000 7f6d33600700 1 -- 172.21.15.28:0/555507206 shutdown_connections 2024-06-06T08:41:38.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.471+0000 7f6d33600700 1 -- 172.21.15.28:0/555507206 >> 172.21.15.28:0/555507206 conn(0x7f6d2c078340 msgr2=0x7f6d2c103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:38.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.471+0000 7f6d33600700 1 -- 172.21.15.28:0/555507206 shutdown_connections 2024-06-06T08:41:38.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:38.471+0000 7f6d33600700 1 -- 172.21.15.28:0/555507206 wait complete. 2024-06-06T08:41:39.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.463+0000 7ff955800700 1 -- 172.21.15.28:0/224585810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff950102540 msgr2=0x7ff9501029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:39.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.463+0000 7ff955800700 1 --2- 172.21.15.28:0/224585810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff950102540 0x7ff9501029a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009990 tx=0x7ff93c009ca0 comp rx=0 tx=0).stop 2024-06-06T08:41:39.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.463+0000 7ff955800700 1 -- 172.21.15.28:0/224585810 shutdown_connections 2024-06-06T08:41:39.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.463+0000 7ff955800700 1 --2- 172.21.15.28:0/224585810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff950102ee0 0x7ff95010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:39.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.463+0000 7ff955800700 1 --2- 172.21.15.28:0/224585810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff950107450 0x7ff950107830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:39.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.463+0000 7ff955800700 1 --2- 172.21.15.28:0/224585810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff950102540 0x7ff9501029a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:39.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.463+0000 7ff955800700 1 -- 172.21.15.28:0/224585810 >> 172.21.15.28:0/224585810 conn(0x7ff9500795f0 msgr2=0x7ff950079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:39.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.463+0000 7ff955800700 1 -- 172.21.15.28:0/224585810 shutdown_connections 2024-06-06T08:41:39.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.463+0000 7ff955800700 1 -- 172.21.15.28:0/224585810 wait complete. 2024-06-06T08:41:39.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.465+0000 7ff955800700 1 Processor -- start 2024-06-06T08:41:39.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.465+0000 7ff955800700 1 -- start start 2024-06-06T08:41:39.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.465+0000 7ff955800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff950102540 0x7ff95019adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff955800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff950102ee0 0x7ff95019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff955800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff950107450 0x7ff95019f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff955800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff9501127d0 con 0x7ff950107450 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff955800700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff950112650 con 0x7ff950102ee0 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff955800700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff950112950 con 0x7ff950102540 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff94f400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff950107450 0x7ff95019f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff94ea00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff950102540 0x7ff95019adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff94f400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff950107450 0x7ff95019f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49128/0 (socket says 172.21.15.28:49128) 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff94f400700 1 -- 172.21.15.28:0/1748635542 learned_addr learned my addr 172.21.15.28:0/1748635542 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff94e000700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff950102ee0 0x7ff95019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff94ea00700 1 -- 172.21.15.28:0/1748635542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff950102ee0 msgr2=0x7ff95019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff94ea00700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff950102ee0 0x7ff95019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:39.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff94ea00700 1 -- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff950107450 msgr2=0x7ff95019f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.466+0000 7ff94ea00700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff950107450 0x7ff95019f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.467+0000 7ff94ea00700 1 -- 172.21.15.28:0/1748635542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95019fe00 con 0x7ff950102540 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.467+0000 7ff94ea00700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff950102540 0x7ff95019adf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9c0 tx=0x7ff94000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.467+0000 7ff947400700 1 -- 172.21.15.28:0/1748635542 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940004220 con 0x7ff950102540 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.467+0000 7ff955800700 1 -- 172.21.15.28:0/1748635542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9501a00f0 con 0x7ff950102540 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.467+0000 7ff947400700 1 -- 172.21.15.28:0/1748635542 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9400043c0 con 0x7ff950102540 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.467+0000 7ff947400700 1 -- 172.21.15.28:0/1748635542 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940003cc0 con 0x7ff950102540 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.467+0000 7ff955800700 1 -- 172.21.15.28:0/1748635542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9501a7970 con 0x7ff950102540 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.468+0000 7ff944c00700 1 -- 172.21.15.28:0/1748635542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff950062c20 con 0x7ff950102540 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.471+0000 7ff947400700 1 -- 172.21.15.28:0/1748635542 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff94000c7c0 con 0x7ff950102540 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.472+0000 7ff947400700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff9340a2d30 0x7ff9340a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.472+0000 7ff947400700 1 -- 172.21.15.28:0/1748635542 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8248+0+0 (secure 0 0 0) 0x7ff9400cf3a0 con 0x7ff950102540 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.472+0000 7ff94e000700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff9340a2d30 0x7ff9340a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:39.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.472+0000 7ff947400700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886] conn(0x7ff9340ac8f0 0x7ff9340aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:39.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.472+0000 7ff947400700 1 -- 172.21.15.28:0/1748635542 --> [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff940001d30 con 0x7ff9340ac8f0 2024-06-06T08:41:39.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.472+0000 7ff947400700 1 -- 172.21.15.28:0/1748635542 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7ff9400d6050 con 0x7ff950102540 2024-06-06T08:41:39.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.473+0000 7ff94f400700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886] conn(0x7ff9340ac8f0 0x7ff9340aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:39.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.473+0000 7ff94e000700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff9340a2d30 0x7ff9340a51f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0098e0 tx=0x7ff93c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:39.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.473+0000 7ff94f400700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886] conn(0x7ff9340ac8f0 0x7ff9340aed90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:39.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.474+0000 7ff947400700 1 -- 172.21.15.28:0/1748635542 <== osd.6 v2:172.21.15.28:6818/3794924886 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff940001d30 con 0x7ff9340ac8f0 2024-06-06T08:41:39.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.493+0000 7ff944c00700 1 -- 172.21.15.28:0/1748635542 --> [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff950063050 con 0x7ff9340ac8f0 2024-06-06T08:41:39.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.494+0000 7ff947400700 1 -- 172.21.15.28:0/1748635542 <== osd.6 v2:172.21.15.28:6818/3794924886 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff950063050 con 0x7ff9340ac8f0 2024-06-06T08:41:39.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.494+0000 7ff944c00700 1 -- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886] conn(0x7ff9340ac8f0 msgr2=0x7ff9340aed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:39.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.494+0000 7ff944c00700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886] conn(0x7ff9340ac8f0 0x7ff9340aed90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:39.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.495+0000 7ff944c00700 1 -- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff9340a2d30 msgr2=0x7ff9340a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:39.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.495+0000 7ff944c00700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff9340a2d30 0x7ff9340a51f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0098e0 tx=0x7ff93c005960 comp rx=0 tx=0).stop 2024-06-06T08:41:39.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.495+0000 7ff944c00700 1 -- 172.21.15.28:0/1748635542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff950102540 msgr2=0x7ff95019adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:39.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.495+0000 7ff944c00700 1 --2- 172.21.15.28:0/1748635542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff950102540 0x7ff95019adf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9c0 tx=0x7ff94000ecd0 comp rx=0 tx=0).stop 2024-06-06T08:41:39.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.495+0000 7ff94f400700 1 -- 172.21.15.28:0/1748635542 reap_dead start 2024-06-06T08:41:39.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.495+0000 7ff944c00700 1 -- 172.21.15.28:0/1748635542 shutdown_connections 2024-06-06T08:41:39.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.495+0000 7ff944c00700 1 -- 172.21.15.28:0/1748635542 >> 172.21.15.28:0/1748635542 conn(0x7ff9500795f0 msgr2=0x7ff9501003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:39.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.495+0000 7ff944c00700 1 -- 172.21.15.28:0/1748635542 shutdown_connections 2024-06-06T08:41:39.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:36.495+0000 7ff944c00700 1 -- 172.21.15.28:0/1748635542 wait complete. 2024-06-06T08:41:40.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:39 smithi028 ceph-mon[31564]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:41:40.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:39 smithi037 ceph-mon[36609]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:41:40.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:39 smithi059 ceph-mon[36684]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:41:40.981 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-06-06T08:41:40.981 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-06-06T08:41:40.981 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-06-06T08:41:40.981 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:40 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-06-06T08:41:41.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-06-06T08:41:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-06-06T08:41:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-06-06T08:41:41.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:40 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-06-06T08:41:41.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-06-06T08:41:41.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-06-06T08:41:41.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-06-06T08:41:41.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:40 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-06-06T08:41:41.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.814+0000 7f25f4e00700 1 -- 172.21.15.28:0/1147375364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f0102740 msgr2=0x7f25f0102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:41.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.814+0000 7f25f4e00700 1 --2- 172.21.15.28:0/1147375364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f0102740 0x7f25f0102b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f25e00099c0 tx=0x7f25e0009cd0 comp rx=0 tx=0).stop 2024-06-06T08:41:41.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.814+0000 7f25f4e00700 1 -- 172.21.15.28:0/1147375364 shutdown_connections 2024-06-06T08:41:41.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.814+0000 7f25f4e00700 1 --2- 172.21.15.28:0/1147375364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25f0107840 0x7f25f010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:41.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.814+0000 7f25f4e00700 1 --2- 172.21.15.28:0/1147375364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f0102740 0x7f25f0102b20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:41.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.814+0000 7f25f4e00700 1 --2- 172.21.15.28:0/1147375364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f01030f0 0x7f25f0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:41.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.814+0000 7f25f4e00700 1 -- 172.21.15.28:0/1147375364 >> 172.21.15.28:0/1147375364 conn(0x7f25f00795f0 msgr2=0x7f25f0079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:41.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.814+0000 7f25f4e00700 1 -- 172.21.15.28:0/1147375364 shutdown_connections 2024-06-06T08:41:41.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.814+0000 7f25f4e00700 1 -- 172.21.15.28:0/1147375364 wait complete. 2024-06-06T08:41:41.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.815+0000 7f25f4e00700 1 Processor -- start 2024-06-06T08:41:41.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.816+0000 7f25f4e00700 1 -- start start 2024-06-06T08:41:41.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.816+0000 7f25f4e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25f0102740 0x7f25f019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:41.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.816+0000 7f25f4e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f01030f0 0x7f25f019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:41.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.816+0000 7f25f4e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f0107840 0x7f25f019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:41.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.816+0000 7f25f4e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f25f01127b0 con 0x7f25f0102740 2024-06-06T08:41:41.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.816+0000 7f25f4e00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f25f0112630 con 0x7f25f01030f0 2024-06-06T08:41:41.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.816+0000 7f25f4e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f25f0112930 con 0x7f25f0107840 2024-06-06T08:41:41.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.816+0000 7f25ede00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25f0102740 0x7f25f019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:41.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.817+0000 7f25ede00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25f0102740 0x7f25f019aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49184/0 (socket says 172.21.15.28:49184) 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.817+0000 7f25ede00700 1 -- 172.21.15.28:0/58171024 learned_addr learned my addr 172.21.15.28:0/58171024 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.817+0000 7f25ed400700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f01030f0 0x7f25f019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.817+0000 7f25ee800700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f0107840 0x7f25f019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.817+0000 7f25ed400700 1 -- 172.21.15.28:0/58171024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f0107840 msgr2=0x7f25f019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.817+0000 7f25ed400700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25f0107840 0x7f25f019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.817+0000 7f25ed400700 1 -- 172.21.15.28:0/58171024 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25f0102740 msgr2=0x7f25f019aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.817+0000 7f25ed400700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25f0102740 0x7f25f019aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.817+0000 7f25ed400700 1 -- 172.21.15.28:0/58171024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f019fe80 con 0x7f25f01030f0 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.817+0000 7f25ede00700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25f0102740 0x7f25f019aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.817+0000 7f25ed400700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f01030f0 0x7f25f019b400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00e9f0 tx=0x7f25dc00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.818+0000 7f25e6a00700 1 -- 172.21.15.28:0/58171024 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00c9c0 con 0x7f25f01030f0 2024-06-06T08:41:41.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.818+0000 7f25e6a00700 1 -- 172.21.15.28:0/58171024 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25dc00cb60 con 0x7f25f01030f0 2024-06-06T08:41:41.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.818+0000 7f25f4e00700 1 -- 172.21.15.28:0/58171024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f01a0170 con 0x7f25f01030f0 2024-06-06T08:41:41.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.818+0000 7f25e6a00700 1 -- 172.21.15.28:0/58171024 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc018680 con 0x7f25f01030f0 2024-06-06T08:41:41.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.818+0000 7f25f4e00700 1 -- 172.21.15.28:0/58171024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f01a79f0 con 0x7f25f01030f0 2024-06-06T08:41:41.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.819+0000 7f25f4e00700 1 -- 172.21.15.28:0/58171024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25f0075a20 con 0x7f25f01030f0 2024-06-06T08:41:41.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.822+0000 7f25e6a00700 1 -- 172.21.15.28:0/58171024 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f25dc010430 con 0x7f25f01030f0 2024-06-06T08:41:41.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.823+0000 7f25e6a00700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f25d40a2d30 0x7f25d40a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:41.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.824+0000 7f25e6a00700 1 -- 172.21.15.28:0/58171024 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8364+0+0 (secure 0 0 0) 0x7f25dc0cf7f0 con 0x7f25f01030f0 2024-06-06T08:41:41.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.824+0000 7f25ede00700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f25d40a2d30 0x7f25d40a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:41.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.824+0000 7f25e6a00700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860] conn(0x7f25d40acaf0 0x7f25d40aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:41.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.824+0000 7f25e6a00700 1 -- 172.21.15.28:0/58171024 --> [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25dc01bec0 con 0x7f25d40acaf0 2024-06-06T08:41:41.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.824+0000 7f25e6a00700 1 -- 172.21.15.28:0/58171024 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f25dc0cfba0 con 0x7f25f01030f0 2024-06-06T08:41:41.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.824+0000 7f25ee800700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860] conn(0x7f25d40acaf0 0x7f25d40aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:41.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.824+0000 7f25ede00700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f25d40a2d30 0x7f25d40a51f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009990 tx=0x7f25e0005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:41.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.825+0000 7f25ee800700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860] conn(0x7f25d40acaf0 0x7f25d40aef90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:41.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.826+0000 7f25e6a00700 1 -- 172.21.15.28:0/58171024 <== osd.7 v2:172.21.15.37:6816/724042860 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25dc01bec0 con 0x7f25d40acaf0 2024-06-06T08:41:41.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.851+0000 7f25f4e00700 1 -- 172.21.15.28:0/58171024 --> [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25f0103bd0 con 0x7f25d40acaf0 2024-06-06T08:41:41.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.851+0000 7f25e6a00700 1 -- 172.21.15.28:0/58171024 <== osd.7 v2:172.21.15.37:6816/724042860 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f25f0103bd0 con 0x7f25d40acaf0 2024-06-06T08:41:41.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.852+0000 7f25f4e00700 1 -- 172.21.15.28:0/58171024 >> [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860] conn(0x7f25d40acaf0 msgr2=0x7f25d40aef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:41.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.852+0000 7f25f4e00700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860] conn(0x7f25d40acaf0 0x7f25d40aef90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:41.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.852+0000 7f25f4e00700 1 -- 172.21.15.28:0/58171024 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f25d40a2d30 msgr2=0x7f25d40a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:41.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.852+0000 7f25f4e00700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f25d40a2d30 0x7f25d40a51f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009990 tx=0x7f25e0005ab0 comp rx=0 tx=0).stop 2024-06-06T08:41:41.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.852+0000 7f25f4e00700 1 -- 172.21.15.28:0/58171024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f01030f0 msgr2=0x7f25f019b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:41.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.852+0000 7f25f4e00700 1 --2- 172.21.15.28:0/58171024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f01030f0 0x7f25f019b400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00e9f0 tx=0x7f25dc00ed00 comp rx=0 tx=0).stop 2024-06-06T08:41:41.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.852+0000 7f25ee800700 1 -- 172.21.15.28:0/58171024 reap_dead start 2024-06-06T08:41:41.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.852+0000 7f25f4e00700 1 -- 172.21.15.28:0/58171024 shutdown_connections 2024-06-06T08:41:41.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.852+0000 7f25f4e00700 1 -- 172.21.15.28:0/58171024 >> 172.21.15.28:0/58171024 conn(0x7f25f00795f0 msgr2=0x7f25f0101ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:41.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.852+0000 7f25f4e00700 1 -- 172.21.15.28:0/58171024 shutdown_connections 2024-06-06T08:41:41.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.852+0000 7f25f4e00700 1 -- 172.21.15.28:0/58171024 wait complete. 2024-06-06T08:41:42.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:41 smithi059 ceph-mon[36684]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2024-06-06T08:41:42.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-06-06T08:41:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-06-06T08:41:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-06-06T08:41:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:41 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-06-06T08:41:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:41 smithi059 ceph-mon[36684]: osdmap e91: 12 total, 12 up, 12 in 2024-06-06T08:41:42.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:41 smithi059 ceph-mon[36684]: osdmap e92: 12 total, 12 up, 12 in 2024-06-06T08:41:42.159 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:41 smithi028 ceph-mon[31564]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2024-06-06T08:41:42.159 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-06-06T08:41:42.159 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-06-06T08:41:42.159 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-06-06T08:41:42.159 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:41 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-06-06T08:41:42.159 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:41 smithi028 ceph-mon[31564]: osdmap e91: 12 total, 12 up, 12 in 2024-06-06T08:41:42.159 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:41 smithi028 ceph-mon[31564]: osdmap e92: 12 total, 12 up, 12 in 2024-06-06T08:41:42.208 INFO:teuthology.orchestra.run.smithi028.stdout:55834574941 2024-06-06T08:41:42.208 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-06-06T08:41:42.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.203+0000 7f3306000700 1 -- 172.21.15.28:0/106186673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33001094c0 msgr2=0x7f3300115980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:42.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.203+0000 7f3306000700 1 --2- 172.21.15.28:0/106186673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33001094c0 0x7f3300115980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f32f800b0a0 tx=0x7f32f800b3b0 comp rx=0 tx=0).stop 2024-06-06T08:41:42.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.203+0000 7f3306000700 1 -- 172.21.15.28:0/106186673 shutdown_connections 2024-06-06T08:41:42.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.203+0000 7f3306000700 1 --2- 172.21.15.28:0/106186673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33001094c0 0x7f3300115980 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:42.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.203+0000 7f3306000700 1 --2- 172.21.15.28:0/106186673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f330010eab0 0x7f330010ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:42.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.203+0000 7f3306000700 1 --2- 172.21.15.28:0/106186673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3300108b00 0x7f3300108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:42.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.203+0000 7f3306000700 1 -- 172.21.15.28:0/106186673 >> 172.21.15.28:0/106186673 conn(0x7f3300075c60 msgr2=0x7f3300078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:42.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.203+0000 7f3306000700 1 -- 172.21.15.28:0/106186673 shutdown_connections 2024-06-06T08:41:42.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.203+0000 7f3306000700 1 -- 172.21.15.28:0/106186673 wait complete. 2024-06-06T08:41:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.204+0000 7f3306000700 1 Processor -- start 2024-06-06T08:41:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.204+0000 7f3306000700 1 -- start start 2024-06-06T08:41:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.205+0000 7f3306000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3300108b00 0x7f330019f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.205+0000 7f3306000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33001094c0 0x7f330019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.205+0000 7f3306000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330010eab0 0x7f33001a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.205+0000 7f3306000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3300118e00 con 0x7f3300108b00 2024-06-06T08:41:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.205+0000 7f3306000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3300118c80 con 0x7f33001094c0 2024-06-06T08:41:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.205+0000 7f3306000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3300118f80 con 0x7f330010eab0 2024-06-06T08:41:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.205+0000 7f32ff400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3300108b00 0x7f330019f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.205+0000 7f32fea00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33001094c0 0x7f330019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.205+0000 7f32ffe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330010eab0 0x7f33001a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.205+0000 7f32ff400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3300108b00 0x7f330019f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49178/0 (socket says 172.21.15.28:49178) 2024-06-06T08:41:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.205+0000 7f32ff400700 1 -- 172.21.15.28:0/1474267129 learned_addr learned my addr 172.21.15.28:0/1474267129 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f32fea00700 1 -- 172.21.15.28:0/1474267129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330010eab0 msgr2=0x7f33001a3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f32fea00700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330010eab0 0x7f33001a3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f32fea00700 1 -- 172.21.15.28:0/1474267129 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3300108b00 msgr2=0x7f330019f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f32fea00700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3300108b00 0x7f330019f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f32fea00700 1 -- 172.21.15.28:0/1474267129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33001a41e0 con 0x7f33001094c0 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f32ffe00700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330010eab0 0x7f33001a3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f32fea00700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33001094c0 0x7f330019f710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00e9f0 tx=0x7f32ec00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f32f7e00700 1 -- 172.21.15.28:0/1474267129 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec004220 con 0x7f33001094c0 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f32f7e00700 1 -- 172.21.15.28:0/1474267129 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32ec004d10 con 0x7f33001094c0 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f3306000700 1 -- 172.21.15.28:0/1474267129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33001a44d0 con 0x7f33001094c0 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f32f7e00700 1 -- 172.21.15.28:0/1474267129 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec005020 con 0x7f33001094c0 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.206+0000 7f3306000700 1 -- 172.21.15.28:0/1474267129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33001abd50 con 0x7f33001094c0 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.207+0000 7f32f5600700 1 -- 172.21.15.28:0/1474267129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32d8001030 con 0x7f33001094c0 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.209+0000 7f32f7e00700 1 -- 172.21.15.28:0/1474267129 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f32ec004750 con 0x7f33001094c0 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.211+0000 7f32f7e00700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f32e40a2cb0 0x7f32e40a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.211+0000 7f32f7e00700 1 -- 172.21.15.28:0/1474267129 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8364+0+0 (secure 0 0 0) 0x7f32ec0cf420 con 0x7f33001094c0 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.211+0000 7f32ff400700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f32e40a2cb0 0x7f32e40a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:42.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.211+0000 7f32f7e00700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266] conn(0x7f32e40aca70 0x7f32e40aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.211+0000 7f32f7e00700 1 -- 172.21.15.28:0/1474267129 --> [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32ec016ec0 con 0x7f32e40aca70 2024-06-06T08:41:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.211+0000 7f32f7e00700 1 -- 172.21.15.28:0/1474267129 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f32ec0cf7d0 con 0x7f33001094c0 2024-06-06T08:41:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.212+0000 7f32ffe00700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266] conn(0x7f32e40aca70 0x7f32e40aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.212+0000 7f32ff400700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f32e40a2cb0 0x7f32e40a5170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009ca0 tx=0x7f32f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.212+0000 7f32ffe00700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266] conn(0x7f32e40aca70 0x7f32e40aef10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.213+0000 7f32f7e00700 1 -- 172.21.15.28:0/1474267129 <== osd.4 v2:172.21.15.37:6808/3596500266 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f32ec016ec0 con 0x7f32e40aca70 2024-06-06T08:41:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.232+0000 7f32f5600700 1 -- 172.21.15.28:0/1474267129 --> [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f32d8002e60 con 0x7f32e40aca70 2024-06-06T08:41:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.233+0000 7f32f7e00700 1 -- 172.21.15.28:0/1474267129 <== osd.4 v2:172.21.15.37:6808/3596500266 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f32d8002e60 con 0x7f32e40aca70 2024-06-06T08:41:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.236+0000 7f32f5600700 1 -- 172.21.15.28:0/1474267129 >> [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266] conn(0x7f32e40aca70 msgr2=0x7f32e40aef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.236+0000 7f32f5600700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266] conn(0x7f32e40aca70 0x7f32e40aef10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.237+0000 7f32f5600700 1 -- 172.21.15.28:0/1474267129 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f32e40a2cb0 msgr2=0x7f32e40a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.237+0000 7f32f5600700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f32e40a2cb0 0x7f32e40a5170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009ca0 tx=0x7f32f0009260 comp rx=0 tx=0).stop 2024-06-06T08:41:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.237+0000 7f32f5600700 1 -- 172.21.15.28:0/1474267129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33001094c0 msgr2=0x7f330019f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.237+0000 7f32f5600700 1 --2- 172.21.15.28:0/1474267129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33001094c0 0x7f330019f710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00e9f0 tx=0x7f32ec00ed00 comp rx=0 tx=0).stop 2024-06-06T08:41:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.237+0000 7f32ffe00700 1 -- 172.21.15.28:0/1474267129 reap_dead start 2024-06-06T08:41:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.237+0000 7f32f5600700 1 -- 172.21.15.28:0/1474267129 shutdown_connections 2024-06-06T08:41:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.237+0000 7f32f5600700 1 -- 172.21.15.28:0/1474267129 >> 172.21.15.28:0/1474267129 conn(0x7f3300075c60 msgr2=0x7f3300076140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.241+0000 7f32f5600700 1 -- 172.21.15.28:0/1474267129 shutdown_connections 2024-06-06T08:41:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:41.241+0000 7f32f5600700 1 -- 172.21.15.28:0/1474267129 wait complete. 2024-06-06T08:41:42.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:41 smithi037 ceph-mon[36609]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 10 op/s 2024-06-06T08:41:42.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-06-06T08:41:42.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-06-06T08:41:42.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-06-06T08:41:42.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:41 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-06-06T08:41:42.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:41 smithi037 ceph-mon[36609]: osdmap e91: 12 total, 12 up, 12 in 2024-06-06T08:41:42.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:41 smithi037 ceph-mon[36609]: osdmap e92: 12 total, 12 up, 12 in 2024-06-06T08:41:43.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.794+0000 7faa98a00700 1 -- 172.21.15.28:0/732885584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9410a6a0 msgr2=0x7faa9410aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:43.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.794+0000 7faa98a00700 1 --2- 172.21.15.28:0/732885584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9410a6a0 0x7faa9410aa80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faa840098f0 tx=0x7faa84009c00 comp rx=0 tx=0).stop 2024-06-06T08:41:43.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.794+0000 7faa98a00700 1 -- 172.21.15.28:0/732885584 shutdown_connections 2024-06-06T08:41:43.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.794+0000 7faa98a00700 1 --2- 172.21.15.28:0/732885584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa94105060 0x7faa94111570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:43.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.794+0000 7faa98a00700 1 --2- 172.21.15.28:0/732885584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9410a6a0 0x7faa9410aa80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:43.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.794+0000 7faa98a00700 1 --2- 172.21.15.28:0/732885584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa941046a0 0x7faa94104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:43.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.794+0000 7faa98a00700 1 -- 172.21.15.28:0/732885584 >> 172.21.15.28:0/732885584 conn(0x7faa94100190 msgr2=0x7faa941025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:43.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.794+0000 7faa98a00700 1 -- 172.21.15.28:0/732885584 shutdown_connections 2024-06-06T08:41:43.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.794+0000 7faa98a00700 1 -- 172.21.15.28:0/732885584 wait complete. 2024-06-06T08:41:43.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.795+0000 7faa98a00700 1 Processor -- start 2024-06-06T08:41:43.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa98a00700 1 -- start start 2024-06-06T08:41:43.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa98a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa941046a0 0x7faa9419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:43.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa98a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa94105060 0x7faa9419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:43.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa98a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9410a6a0 0x7faa9419f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:43.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa98a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa941149f0 con 0x7faa941046a0 2024-06-06T08:41:43.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa98a00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa94114870 con 0x7faa94105060 2024-06-06T08:41:43.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa98a00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faa94114b70 con 0x7faa9410a6a0 2024-06-06T08:41:43.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa91e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa941046a0 0x7faa9419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:43.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa91400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa94105060 0x7faa9419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:43.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa91e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa941046a0 0x7faa9419ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49212/0 (socket says 172.21.15.28:49212) 2024-06-06T08:41:43.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa91e00700 1 -- 172.21.15.28:0/2832969982 learned_addr learned my addr 172.21.15.28:0/2832969982 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:43.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.796+0000 7faa92800700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9410a6a0 0x7faa9419f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:43.169 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:42 smithi028 ceph-mon[31564]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-06T08:41:43.169 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:42 smithi028 ceph-mon[31564]: Health check failed: Degraded data redundancy: 2/306 objects degraded (0.654%), 1 pg degraded (PG_DEGRADED) 2024-06-06T08:41:43.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa91400700 1 -- 172.21.15.28:0/2832969982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9410a6a0 msgr2=0x7faa9419f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:43.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa91400700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9410a6a0 0x7faa9419f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:43.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa91400700 1 -- 172.21.15.28:0/2832969982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa941046a0 msgr2=0x7faa9419ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:43.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa91400700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa941046a0 0x7faa9419ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:43.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa91400700 1 -- 172.21.15.28:0/2832969982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9419fe50 con 0x7faa94105060 2024-06-06T08:41:43.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa92800700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa9410a6a0 0x7faa9419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:41:43.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa91e00700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa941046a0 0x7faa9419ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:43.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa91400700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa94105060 0x7faa9419b380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faa8000e9c0 tx=0x7faa8000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:43.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa8aa00700 1 -- 172.21.15.28:0/2832969982 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80004220 con 0x7faa94105060 2024-06-06T08:41:43.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa8aa00700 1 -- 172.21.15.28:0/2832969982 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa80004d10 con 0x7faa94105060 2024-06-06T08:41:43.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa98a00700 1 -- 172.21.15.28:0/2832969982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa941a0140 con 0x7faa94105060 2024-06-06T08:41:43.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa8aa00700 1 -- 172.21.15.28:0/2832969982 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80005020 con 0x7faa94105060 2024-06-06T08:41:43.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.797+0000 7faa98a00700 1 -- 172.21.15.28:0/2832969982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa941a79c0 con 0x7faa94105060 2024-06-06T08:41:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.798+0000 7faa98a00700 1 -- 172.21.15.28:0/2832969982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa94062c20 con 0x7faa94105060 2024-06-06T08:41:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.801+0000 7faa8aa00700 1 -- 172.21.15.28:0/2832969982 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faa80004750 con 0x7faa94105060 2024-06-06T08:41:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.803+0000 7faa8aa00700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7faa780a2cb0 0x7faa780a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.803+0000 7faa8aa00700 1 -- 172.21.15.28:0/2832969982 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7faa800cf310 con 0x7faa94105060 2024-06-06T08:41:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.803+0000 7faa91e00700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7faa780a2cb0 0x7faa780a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.803+0000 7faa8aa00700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372] conn(0x7faa780aca70 0x7faa780aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.803+0000 7faa8aa00700 1 -- 172.21.15.28:0/2832969982 --> [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa780af5e0 con 0x7faa780aca70 2024-06-06T08:41:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.803+0000 7faa8aa00700 1 -- 172.21.15.28:0/2832969982 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7faa800cf6c0 con 0x7faa94105060 2024-06-06T08:41:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.804+0000 7faa92800700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372] conn(0x7faa780aca70 0x7faa780aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.804+0000 7faa91e00700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7faa780a2cb0 0x7faa780a5170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faa84009680 tx=0x7faa84019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.804+0000 7faa92800700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372] conn(0x7faa780aca70 0x7faa780aef10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.805+0000 7faa8aa00700 1 -- 172.21.15.28:0/2832969982 <== osd.10 v2:172.21.15.37:6824/176857372 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa780af5e0 con 0x7faa780aca70 2024-06-06T08:41:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.824+0000 7faa98a00700 1 -- 172.21.15.28:0/2832969982 --> [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa940630a0 con 0x7faa780aca70 2024-06-06T08:41:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.825+0000 7faa8aa00700 1 -- 172.21.15.28:0/2832969982 <== osd.10 v2:172.21.15.37:6824/176857372 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faa940630a0 con 0x7faa780aca70 2024-06-06T08:41:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.825+0000 7faa98a00700 1 -- 172.21.15.28:0/2832969982 >> [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372] conn(0x7faa780aca70 msgr2=0x7faa780aef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:43.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.825+0000 7faa98a00700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372] conn(0x7faa780aca70 0x7faa780aef10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:43.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.826+0000 7faa98a00700 1 -- 172.21.15.28:0/2832969982 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7faa780a2cb0 msgr2=0x7faa780a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:43.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.826+0000 7faa98a00700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7faa780a2cb0 0x7faa780a5170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faa84009680 tx=0x7faa84019040 comp rx=0 tx=0).stop 2024-06-06T08:41:43.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.826+0000 7faa98a00700 1 -- 172.21.15.28:0/2832969982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa94105060 msgr2=0x7faa9419b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:43.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.826+0000 7faa98a00700 1 --2- 172.21.15.28:0/2832969982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa94105060 0x7faa9419b380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faa8000e9c0 tx=0x7faa8000ecd0 comp rx=0 tx=0).stop 2024-06-06T08:41:43.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.826+0000 7faa92800700 1 -- 172.21.15.28:0/2832969982 reap_dead start 2024-06-06T08:41:43.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.826+0000 7faa98a00700 1 -- 172.21.15.28:0/2832969982 shutdown_connections 2024-06-06T08:41:43.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.826+0000 7faa98a00700 1 -- 172.21.15.28:0/2832969982 >> 172.21.15.28:0/2832969982 conn(0x7faa94100190 msgr2=0x7faa941008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.826+0000 7faa98a00700 1 -- 172.21.15.28:0/2832969982 shutdown_connections 2024-06-06T08:41:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:42.826+0000 7faa98a00700 1 -- 172.21.15.28:0/2832969982 wait complete. 2024-06-06T08:41:43.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:42 smithi037 ceph-mon[36609]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-06T08:41:43.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:42 smithi037 ceph-mon[36609]: Health check failed: Degraded data redundancy: 2/306 objects degraded (0.654%), 1 pg degraded (PG_DEGRADED) 2024-06-06T08:41:43.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:42 smithi059 ceph-mon[36684]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-06T08:41:43.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:42 smithi059 ceph-mon[36684]: Health check failed: Degraded data redundancy: 2/306 objects degraded (0.654%), 1 pg degraded (PG_DEGRADED) 2024-06-06T08:41:44.194 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:43 smithi028 ceph-mon[31564]: pgmap v383: 97 pgs: 1 activating+degraded, 1 peering, 95 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 op/s; 2/306 objects degraded (0.654%); 13 B/s, 0 objects/s recovering 2024-06-06T08:41:44.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:43 smithi037 ceph-mon[36609]: pgmap v383: 97 pgs: 1 activating+degraded, 1 peering, 95 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 op/s; 2/306 objects degraded (0.654%); 13 B/s, 0 objects/s recovering 2024-06-06T08:41:44.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:43 smithi059 ceph-mon[36684]: pgmap v383: 97 pgs: 1 activating+degraded, 1 peering, 95 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 op/s; 2/306 objects degraded (0.654%); 13 B/s, 0 objects/s recovering 2024-06-06T08:41:44.739 INFO:teuthology.orchestra.run.smithi028.stdout:197568495681 2024-06-06T08:41:44.739 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-06-06T08:41:45.131 INFO:teuthology.orchestra.run.smithi028.stdout:253403070518 2024-06-06T08:41:45.131 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-06-06T08:41:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.347+0000 7f4efbc00700 1 -- 172.21.15.28:0/102768188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ef41084e0 msgr2=0x7f4ef41088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.347+0000 7f4efbc00700 1 --2- 172.21.15.28:0/102768188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ef41084e0 0x7f4ef41088c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80099c0 tx=0x7f4ee8009cd0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.347+0000 7f4efbc00700 1 -- 172.21.15.28:0/102768188 shutdown_connections 2024-06-06T08:41:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.347+0000 7f4efbc00700 1 --2- 172.21.15.28:0/102768188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef406ab10 0x7f4ef410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.347+0000 7f4efbc00700 1 --2- 172.21.15.28:0/102768188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ef41084e0 0x7f4ef41088c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.347+0000 7f4efbc00700 1 --2- 172.21.15.28:0/102768188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef406a170 0x7f4ef406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.347+0000 7f4efbc00700 1 -- 172.21.15.28:0/102768188 >> 172.21.15.28:0/102768188 conn(0x7f4ef40782c0 msgr2=0x7f4ef40786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.348+0000 7f4efbc00700 1 -- 172.21.15.28:0/102768188 shutdown_connections 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.348+0000 7f4efbc00700 1 -- 172.21.15.28:0/102768188 wait complete. 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.349+0000 7f4efbc00700 1 Processor -- start 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.349+0000 7f4efbc00700 1 -- start start 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.350+0000 7f4efbc00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef406a170 0x7f4ef419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.350+0000 7f4efbc00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef406ab10 0x7f4ef419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.350+0000 7f4efbc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ef41084e0 0x7f4ef419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.350+0000 7f4efbc00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef4112790 con 0x7f4ef41084e0 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.350+0000 7f4efbc00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef4112610 con 0x7f4ef406ab10 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.350+0000 7f4efbc00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef4112910 con 0x7f4ef406a170 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.350+0000 7f4ef9200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef406a170 0x7f4ef419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.350+0000 7f4ef3e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef406ab10 0x7f4ef419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.350+0000 7f4ef3e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef406ab10 0x7f4ef419b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:41354/0 (socket says 172.21.15.28:41354) 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.350+0000 7f4ef9200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef406a170 0x7f4ef419aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:36604/0 (socket says 172.21.15.28:36604) 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.350+0000 7f4ef3e00700 1 -- 172.21.15.28:0/631207955 learned_addr learned my addr 172.21.15.28:0/631207955 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.351+0000 7f4ef3e00700 1 -- 172.21.15.28:0/631207955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef406a170 msgr2=0x7f4ef419aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.351+0000 7f4ef3e00700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ef406a170 0x7f4ef419aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.351+0000 7f4ef9c00700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ef41084e0 0x7f4ef419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.351+0000 7f4ef3e00700 1 -- 172.21.15.28:0/631207955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ef41084e0 msgr2=0x7f4ef419f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.351+0000 7f4ef3e00700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ef41084e0 0x7f4ef419f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.351+0000 7f4ef3e00700 1 -- 172.21.15.28:0/631207955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef419feb0 con 0x7f4ef406ab10 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.351+0000 7f4ef3e00700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef406ab10 0x7f4ef419b3e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000e9c0 tx=0x7f4ee000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.351+0000 7f4ef1600700 1 -- 172.21.15.28:0/631207955 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000cbd0 con 0x7f4ef406ab10 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.351+0000 7f4ef1600700 1 -- 172.21.15.28:0/631207955 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ee000cd70 con 0x7f4ef406ab10 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.351+0000 7f4ef1600700 1 -- 172.21.15.28:0/631207955 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0010430 con 0x7f4ef406ab10 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.352+0000 7f4efbc00700 1 -- 172.21.15.28:0/631207955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef41a01a0 con 0x7f4ef406ab10 2024-06-06T08:41:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.352+0000 7f4efbc00700 1 -- 172.21.15.28:0/631207955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef4109260 con 0x7f4ef406ab10 2024-06-06T08:41:45.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.353+0000 7f4efbc00700 1 -- 172.21.15.28:0/631207955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ef4062ba0 con 0x7f4ef406ab10 2024-06-06T08:41:45.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.357+0000 7f4ef1600700 1 -- 172.21.15.28:0/631207955 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4ee0004750 con 0x7f4ef406ab10 2024-06-06T08:41:45.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.358+0000 7f4ef1600700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4edc0a2db0 0x7f4edc0a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:45.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.358+0000 7f4ef1600700 1 -- 172.21.15.28:0/631207955 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f4ee00cf4e0 con 0x7f4ef406ab10 2024-06-06T08:41:45.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.358+0000 7f4ef1600700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798] conn(0x7f4edc0acb70 0x7f4edc0af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:45.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.359+0000 7f4ef1600700 1 -- 172.21.15.28:0/631207955 --> [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4edc0af6e0 con 0x7f4edc0acb70 2024-06-06T08:41:45.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.359+0000 7f4ef1600700 1 -- 172.21.15.28:0/631207955 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f4ee00d6050 con 0x7f4ef406ab10 2024-06-06T08:41:45.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.359+0000 7f4ef9200700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4edc0a2db0 0x7f4edc0a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:45.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.359+0000 7f4ef9c00700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798] conn(0x7f4edc0acb70 0x7f4edc0af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:45.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.360+0000 7f4ef9c00700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798] conn(0x7f4edc0acb70 0x7f4edc0af010 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:45.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.360+0000 7f4ef9200700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4edc0a2db0 0x7f4edc0a5270 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8000c00 tx=0x7f4ee8024040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:45.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.361+0000 7f4ef1600700 1 -- 172.21.15.28:0/631207955 <== osd.11 v2:172.21.15.59:6824/2675673798 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4edc0af6e0 con 0x7f4edc0acb70 2024-06-06T08:41:45.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.397+0000 7f4efbc00700 1 -- 172.21.15.28:0/631207955 --> [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ef4063020 con 0x7f4edc0acb70 2024-06-06T08:41:45.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.397+0000 7f4ef1600700 1 -- 172.21.15.28:0/631207955 <== osd.11 v2:172.21.15.59:6824/2675673798 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4ef4063020 con 0x7f4edc0acb70 2024-06-06T08:41:45.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.398+0000 7f4efbc00700 1 -- 172.21.15.28:0/631207955 >> [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798] conn(0x7f4edc0acb70 msgr2=0x7f4edc0af010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.398+0000 7f4efbc00700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798] conn(0x7f4edc0acb70 0x7f4edc0af010 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.398+0000 7f4efbc00700 1 -- 172.21.15.28:0/631207955 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4edc0a2db0 msgr2=0x7f4edc0a5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.398+0000 7f4efbc00700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f4edc0a2db0 0x7f4edc0a5270 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8000c00 tx=0x7f4ee8024040 comp rx=0 tx=0).stop 2024-06-06T08:41:45.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.398+0000 7f4efbc00700 1 -- 172.21.15.28:0/631207955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef406ab10 msgr2=0x7f4ef419b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.398+0000 7f4efbc00700 1 --2- 172.21.15.28:0/631207955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef406ab10 0x7f4ef419b3e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000e9c0 tx=0x7f4ee000ecd0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.398+0000 7f4ef9c00700 1 -- 172.21.15.28:0/631207955 reap_dead start 2024-06-06T08:41:45.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.398+0000 7f4efbc00700 1 -- 172.21.15.28:0/631207955 shutdown_connections 2024-06-06T08:41:45.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.398+0000 7f4efbc00700 1 -- 172.21.15.28:0/631207955 >> 172.21.15.28:0/631207955 conn(0x7f4ef40782c0 msgr2=0x7f4ef410d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:45.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.398+0000 7f4efbc00700 1 -- 172.21.15.28:0/631207955 shutdown_connections 2024-06-06T08:41:45.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:45.399+0000 7f4efbc00700 1 -- 172.21.15.28:0/631207955 wait complete. 2024-06-06T08:41:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.545+0000 7fdaa3200700 1 -- 172.21.15.28:0/1807199938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda9c1030f0 msgr2=0x7fda9c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.545+0000 7fdaa3200700 1 --2- 172.21.15.28:0/1807199938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda9c1030f0 0x7fda9c107110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda880099c0 tx=0x7fda88009cd0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.545+0000 7fdaa3200700 1 -- 172.21.15.28:0/1807199938 shutdown_connections 2024-06-06T08:41:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.545+0000 7fdaa3200700 1 --2- 172.21.15.28:0/1807199938 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda9c107840 0x7fda9c10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.545+0000 7fdaa3200700 1 --2- 172.21.15.28:0/1807199938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda9c102740 0x7fda9c102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.545+0000 7fdaa3200700 1 --2- 172.21.15.28:0/1807199938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda9c1030f0 0x7fda9c107110 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.545+0000 7fdaa3200700 1 -- 172.21.15.28:0/1807199938 >> 172.21.15.28:0/1807199938 conn(0x7fda9c0795f0 msgr2=0x7fda9c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.545+0000 7fdaa3200700 1 -- 172.21.15.28:0/1807199938 shutdown_connections 2024-06-06T08:41:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.545+0000 7fdaa3200700 1 -- 172.21.15.28:0/1807199938 wait complete. 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.546+0000 7fdaa3200700 1 Processor -- start 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.546+0000 7fdaa3200700 1 -- start start 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.547+0000 7fdaa3200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda9c102740 0x7fda9c19ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.547+0000 7fdaa3200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda9c1030f0 0x7fda9c19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.547+0000 7fdaa3200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda9c107840 0x7fda9c19f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.547+0000 7fdaa3200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c112750 con 0x7fda9c1030f0 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.547+0000 7fdaa3200700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c1125d0 con 0x7fda9c102740 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.547+0000 7fdaa3200700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c1128d0 con 0x7fda9c107840 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.547+0000 7fda9b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda9c1030f0 0x7fda9c19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.547+0000 7fda9be00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda9c102740 0x7fda9c19ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.547+0000 7fda9be00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda9c102740 0x7fda9c19ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:41330/0 (socket says 172.21.15.28:41330) 2024-06-06T08:41:45.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.547+0000 7fda9be00700 1 -- 172.21.15.28:0/239821376 learned_addr learned my addr 172.21.15.28:0/239821376 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:45.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.547+0000 7fdaa1200700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda9c107840 0x7fda9c19f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:45.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.548+0000 7fda9be00700 1 -- 172.21.15.28:0/239821376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda9c107840 msgr2=0x7fda9c19f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.548+0000 7fda9be00700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda9c107840 0x7fda9c19f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.548+0000 7fda9be00700 1 -- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda9c1030f0 msgr2=0x7fda9c19b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.548+0000 7fda9be00700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda9c1030f0 0x7fda9c19b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.548+0000 7fda9be00700 1 -- 172.21.15.28:0/239821376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c19fdb0 con 0x7fda9c102740 2024-06-06T08:41:45.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.548+0000 7fda9be00700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda9c102740 0x7fda9c19ada0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e9a0 tx=0x7fda8c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:45.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.548+0000 7fda98c00700 1 -- 172.21.15.28:0/239821376 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c00ca10 con 0x7fda9c102740 2024-06-06T08:41:45.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.548+0000 7fda98c00700 1 -- 172.21.15.28:0/239821376 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda8c00cbb0 con 0x7fda9c102740 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.548+0000 7fdaa3200700 1 -- 172.21.15.28:0/239821376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9c1a00a0 con 0x7fda9c102740 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.548+0000 7fda98c00700 1 -- 172.21.15.28:0/239821376 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c018660 con 0x7fda9c102740 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.548+0000 7fdaa3200700 1 -- 172.21.15.28:0/239821376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9c1a7920 con 0x7fda9c102740 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.549+0000 7fdaa3200700 1 -- 172.21.15.28:0/239821376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda9c10ea70 con 0x7fda9c102740 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.552+0000 7fda98c00700 1 -- 172.21.15.28:0/239821376 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fda8c010430 con 0x7fda9c102740 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.553+0000 7fda98c00700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fda800a2d30 0x7fda800a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.553+0000 7fda98c00700 1 -- 172.21.15.28:0/239821376 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fda8c0cfbe0 con 0x7fda9c102740 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.553+0000 7fda9b400700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fda800a2d30 0x7fda800a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.553+0000 7fda98c00700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355] conn(0x7fda800acaf0 0x7fda800aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.553+0000 7fda98c00700 1 -- 172.21.15.28:0/239821376 --> [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda8c01bec0 con 0x7fda800acaf0 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.553+0000 7fda98c00700 1 -- 172.21.15.28:0/239821376 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fda8c0cff90 con 0x7fda9c102740 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.554+0000 7fdaa1200700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355] conn(0x7fda800acaf0 0x7fda800aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.554+0000 7fda9b400700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fda800a2d30 0x7fda800a51f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fda9c076720 tx=0x7fda88005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:45.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.554+0000 7fdaa1200700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355] conn(0x7fda800acaf0 0x7fda800aef90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.555+0000 7fda98c00700 1 -- 172.21.15.28:0/239821376 <== osd.9 v2:172.21.15.28:6826/2555848355 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda8c01bec0 con 0x7fda800acaf0 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.574+0000 7fdaa3200700 1 -- 172.21.15.28:0/239821376 --> [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fda9c103bd0 con 0x7fda800acaf0 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.575+0000 7fda98c00700 1 -- 172.21.15.28:0/239821376 <== osd.9 v2:172.21.15.28:6826/2555848355 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fda9c103bd0 con 0x7fda800acaf0 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.576+0000 7fdaa3200700 1 -- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355] conn(0x7fda800acaf0 msgr2=0x7fda800aef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.576+0000 7fdaa3200700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355] conn(0x7fda800acaf0 0x7fda800aef90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.576+0000 7fdaa3200700 1 -- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fda800a2d30 msgr2=0x7fda800a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.576+0000 7fdaa3200700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fda800a2d30 0x7fda800a51f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fda9c076720 tx=0x7fda88005fb0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.576+0000 7fdaa3200700 1 -- 172.21.15.28:0/239821376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda9c102740 msgr2=0x7fda9c19ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.576+0000 7fdaa3200700 1 --2- 172.21.15.28:0/239821376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda9c102740 0x7fda9c19ada0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e9a0 tx=0x7fda8c00ecb0 comp rx=0 tx=0).stop 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.576+0000 7fdaa1200700 1 -- 172.21.15.28:0/239821376 reap_dead start 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.576+0000 7fdaa3200700 1 -- 172.21.15.28:0/239821376 shutdown_connections 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.576+0000 7fdaa3200700 1 -- 172.21.15.28:0/239821376 >> 172.21.15.28:0/239821376 conn(0x7fda9c0795f0 msgr2=0x7fda9c1007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:45.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.577+0000 7fdaa3200700 1 -- 172.21.15.28:0/239821376 shutdown_connections 2024-06-06T08:41:45.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:44.577+0000 7fdaa3200700 1 -- 172.21.15.28:0/239821376 wait complete. 2024-06-06T08:41:46.189 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:45 smithi028 ceph-mon[31564]: pgmap v384: 97 pgs: 1 activating+degraded, 1 peering, 95 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2/306 objects degraded (0.654%); 97 B/s, 1 objects/s recovering 2024-06-06T08:41:46.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:45 smithi037 ceph-mon[36609]: pgmap v384: 97 pgs: 1 activating+degraded, 1 peering, 95 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2/306 objects degraded (0.654%); 97 B/s, 1 objects/s recovering 2024-06-06T08:41:46.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:45 smithi059 ceph-mon[36684]: pgmap v384: 97 pgs: 1 activating+degraded, 1 peering, 95 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2/306 objects degraded (0.654%); 97 B/s, 1 objects/s recovering 2024-06-06T08:41:46.404 INFO:teuthology.orchestra.run.smithi028.stdout:219043332155 2024-06-06T08:41:46.404 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-06-06T08:41:46.971 INFO:teuthology.orchestra.run.smithi028.stdout:309237645354 2024-06-06T08:41:46.972 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-06-06T08:41:47.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.189+0000 7fa719c00700 1 -- 172.21.15.28:0/1348916322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa71406abd0 msgr2=0x7fa71406b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:47.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.189+0000 7fa719c00700 1 --2- 172.21.15.28:0/1348916322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa71406abd0 0x7fa71406b050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa700009920 tx=0x7fa700009c30 comp rx=0 tx=0).stop 2024-06-06T08:41:47.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.189+0000 7fa719c00700 1 -- 172.21.15.28:0/1348916322 shutdown_connections 2024-06-06T08:41:47.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.189+0000 7fa719c00700 1 --2- 172.21.15.28:0/1348916322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406b590 0x7fa71410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:47.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.189+0000 7fa719c00700 1 --2- 172.21.15.28:0/1348916322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa714108520 0x7fa714108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:47.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.189+0000 7fa719c00700 1 --2- 172.21.15.28:0/1348916322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa71406abd0 0x7fa71406b050 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:47.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.189+0000 7fa719c00700 1 -- 172.21.15.28:0/1348916322 >> 172.21.15.28:0/1348916322 conn(0x7fa714077430 msgr2=0x7fa714077840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:47.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.189+0000 7fa719c00700 1 -- 172.21.15.28:0/1348916322 shutdown_connections 2024-06-06T08:41:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.189+0000 7fa719c00700 1 -- 172.21.15.28:0/1348916322 wait complete. 2024-06-06T08:41:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.191+0000 7fa719c00700 1 Processor -- start 2024-06-06T08:41:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.192+0000 7fa719c00700 1 -- start start 2024-06-06T08:41:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.192+0000 7fa719c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406abd0 0x7fa71419ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.192+0000 7fa719c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa71406b590 0x7fa71419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.192+0000 7fa719c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa714108520 0x7fa714198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.192+0000 7fa719c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa714112770 con 0x7fa71406b590 2024-06-06T08:41:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.192+0000 7fa719c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7141125f0 con 0x7fa71406abd0 2024-06-06T08:41:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.192+0000 7fa719c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa7141128f0 con 0x7fa714108520 2024-06-06T08:41:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.193+0000 7fa712a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406abd0 0x7fa71419ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.193+0000 7fa712000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa71406b590 0x7fa71419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.193+0000 7fa712a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406abd0 0x7fa71419ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:50956/0 (socket says 172.21.15.28:50956) 2024-06-06T08:41:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.193+0000 7fa712a00700 1 -- 172.21.15.28:0/3361493210 learned_addr learned my addr 172.21.15.28:0/3361493210 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.193+0000 7fa713400700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa714108520 0x7fa714198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.193+0000 7fa712a00700 1 -- 172.21.15.28:0/3361493210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa714108520 msgr2=0x7fa714198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.193+0000 7fa712a00700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa714108520 0x7fa714198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.193+0000 7fa712a00700 1 -- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa71406b590 msgr2=0x7fa71419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.193+0000 7fa712a00700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa71406b590 0x7fa71419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.193+0000 7fa712a00700 1 -- 172.21.15.28:0/3361493210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa714199410 con 0x7fa71406abd0 2024-06-06T08:41:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.193+0000 7fa712a00700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406abd0 0x7fa71419ea60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa70400e9c0 tx=0x7fa70400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.194+0000 7fa70b400700 1 -- 172.21.15.28:0/3361493210 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa704004a30 con 0x7fa71406abd0 2024-06-06T08:41:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.194+0000 7fa70b400700 1 -- 172.21.15.28:0/3361493210 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa70400cca0 con 0x7fa71406abd0 2024-06-06T08:41:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.194+0000 7fa70b400700 1 -- 172.21.15.28:0/3361493210 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa704005610 con 0x7fa71406abd0 2024-06-06T08:41:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.194+0000 7fa719c00700 1 -- 172.21.15.28:0/3361493210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa714199700 con 0x7fa71406abd0 2024-06-06T08:41:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.194+0000 7fa719c00700 1 -- 172.21.15.28:0/3361493210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7141a59e0 con 0x7fa71406abd0 2024-06-06T08:41:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.195+0000 7fa719c00700 1 -- 172.21.15.28:0/3361493210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa714062ba0 con 0x7fa71406abd0 2024-06-06T08:41:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.197+0000 7fa70b400700 1 -- 172.21.15.28:0/3361493210 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa704004cf0 con 0x7fa71406abd0 2024-06-06T08:41:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.198+0000 7fa70b400700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa6f80a2cb0 0x7fa6f80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.198+0000 7fa70b400700 1 -- 172.21.15.28:0/3361493210 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fa7040cf780 con 0x7fa71406abd0 2024-06-06T08:41:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.198+0000 7fa712000700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa6f80a2cb0 0x7fa6f80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.199+0000 7fa70b400700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636] conn(0x7fa6f80aca70 0x7fa6f80aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.199+0000 7fa70b400700 1 -- 172.21.15.28:0/3361493210 --> [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa70400ce50 con 0x7fa6f80aca70 2024-06-06T08:41:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.199+0000 7fa70b400700 1 -- 172.21.15.28:0/3361493210 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fa7040cfb30 con 0x7fa71406abd0 2024-06-06T08:41:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.199+0000 7fa713400700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636] conn(0x7fa6f80aca70 0x7fa6f80aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.199+0000 7fa712000700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa6f80a2cb0 0x7fa6f80a5170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa70000c010 tx=0x7fa700019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.200+0000 7fa713400700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636] conn(0x7fa6f80aca70 0x7fa6f80aef10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.200+0000 7fa70b400700 1 -- 172.21.15.28:0/3361493210 <== osd.0 v2:172.21.15.28:6802/2001709636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa70400ce50 con 0x7fa6f80aca70 2024-06-06T08:41:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.218+0000 7fa719c00700 1 -- 172.21.15.28:0/3361493210 --> [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa714062fa0 con 0x7fa6f80aca70 2024-06-06T08:41:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.219+0000 7fa70b400700 1 -- 172.21.15.28:0/3361493210 <== osd.0 v2:172.21.15.28:6802/2001709636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa714062fa0 con 0x7fa6f80aca70 2024-06-06T08:41:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.219+0000 7fa719c00700 1 -- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636] conn(0x7fa6f80aca70 msgr2=0x7fa6f80aef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.220+0000 7fa719c00700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636] conn(0x7fa6f80aca70 0x7fa6f80aef10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.220+0000 7fa719c00700 1 -- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa6f80a2cb0 msgr2=0x7fa6f80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.220+0000 7fa719c00700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa6f80a2cb0 0x7fa6f80a5170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa70000c010 tx=0x7fa700019040 comp rx=0 tx=0).stop 2024-06-06T08:41:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.220+0000 7fa719c00700 1 -- 172.21.15.28:0/3361493210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406abd0 msgr2=0x7fa71419ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:47.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.220+0000 7fa719c00700 1 --2- 172.21.15.28:0/3361493210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa71406abd0 0x7fa71419ea60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa70400e9c0 tx=0x7fa70400ecd0 comp rx=0 tx=0).stop 2024-06-06T08:41:47.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.220+0000 7fa713400700 1 -- 172.21.15.28:0/3361493210 reap_dead start 2024-06-06T08:41:47.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.220+0000 7fa719c00700 1 -- 172.21.15.28:0/3361493210 shutdown_connections 2024-06-06T08:41:47.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.220+0000 7fa719c00700 1 -- 172.21.15.28:0/3361493210 >> 172.21.15.28:0/3361493210 conn(0x7fa714077430 msgr2=0x7fa714100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:47.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.220+0000 7fa719c00700 1 -- 172.21.15.28:0/3361493210 shutdown_connections 2024-06-06T08:41:47.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:46.220+0000 7fa719c00700 1 -- 172.21.15.28:0/3361493210 wait complete. 2024-06-06T08:41:48.165 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:47 smithi028 ceph-mon[31564]: pgmap v385: 97 pgs: 1 activating+degraded, 1 peering, 95 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2/306 objects degraded (0.654%); 97 B/s, 1 objects/s recovering 2024-06-06T08:41:48.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:47 smithi037 ceph-mon[36609]: pgmap v385: 97 pgs: 1 activating+degraded, 1 peering, 95 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2/306 objects degraded (0.654%); 97 B/s, 1 objects/s recovering 2024-06-06T08:41:48.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:47 smithi059 ceph-mon[36684]: pgmap v385: 97 pgs: 1 activating+degraded, 1 peering, 95 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2/306 objects degraded (0.654%); 97 B/s, 1 objects/s recovering 2024-06-06T08:41:48.387 INFO:teuthology.orchestra.run.smithi028.stdout:287762808881 2024-06-06T08:41:48.387 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-06-06T08:41:48.709 INFO:teuthology.orchestra.run.smithi028.stdout:34359738468 2024-06-06T08:41:48.710 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-06-06T08:41:49.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:48 smithi028 ceph-mon[31564]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-06T08:41:49.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:48 smithi028 ceph-mon[31564]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/306 objects degraded (0.654%), 1 pg degraded) 2024-06-06T08:41:49.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:48 smithi028 ceph-mon[31564]: Cluster is now healthy 2024-06-06T08:41:49.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:48 smithi037 ceph-mon[36609]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-06T08:41:49.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:48 smithi037 ceph-mon[36609]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/306 objects degraded (0.654%), 1 pg degraded) 2024-06-06T08:41:49.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:48 smithi037 ceph-mon[36609]: Cluster is now healthy 2024-06-06T08:41:49.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:48 smithi059 ceph-mon[36684]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-06T08:41:49.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:48 smithi059 ceph-mon[36684]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/306 objects degraded (0.654%), 1 pg degraded) 2024-06-06T08:41:49.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:48 smithi059 ceph-mon[36684]: Cluster is now healthy 2024-06-06T08:41:49.464 INFO:teuthology.orchestra.run.smithi028.stdout:141733920846 2024-06-06T08:41:49.464 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-06-06T08:41:49.756 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:49.765 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:49.803 INFO:teuthology.orchestra.run.smithi028.stdout:343597383717 2024-06-06T08:41:49.803 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-06-06T08:41:50.233 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:49 smithi028 ceph-mon[31564]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 370 B/s, 1 objects/s recovering 2024-06-06T08:41:50.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:49 smithi037 ceph-mon[36609]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 370 B/s, 1 objects/s recovering 2024-06-06T08:41:50.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:49 smithi059 ceph-mon[36684]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 370 B/s, 1 objects/s recovering 2024-06-06T08:41:51.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:51 smithi028 ceph-mon[31564]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 314 B/s, 1 objects/s recovering 2024-06-06T08:41:51.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:51 smithi037 ceph-mon[36609]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 314 B/s, 1 objects/s recovering 2024-06-06T08:41:51.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:51 smithi059 ceph-mon[36684]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 314 B/s, 1 objects/s recovering 2024-06-06T08:41:52.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.648+0000 7fa561c00700 1 -- 172.21.15.28:0/1436744767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa55c108ac0 msgr2=0x7fa55c108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:52.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.648+0000 7fa561c00700 1 --2- 172.21.15.28:0/1436744767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa55c108ac0 0x7fa55c108f40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa548009990 tx=0x7fa548009ca0 comp rx=0 tx=0).stop 2024-06-06T08:41:52.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.648+0000 7fa561c00700 1 -- 172.21.15.28:0/1436744767 shutdown_connections 2024-06-06T08:41:52.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.648+0000 7fa561c00700 1 --2- 172.21.15.28:0/1436744767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c109480 0x7fa55c115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:52.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.648+0000 7fa561c00700 1 --2- 172.21.15.28:0/1436744767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa55c10eac0 0x7fa55c10eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:52.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.648+0000 7fa561c00700 1 --2- 172.21.15.28:0/1436744767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa55c108ac0 0x7fa55c108f40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:52.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.648+0000 7fa561c00700 1 -- 172.21.15.28:0/1436744767 >> 172.21.15.28:0/1436744767 conn(0x7fa55c075c60 msgr2=0x7fa55c078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:52.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.648+0000 7fa561c00700 1 -- 172.21.15.28:0/1436744767 shutdown_connections 2024-06-06T08:41:52.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.648+0000 7fa561c00700 1 -- 172.21.15.28:0/1436744767 wait complete. 2024-06-06T08:41:52.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.651+0000 7fa561c00700 1 Processor -- start 2024-06-06T08:41:52.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.651+0000 7fa561c00700 1 -- start start 2024-06-06T08:41:52.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.651+0000 7fa561c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c108ac0 0x7fa55c19f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa561c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa55c109480 0x7fa55c19f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa561c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa55c10eac0 0x7fa55c1a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa561c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c118e50 con 0x7fa55c10eac0 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa561c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c118cd0 con 0x7fa55c108ac0 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa561c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c118fd0 con 0x7fa55c109480 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa55aa00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c108ac0 0x7fa55c19f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa55aa00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c108ac0 0x7fa55c19f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:50966/0 (socket says 172.21.15.28:50966) 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa55aa00700 1 -- 172.21.15.28:0/2774174540 learned_addr learned my addr 172.21.15.28:0/2774174540 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa55b400700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa55c10eac0 0x7fa55c1a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa55a000700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa55c109480 0x7fa55c19f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa55aa00700 1 -- 172.21.15.28:0/2774174540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa55c109480 msgr2=0x7fa55c19f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa55aa00700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa55c109480 0x7fa55c19f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa55aa00700 1 -- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa55c10eac0 msgr2=0x7fa55c1a3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:52.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa55aa00700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa55c10eac0 0x7fa55c1a3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:52.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa55aa00700 1 -- 172.21.15.28:0/2774174540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c1a4230 con 0x7fa55c108ac0 2024-06-06T08:41:52.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.652+0000 7fa55a000700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa55c109480 0x7fa55c19f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:52.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.653+0000 7fa55aa00700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c108ac0 0x7fa55c19f220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00e9c0 tx=0x7fa54c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:52.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.653+0000 7fa553400700 1 -- 172.21.15.28:0/2774174540 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00cbd0 con 0x7fa55c108ac0 2024-06-06T08:41:52.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.653+0000 7fa561c00700 1 -- 172.21.15.28:0/2774174540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55c1a4520 con 0x7fa55c108ac0 2024-06-06T08:41:52.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.653+0000 7fa561c00700 1 -- 172.21.15.28:0/2774174540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55c1abda0 con 0x7fa55c108ac0 2024-06-06T08:41:52.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.654+0000 7fa553400700 1 -- 172.21.15.28:0/2774174540 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa54c00ee60 con 0x7fa55c108ac0 2024-06-06T08:41:52.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.654+0000 7fa553400700 1 -- 172.21.15.28:0/2774174540 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c005630 con 0x7fa55c108ac0 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.654+0000 7fa561c00700 1 -- 172.21.15.28:0/2774174540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa53c001030 con 0x7fa55c108ac0 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.656+0000 7fa553400700 1 -- 172.21.15.28:0/2774174540 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa54c004830 con 0x7fa55c108ac0 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.658+0000 7fa553400700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa5400a2d30 0x7fa5400a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.658+0000 7fa553400700 1 -- 172.21.15.28:0/2774174540 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fa54c0cf9e0 con 0x7fa55c108ac0 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.658+0000 7fa55a000700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa5400a2d30 0x7fa5400a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.658+0000 7fa553400700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430] conn(0x7fa5400acaf0 0x7fa5400aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.658+0000 7fa553400700 1 -- 172.21.15.28:0/2774174540 --> [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa54c0090b0 con 0x7fa5400acaf0 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.658+0000 7fa553400700 1 -- 172.21.15.28:0/2774174540 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fa54c0cfd90 con 0x7fa55c108ac0 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.659+0000 7fa55b400700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430] conn(0x7fa5400acaf0 0x7fa5400aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.659+0000 7fa55a000700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa5400a2d30 0x7fa5400a51f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa5480098e0 tx=0x7fa548005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.659+0000 7fa55b400700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430] conn(0x7fa5400acaf0 0x7fa5400aef90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.660+0000 7fa553400700 1 -- 172.21.15.28:0/2774174540 <== osd.3 v2:172.21.15.28:6810/484290430 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa54c0090b0 con 0x7fa5400acaf0 2024-06-06T08:41:52.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.679+0000 7fa561c00700 1 -- 172.21.15.28:0/2774174540 --> [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa53c002e60 con 0x7fa5400acaf0 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.679+0000 7fa553400700 1 -- 172.21.15.28:0/2774174540 <== osd.3 v2:172.21.15.28:6810/484290430 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa53c002e60 con 0x7fa5400acaf0 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.680+0000 7fa561c00700 1 -- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430] conn(0x7fa5400acaf0 msgr2=0x7fa5400aef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.680+0000 7fa561c00700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430] conn(0x7fa5400acaf0 0x7fa5400aef90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.680+0000 7fa561c00700 1 -- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa5400a2d30 msgr2=0x7fa5400a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.680+0000 7fa561c00700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa5400a2d30 0x7fa5400a51f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa5480098e0 tx=0x7fa548005960 comp rx=0 tx=0).stop 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.680+0000 7fa561c00700 1 -- 172.21.15.28:0/2774174540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c108ac0 msgr2=0x7fa55c19f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.680+0000 7fa561c00700 1 --2- 172.21.15.28:0/2774174540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c108ac0 0x7fa55c19f220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00e9c0 tx=0x7fa54c00ecd0 comp rx=0 tx=0).stop 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.680+0000 7fa55b400700 1 -- 172.21.15.28:0/2774174540 reap_dead start 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.680+0000 7fa561c00700 1 -- 172.21.15.28:0/2774174540 shutdown_connections 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.680+0000 7fa561c00700 1 -- 172.21.15.28:0/2774174540 >> 172.21.15.28:0/2774174540 conn(0x7fa55c075c60 msgr2=0x7fa55c076220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.680+0000 7fa561c00700 1 -- 172.21.15.28:0/2774174540 shutdown_connections 2024-06-06T08:41:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:50.680+0000 7fa561c00700 1 -- 172.21.15.28:0/2774174540 wait complete. 2024-06-06T08:41:52.612 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:52.616 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:52.618 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:52.632 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:52.633 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:52.776 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:52.776 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:53.327 INFO:teuthology.orchestra.run.smithi028.stdout:107374182485 2024-06-06T08:41:53.328 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-06-06T08:41:53.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:53 smithi059 ceph-mon[36684]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 284 B/s, 1 objects/s recovering 2024-06-06T08:41:53.643 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:53 smithi028 ceph-mon[31564]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 284 B/s, 1 objects/s recovering 2024-06-06T08:41:53.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:53 smithi037 ceph-mon[36609]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 284 B/s, 1 objects/s recovering 2024-06-06T08:41:55.347 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:55 smithi028 ceph-mon[31564]: pgmap v389: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 237 B/s, 0 objects/s recovering 2024-06-06T08:41:55.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:55 smithi059 ceph-mon[36684]: pgmap v389: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 237 B/s, 0 objects/s recovering 2024-06-06T08:41:55.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.096+0000 7fa6f3200700 1 -- 172.21.15.28:0/2556068969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f4104980 msgr2=0x7fa6f410f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:55.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.096+0000 7fa6f3200700 1 --2- 172.21.15.28:0/2556068969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f4104980 0x7fa6f410f360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0099c0 tx=0x7fa6ec009cd0 comp rx=0 tx=0).stop 2024-06-06T08:41:55.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.096+0000 7fa6f3200700 1 -- 172.21.15.28:0/2556068969 shutdown_connections 2024-06-06T08:41:55.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.096+0000 7fa6f3200700 1 --2- 172.21.15.28:0/2556068969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f4104980 0x7fa6f410f360 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.096+0000 7fa6f3200700 1 --2- 172.21.15.28:0/2556068969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6f41026d0 0x7fa6f4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.096+0000 7fa6f3200700 1 --2- 172.21.15.28:0/2556068969 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f4103fc0 0x7fa6f4104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.096+0000 7fa6f3200700 1 -- 172.21.15.28:0/2556068969 >> 172.21.15.28:0/2556068969 conn(0x7fa6f40fde80 msgr2=0x7fa6f41002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.096+0000 7fa6f3200700 1 -- 172.21.15.28:0/2556068969 shutdown_connections 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.096+0000 7fa6f3200700 1 -- 172.21.15.28:0/2556068969 wait complete. 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.097+0000 7fa6f3200700 1 Processor -- start 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.097+0000 7fa6f3200700 1 -- start start 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.097+0000 7fa6f3200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f41026d0 0x7fa6f41a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f3200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f4103fc0 0x7fa6f41a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f3200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6f4104980 0x7fa6f419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f3200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4112780 con 0x7fa6f4103fc0 2024-06-06T08:41:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f3200700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4112600 con 0x7fa6f4104980 2024-06-06T08:41:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f3200700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4112900 con 0x7fa6f41026d0 2024-06-06T08:41:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f1400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f4103fc0 0x7fa6f41a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f1e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f41026d0 0x7fa6f41a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f1400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f4103fc0 0x7fa6f41a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55702/0 (socket says 172.21.15.28:55702) 2024-06-06T08:41:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f1400700 1 -- 172.21.15.28:0/2782058383 learned_addr learned my addr 172.21.15.28:0/2782058383 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:41:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f2800700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6f4104980 0x7fa6f419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f1e00700 1 -- 172.21.15.28:0/2782058383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6f4104980 msgr2=0x7fa6f419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f1e00700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6f4104980 0x7fa6f419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f1e00700 1 -- 172.21.15.28:0/2782058383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f4103fc0 msgr2=0x7fa6f41a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f1e00700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f4103fc0 0x7fa6f41a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f1e00700 1 -- 172.21.15.28:0/2782058383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f419b240 con 0x7fa6f41026d0 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.098+0000 7fa6f1400700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f4103fc0 0x7fa6f41a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.099+0000 7fa6f1e00700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f41026d0 0x7fa6f41a0920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400ef10 tx=0x7fa6e400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.099+0000 7fa6eaa00700 1 -- 172.21.15.28:0/2782058383 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e400c9c0 con 0x7fa6f41026d0 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.099+0000 7fa6eaa00700 1 -- 172.21.15.28:0/2782058383 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6e4019070 con 0x7fa6f41026d0 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.099+0000 7fa6eaa00700 1 -- 172.21.15.28:0/2782058383 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40146e0 con 0x7fa6f41026d0 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.099+0000 7fa6f3200700 1 -- 172.21.15.28:0/2782058383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f419b4d0 con 0x7fa6f41026d0 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.099+0000 7fa6f3200700 1 -- 172.21.15.28:0/2782058383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f41a77f0 con 0x7fa6f41026d0 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.101+0000 7fa6f3200700 1 -- 172.21.15.28:0/2782058383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f4069180 con 0x7fa6f41026d0 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.103+0000 7fa6eaa00700 1 -- 172.21.15.28:0/2782058383 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa6e4012050 con 0x7fa6f41026d0 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.104+0000 7fa6eaa00700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa6d80a2d30 0x7fa6d80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:41:55.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.104+0000 7fa6eaa00700 1 -- 172.21.15.28:0/2782058383 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fa6e40cf1e0 con 0x7fa6f41026d0 2024-06-06T08:41:55.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.105+0000 7fa6f1400700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa6d80a2d30 0x7fa6d80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:41:55.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.105+0000 7fa6f1400700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa6d80a2d30 0x7fa6d80a51f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa6f410f7a0 tx=0x7fa6e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:41:55.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.109+0000 7fa6eaa00700 1 -- 172.21.15.28:0/2782058383 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa6e4010040 con 0x7fa6f41026d0 2024-06-06T08:41:55.800 INFO:teuthology.orchestra.run.smithi028.stdout:163208757324 2024-06-06T08:41:55.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.344+0000 7fa6f3200700 1 -- 172.21.15.28:0/2782058383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa6f41a79c0 con 0x7fa6f41026d0 2024-06-06T08:41:55.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.345+0000 7fa6eaa00700 1 -- 172.21.15.28:0/2782058383 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa6e409bf00 con 0x7fa6f41026d0 2024-06-06T08:41:55.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.348+0000 7fa6f3200700 1 -- 172.21.15.28:0/2782058383 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa6d80a2d30 msgr2=0x7fa6d80a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.348+0000 7fa6f3200700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa6d80a2d30 0x7fa6d80a51f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa6f410f7a0 tx=0x7fa6e0009260 comp rx=0 tx=0).stop 2024-06-06T08:41:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.348+0000 7fa6f3200700 1 -- 172.21.15.28:0/2782058383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f41026d0 msgr2=0x7fa6f41a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:41:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.348+0000 7fa6f3200700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f41026d0 0x7fa6f41a0920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400ef10 tx=0x7fa6e400c3a0 comp rx=0 tx=0).stop 2024-06-06T08:41:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.348+0000 7fa6f3200700 1 -- 172.21.15.28:0/2782058383 shutdown_connections 2024-06-06T08:41:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.348+0000 7fa6f3200700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa6d80a2d30 0x7fa6d80a51f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.348+0000 7fa6f3200700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6f4104980 0x7fa6f419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.348+0000 7fa6f3200700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6f41026d0 0x7fa6f41a0920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.348+0000 7fa6f3200700 1 --2- 172.21.15.28:0/2782058383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f4103fc0 0x7fa6f41a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:41:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.348+0000 7fa6f3200700 1 -- 172.21.15.28:0/2782058383 >> 172.21.15.28:0/2782058383 conn(0x7fa6f40fde80 msgr2=0x7fa6f40fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:41:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.349+0000 7fa6f3200700 1 -- 172.21.15.28:0/2782058383 shutdown_connections 2024-06-06T08:41:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:41:55.349+0000 7fa6f3200700 1 -- 172.21.15.28:0/2782058383 wait complete. 2024-06-06T08:41:55.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:55 smithi037 ceph-mon[36609]: pgmap v389: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 237 B/s, 0 objects/s recovering 2024-06-06T08:41:56.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:56 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2782058383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-06T08:41:56.694 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:56 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2782058383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-06T08:41:56.716 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:56.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:56 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2782058383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-06T08:41:57.576 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:41:57.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:57 smithi059 ceph-mon[36684]: pgmap v390: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 181 B/s, 0 objects/s recovering 2024-06-06T08:41:57.668 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:57 smithi028 ceph-mon[31564]: pgmap v390: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 181 B/s, 0 objects/s recovering 2024-06-06T08:41:57.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:57 smithi037 ceph-mon[36609]: pgmap v390: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 181 B/s, 0 objects/s recovering 2024-06-06T08:41:59.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:59 smithi037 ceph-mon[36609]: pgmap v391: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s; 181 B/s, 0 objects/s recovering 2024-06-06T08:41:59.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:41:59 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:41:59.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:59 smithi059 ceph-mon[36684]: pgmap v391: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s; 181 B/s, 0 objects/s recovering 2024-06-06T08:41:59.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:41:59 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:41:59.628 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:59 smithi028 ceph-mon[31564]: pgmap v391: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s; 181 B/s, 0 objects/s recovering 2024-06-06T08:41:59.628 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:41:59 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:42:00.420 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757319 got 163208757324 for osd.5 2024-06-06T08:42:00.420 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:01.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:01.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:01.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:01 smithi028 ceph-mon[31564]: pgmap v392: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:42:01.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:01.549 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:01 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:01.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:01.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:01.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:01 smithi037 ceph-mon[36609]: pgmap v392: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:42:01.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:01.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:01 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:01.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:01.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:01.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:01 smithi059 ceph-mon[36684]: pgmap v392: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:42:01.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:01.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:01 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:03.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.155+0000 7fc9cbe00700 1 -- 172.21.15.28:0/4230162568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9c4074fe0 msgr2=0x7fc9c410e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:03.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.155+0000 7fc9cbe00700 1 --2- 172.21.15.28:0/4230162568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9c4074fe0 0x7fc9c410e9b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009990 tx=0x7fc9b0009ca0 comp rx=0 tx=0).stop 2024-06-06T08:42:03.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.155+0000 7fc9cbe00700 1 -- 172.21.15.28:0/4230162568 shutdown_connections 2024-06-06T08:42:03.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.155+0000 7fc9cbe00700 1 --2- 172.21.15.28:0/4230162568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c410eef0 0x7fc9c41112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:03.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.155+0000 7fc9cbe00700 1 --2- 172.21.15.28:0/4230162568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c40746c0 0x7fc9c4074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:03.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.155+0000 7fc9cbe00700 1 --2- 172.21.15.28:0/4230162568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9c4074fe0 0x7fc9c410e9b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:03.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.155+0000 7fc9cbe00700 1 -- 172.21.15.28:0/4230162568 >> 172.21.15.28:0/4230162568 conn(0x7fc9c40795f0 msgr2=0x7fc9c4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:03.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.155+0000 7fc9cbe00700 1 -- 172.21.15.28:0/4230162568 shutdown_connections 2024-06-06T08:42:03.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.155+0000 7fc9cbe00700 1 -- 172.21.15.28:0/4230162568 wait complete. 2024-06-06T08:42:03.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.157+0000 7fc9cbe00700 1 Processor -- start 2024-06-06T08:42:03.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.157+0000 7fc9cbe00700 1 -- start start 2024-06-06T08:42:03.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.158+0000 7fc9cbe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c40746c0 0x7fc9c419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:03.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.158+0000 7fc9cbe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9c4074fe0 0x7fc9c419b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:03.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.158+0000 7fc9cbe00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c410eef0 0x7fc9c419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:03.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.158+0000 7fc9cbe00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4114a40 con 0x7fc9c4074fe0 2024-06-06T08:42:03.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.158+0000 7fc9cbe00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c41148c0 con 0x7fc9c410eef0 2024-06-06T08:42:03.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.158+0000 7fc9cbe00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4114bc0 con 0x7fc9c40746c0 2024-06-06T08:42:03.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.158+0000 7fc9c8a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9c4074fe0 0x7fc9c419b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:03.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.158+0000 7fc9c8a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9c4074fe0 0x7fc9c419b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46692/0 (socket says 172.21.15.28:46692) 2024-06-06T08:42:03.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.158+0000 7fc9c8a00700 1 -- 172.21.15.28:0/3507810669 learned_addr learned my addr 172.21.15.28:0/3507810669 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:03.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.158+0000 7fc9c9400700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c40746c0 0x7fc9c419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:03.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.158+0000 7fc9c9e00700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c410eef0 0x7fc9c419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:03.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.159+0000 7fc9c8a00700 1 -- 172.21.15.28:0/3507810669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c40746c0 msgr2=0x7fc9c419ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:03.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.159+0000 7fc9c8a00700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c40746c0 0x7fc9c419ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:03.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.159+0000 7fc9c8a00700 1 -- 172.21.15.28:0/3507810669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c410eef0 msgr2=0x7fc9c419f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:03.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.159+0000 7fc9c8a00700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c410eef0 0x7fc9c419f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:03.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.159+0000 7fc9c8a00700 1 -- 172.21.15.28:0/3507810669 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c419fe30 con 0x7fc9c4074fe0 2024-06-06T08:42:03.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.159+0000 7fc9c9e00700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c410eef0 0x7fc9c419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:03.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.159+0000 7fc9c8a00700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9c4074fe0 0x7fc9c419b3b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000c00 tx=0x7fc9b000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:03.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.159+0000 7fc9c2000700 1 -- 172.21.15.28:0/3507810669 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0027070 con 0x7fc9c4074fe0 2024-06-06T08:42:03.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.159+0000 7fc9c2000700 1 -- 172.21.15.28:0/3507810669 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b00056d0 con 0x7fc9c4074fe0 2024-06-06T08:42:03.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.159+0000 7fc9cbe00700 1 -- 172.21.15.28:0/3507810669 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c41a00c0 con 0x7fc9c4074fe0 2024-06-06T08:42:03.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.159+0000 7fc9c2000700 1 -- 172.21.15.28:0/3507810669 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0022e10 con 0x7fc9c4074fe0 2024-06-06T08:42:03.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.160+0000 7fc9cbe00700 1 -- 172.21.15.28:0/3507810669 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c41a79a0 con 0x7fc9c4074fe0 2024-06-06T08:42:03.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.161+0000 7fc9cbe00700 1 -- 172.21.15.28:0/3507810669 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c4069180 con 0x7fc9c4074fe0 2024-06-06T08:42:03.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.163+0000 7fc9c2000700 1 -- 172.21.15.28:0/3507810669 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc9b002a070 con 0x7fc9c4074fe0 2024-06-06T08:42:03.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.165+0000 7fc9c2000700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc9ac0a2d30 0x7fc9ac0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:03.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.165+0000 7fc9c2000700 1 -- 172.21.15.28:0/3507810669 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fc9b00d04d0 con 0x7fc9c4074fe0 2024-06-06T08:42:03.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.166+0000 7fc9c9400700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc9ac0a2d30 0x7fc9ac0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:03.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.166+0000 7fc9c9400700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc9ac0a2d30 0x7fc9ac0a51f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800f540 tx=0x7fc9b800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:03.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.167+0000 7fc9c2000700 1 -- 172.21.15.28:0/3507810669 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc9b0013070 con 0x7fc9c4074fe0 2024-06-06T08:42:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.423+0000 7fc9cbe00700 1 -- 172.21.15.28:0/3507810669 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc9c41a7b70 con 0x7fc9c4074fe0 2024-06-06T08:42:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.423+0000 7fc9c2000700 1 -- 172.21.15.28:0/3507810669 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc9b009d280 con 0x7fc9c4074fe0 2024-06-06T08:42:03.422 INFO:teuthology.orchestra.run.smithi028.stdout:34359738472 2024-06-06T08:42:03.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.427+0000 7fc9cbe00700 1 -- 172.21.15.28:0/3507810669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc9ac0a2d30 msgr2=0x7fc9ac0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:03.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.427+0000 7fc9cbe00700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc9ac0a2d30 0x7fc9ac0a51f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800f540 tx=0x7fc9b800b040 comp rx=0 tx=0).stop 2024-06-06T08:42:03.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.427+0000 7fc9cbe00700 1 -- 172.21.15.28:0/3507810669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9c4074fe0 msgr2=0x7fc9c419b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:03.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.427+0000 7fc9cbe00700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9c4074fe0 0x7fc9c419b3b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000c00 tx=0x7fc9b000bab0 comp rx=0 tx=0).stop 2024-06-06T08:42:03.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.427+0000 7fc9cbe00700 1 -- 172.21.15.28:0/3507810669 shutdown_connections 2024-06-06T08:42:03.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.427+0000 7fc9cbe00700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc9ac0a2d30 0x7fc9ac0a51f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:03.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.427+0000 7fc9cbe00700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c410eef0 0x7fc9c419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:03.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.427+0000 7fc9cbe00700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c40746c0 0x7fc9c419ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:03.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.427+0000 7fc9cbe00700 1 --2- 172.21.15.28:0/3507810669 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9c4074fe0 0x7fc9c419b3b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:03.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.427+0000 7fc9cbe00700 1 -- 172.21.15.28:0/3507810669 >> 172.21.15.28:0/3507810669 conn(0x7fc9c40795f0 msgr2=0x7fc9c40ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:03.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.427+0000 7fc9cbe00700 1 -- 172.21.15.28:0/3507810669 shutdown_connections 2024-06-06T08:42:03.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:03.428+0000 7fc9cbe00700 1 -- 172.21.15.28:0/3507810669 wait complete. 2024-06-06T08:42:03.583 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:03 smithi028 ceph-mon[31564]: pgmap v393: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:03.583 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:03.583 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:03 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:03.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:03 smithi059 ceph-mon[36684]: pgmap v393: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:03.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:03.600 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:03 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:03.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:03 smithi037 ceph-mon[36609]: pgmap v393: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:03.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:03.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:03 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:04.554 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:04 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/3507810669' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-06T08:42:04.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:04 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/3507810669' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-06T08:42:04.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:04 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/3507810669' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-06T08:42:05.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:05 smithi028 ceph-mon[31564]: pgmap v394: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:05.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:05 smithi059 ceph-mon[36684]: pgmap v394: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:05.714 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:05 smithi037 ceph-mon[36609]: pgmap v394: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:06.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.154+0000 7fa9ebe00700 1 -- 172.21.15.28:0/3404792314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec102620 msgr2=0x7fa9ec102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:06.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.154+0000 7fa9ebe00700 1 --2- 172.21.15.28:0/3404792314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec102620 0x7fa9ec102a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0099c0 tx=0x7fa9dc009cd0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.155+0000 7fa9ebe00700 1 -- 172.21.15.28:0/3404792314 shutdown_connections 2024-06-06T08:42:06.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.155+0000 7fa9ebe00700 1 --2- 172.21.15.28:0/3404792314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9ec107700 0x7fa9ec10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.155+0000 7fa9ebe00700 1 --2- 172.21.15.28:0/3404792314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec102620 0x7fa9ec102a00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.155+0000 7fa9ebe00700 1 --2- 172.21.15.28:0/3404792314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9ec102fd0 0x7fa9ec107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.155+0000 7fa9ebe00700 1 -- 172.21.15.28:0/3404792314 >> 172.21.15.28:0/3404792314 conn(0x7fa9ec0fdf10 msgr2=0x7fa9ec100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:06.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.155+0000 7fa9ebe00700 1 -- 172.21.15.28:0/3404792314 shutdown_connections 2024-06-06T08:42:06.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.155+0000 7fa9ebe00700 1 -- 172.21.15.28:0/3404792314 wait complete. 2024-06-06T08:42:06.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.156+0000 7fa9ebe00700 1 Processor -- start 2024-06-06T08:42:06.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.156+0000 7fa9ebe00700 1 -- start start 2024-06-06T08:42:06.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.156+0000 7fa9ebe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec102620 0x7fa9ec074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:06.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.156+0000 7fa9ebe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9ec102fd0 0x7fa9ec074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:06.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.156+0000 7fa9ebe00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9ec107700 0x7fa9ec075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:06.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9ebe00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec112760 con 0x7fa9ec102620 2024-06-06T08:42:06.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9ebe00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec1125e0 con 0x7fa9ec107700 2024-06-06T08:42:06.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9ebe00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec1128e0 con 0x7fa9ec102fd0 2024-06-06T08:42:06.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9eaa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec102620 0x7fa9ec074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:06.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9eaa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec102620 0x7fa9ec074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46886/0 (socket says 172.21.15.28:46886) 2024-06-06T08:42:06.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9eaa00700 1 -- 172.21.15.28:0/772834013 learned_addr learned my addr 172.21.15.28:0/772834013 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:06.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9ea000700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9ec102fd0 0x7fa9ec074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:06.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9eb400700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9ec107700 0x7fa9ec075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:06.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9ea000700 1 -- 172.21.15.28:0/772834013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9ec107700 msgr2=0x7fa9ec075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:06.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9ea000700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9ec107700 0x7fa9ec075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9ea000700 1 -- 172.21.15.28:0/772834013 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec102620 msgr2=0x7fa9ec074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:06.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9ea000700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec102620 0x7fa9ec074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9ea000700 1 -- 172.21.15.28:0/772834013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec1a7120 con 0x7fa9ec102fd0 2024-06-06T08:42:06.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.157+0000 7fa9eaa00700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec102620 0x7fa9ec074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:06.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.158+0000 7fa9ea000700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9ec102fd0 0x7fa9ec074cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800e9c0 tx=0x7fa9d800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:06.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.158+0000 7fa9e3400700 1 -- 172.21.15.28:0/772834013 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800cb70 con 0x7fa9ec102fd0 2024-06-06T08:42:06.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.158+0000 7fa9e3400700 1 -- 172.21.15.28:0/772834013 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9d8004500 con 0x7fa9ec102fd0 2024-06-06T08:42:06.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.158+0000 7fa9ebe00700 1 -- 172.21.15.28:0/772834013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ec1a7410 con 0x7fa9ec102fd0 2024-06-06T08:42:06.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.158+0000 7fa9e3400700 1 -- 172.21.15.28:0/772834013 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8003de0 con 0x7fa9ec102fd0 2024-06-06T08:42:06.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.158+0000 7fa9ebe00700 1 -- 172.21.15.28:0/772834013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ec1a7950 con 0x7fa9ec102fd0 2024-06-06T08:42:06.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.159+0000 7fa9ebe00700 1 -- 172.21.15.28:0/772834013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ec069180 con 0x7fa9ec102fd0 2024-06-06T08:42:06.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.162+0000 7fa9e3400700 1 -- 172.21.15.28:0/772834013 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa9d8003fc0 con 0x7fa9ec102fd0 2024-06-06T08:42:06.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.164+0000 7fa9e3400700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9d00a2cb0 0x7fa9d00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:06.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.164+0000 7fa9e3400700 1 -- 172.21.15.28:0/772834013 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fa9d80cf3f0 con 0x7fa9ec102fd0 2024-06-06T08:42:06.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.164+0000 7fa9eaa00700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9d00a2cb0 0x7fa9d00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:06.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.165+0000 7fa9eaa00700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9d00a2cb0 0x7fa9d00a5170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009990 tx=0x7fa9dc005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:06.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.168+0000 7fa9e3400700 1 -- 172.21.15.28:0/772834013 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa9d800ee60 con 0x7fa9ec102fd0 2024-06-06T08:42:06.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.433+0000 7fa9ebe00700 1 -- 172.21.15.28:0/772834013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa9ec075cc0 con 0x7fa9ec102fd0 2024-06-06T08:42:06.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.433+0000 7fa9e3400700 1 -- 172.21.15.28:0/772834013 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa9d809c110 con 0x7fa9ec102fd0 2024-06-06T08:42:06.432 INFO:teuthology.orchestra.run.smithi028.stdout:309237645359 2024-06-06T08:42:06.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.436+0000 7fa9ebe00700 1 -- 172.21.15.28:0/772834013 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9d00a2cb0 msgr2=0x7fa9d00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:06.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.436+0000 7fa9ebe00700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9d00a2cb0 0x7fa9d00a5170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009990 tx=0x7fa9dc005ab0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.436+0000 7fa9ebe00700 1 -- 172.21.15.28:0/772834013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9ec102fd0 msgr2=0x7fa9ec074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:06.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.436+0000 7fa9ebe00700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9ec102fd0 0x7fa9ec074cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800e9c0 tx=0x7fa9d800ecd0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.436+0000 7fa9ebe00700 1 -- 172.21.15.28:0/772834013 shutdown_connections 2024-06-06T08:42:06.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.436+0000 7fa9ebe00700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa9d00a2cb0 0x7fa9d00a5170 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.436+0000 7fa9ebe00700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9ec107700 0x7fa9ec075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.436+0000 7fa9ebe00700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9ec102620 0x7fa9ec074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.436+0000 7fa9ebe00700 1 --2- 172.21.15.28:0/772834013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9ec102fd0 0x7fa9ec074cd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:06.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.436+0000 7fa9ebe00700 1 -- 172.21.15.28:0/772834013 >> 172.21.15.28:0/772834013 conn(0x7fa9ec0fdf10 msgr2=0x7fa9ec100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:06.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.437+0000 7fa9ebe00700 1 -- 172.21.15.28:0/772834013 shutdown_connections 2024-06-06T08:42:06.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:06.437+0000 7fa9ebe00700 1 -- 172.21.15.28:0/772834013 wait complete. 2024-06-06T08:42:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.292+0000 7f7a5cc00700 1 -- 172.21.15.28:0/2865473109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a5806a170 msgr2=0x7f7a5806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.292+0000 7f7a5cc00700 1 --2- 172.21.15.28:0/2865473109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a5806a170 0x7f7a5806a5f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a440098f0 tx=0x7f7a44009c00 comp rx=0 tx=0).stop 2024-06-06T08:42:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.293+0000 7f7a5cc00700 1 -- 172.21.15.28:0/2865473109 shutdown_connections 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.293+0000 7f7a5cc00700 1 --2- 172.21.15.28:0/2865473109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a5806ab30 0x7f7a5810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.293+0000 7f7a5cc00700 1 --2- 172.21.15.28:0/2865473109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a58108500 0x7f7a581088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.293+0000 7f7a5cc00700 1 --2- 172.21.15.28:0/2865473109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a5806a170 0x7f7a5806a5f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.293+0000 7f7a5cc00700 1 -- 172.21.15.28:0/2865473109 >> 172.21.15.28:0/2865473109 conn(0x7f7a58078340 msgr2=0x7f7a58078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.293+0000 7f7a5cc00700 1 -- 172.21.15.28:0/2865473109 shutdown_connections 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.293+0000 7f7a5cc00700 1 -- 172.21.15.28:0/2865473109 wait complete. 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.294+0000 7f7a5cc00700 1 Processor -- start 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.294+0000 7f7a5cc00700 1 -- start start 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.294+0000 7f7a5cc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a5806a170 0x7f7a5819e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.294+0000 7f7a5cc00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5806ab30 0x7f7a5819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.294+0000 7f7a5cc00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a58108500 0x7f7a58198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.294+0000 7f7a5cc00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7a58112760 con 0x7f7a5806a170 2024-06-06T08:42:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.294+0000 7f7a5cc00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7a581125e0 con 0x7f7a58108500 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.294+0000 7f7a5cc00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7a581128e0 con 0x7f7a5806ab30 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a55e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a5806a170 0x7f7a5819e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a55e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a5806a170 0x7f7a5819e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46910/0 (socket says 172.21.15.28:46910) 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a55e00700 1 -- 172.21.15.28:0/1026306727 learned_addr learned my addr 172.21.15.28:0/1026306727 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a56800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a58108500 0x7f7a58198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a55400700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5806ab30 0x7f7a5819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a55e00700 1 -- 172.21.15.28:0/1026306727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5806ab30 msgr2=0x7f7a5819ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a55e00700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5806ab30 0x7f7a5819ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a55e00700 1 -- 172.21.15.28:0/1026306727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a58108500 msgr2=0x7f7a58198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a55e00700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a58108500 0x7f7a58198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a55e00700 1 -- 172.21.15.28:0/1026306727 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a58199220 con 0x7f7a5806a170 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a56800700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a58108500 0x7f7a58198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a55400700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5806ab30 0x7f7a5819ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:42:07.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.295+0000 7f7a55e00700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a5806a170 0x7f7a5819e900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800e9a0 tx=0x7f7a4800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.296+0000 7f7a4ea00700 1 -- 172.21.15.28:0/1026306727 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4800cbd0 con 0x7f7a5806a170 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.296+0000 7f7a5cc00700 1 -- 172.21.15.28:0/1026306727 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a58199510 con 0x7f7a5806a170 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.296+0000 7f7a4ea00700 1 -- 172.21.15.28:0/1026306727 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a4800cd70 con 0x7f7a5806a170 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.296+0000 7f7a5cc00700 1 -- 172.21.15.28:0/1026306727 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a581a57d0 con 0x7f7a5806a170 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.296+0000 7f7a4ea00700 1 -- 172.21.15.28:0/1026306727 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480186f0 con 0x7f7a5806a170 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.297+0000 7f7a5cc00700 1 -- 172.21.15.28:0/1026306727 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a58069180 con 0x7f7a5806a170 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.299+0000 7f7a4ea00700 1 -- 172.21.15.28:0/1026306727 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7a48010430 con 0x7f7a5806a170 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.301+0000 7f7a4ea00700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7a3c0a2cb0 0x7f7a3c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.301+0000 7f7a4ea00700 1 -- 172.21.15.28:0/1026306727 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f7a480cf6d0 con 0x7f7a5806a170 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.301+0000 7f7a55400700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7a3c0a2cb0 0x7f7a3c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.302+0000 7f7a55400700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7a3c0a2cb0 0x7f7a3c0a5170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009fd0 tx=0x7f7a44019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.303+0000 7f7a4ea00700 1 -- 172.21.15.28:0/1026306727 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7a4809c3f0 con 0x7f7a5806a170 2024-06-06T08:42:07.506 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738468 got 34359738472 for osd.0 2024-06-06T08:42:07.507 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:07.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.539+0000 7f7a5cc00700 1 -- 172.21.15.28:0/1026306727 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7a5802dca0 con 0x7f7a5806a170 2024-06-06T08:42:07.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.540+0000 7f7a4ea00700 1 -- 172.21.15.28:0/1026306727 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7a4809bcf0 con 0x7f7a5806a170 2024-06-06T08:42:07.538 INFO:teuthology.orchestra.run.smithi028.stdout:77309411424 2024-06-06T08:42:07.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.543+0000 7f7a5cc00700 1 -- 172.21.15.28:0/1026306727 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7a3c0a2cb0 msgr2=0x7f7a3c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:07.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.543+0000 7f7a5cc00700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7a3c0a2cb0 0x7f7a3c0a5170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009fd0 tx=0x7f7a44019040 comp rx=0 tx=0).stop 2024-06-06T08:42:07.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.543+0000 7f7a5cc00700 1 -- 172.21.15.28:0/1026306727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a5806a170 msgr2=0x7f7a5819e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:07.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.543+0000 7f7a5cc00700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a5806a170 0x7f7a5819e900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800e9a0 tx=0x7f7a4800ecb0 comp rx=0 tx=0).stop 2024-06-06T08:42:07.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.543+0000 7f7a5cc00700 1 -- 172.21.15.28:0/1026306727 shutdown_connections 2024-06-06T08:42:07.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.543+0000 7f7a5cc00700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7a3c0a2cb0 0x7f7a3c0a5170 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:07.543 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:07 smithi028 ceph-mon[31564]: pgmap v395: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:07.543 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:07 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/772834013' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-06T08:42:07.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.543+0000 7f7a5cc00700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a58108500 0x7f7a58198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:07.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.543+0000 7f7a5cc00700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a5806a170 0x7f7a5819e900 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:07.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.543+0000 7f7a5cc00700 1 --2- 172.21.15.28:0/1026306727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5806ab30 0x7f7a5819ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:07.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.543+0000 7f7a5cc00700 1 -- 172.21.15.28:0/1026306727 >> 172.21.15.28:0/1026306727 conn(0x7f7a58078340 msgr2=0x7f7a58100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:07.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.544+0000 7f7a5cc00700 1 -- 172.21.15.28:0/1026306727 shutdown_connections 2024-06-06T08:42:07.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:07.544+0000 7f7a5cc00700 1 -- 172.21.15.28:0/1026306727 wait complete. 2024-06-06T08:42:07.586 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645354 got 309237645359 for osd.10 2024-06-06T08:42:07.586 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:07.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:07 smithi059 ceph-mon[36684]: pgmap v395: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:07.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:07 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/772834013' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-06T08:42:07.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:07 smithi037 ceph-mon[36609]: pgmap v395: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:07.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:07 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/772834013' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-06T08:42:08.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:08 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1026306727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-06T08:42:08.667 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:08 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1026306727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-06T08:42:08.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.728+0000 7fdfe9600700 1 -- 172.21.15.28:0/3756601411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe4108580 msgr2=0x7fdfe4108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:08.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.728+0000 7fdfe9600700 1 --2- 172.21.15.28:0/3756601411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe4108580 0x7fdfe4108960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40099c0 tx=0x7fdfd4009cd0 comp rx=0 tx=0).stop 2024-06-06T08:42:08.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.728+0000 7fdfe9600700 1 -- 172.21.15.28:0/3756601411 shutdown_connections 2024-06-06T08:42:08.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.728+0000 7fdfe9600700 1 --2- 172.21.15.28:0/3756601411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfe406b620 0x7fdfe410f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:08.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.728+0000 7fdfe9600700 1 --2- 172.21.15.28:0/3756601411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe4108580 0x7fdfe4108960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:08.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.728+0000 7fdfe9600700 1 --2- 172.21.15.28:0/3756601411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfe406ac60 0x7fdfe406b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.728+0000 7fdfe9600700 1 -- 172.21.15.28:0/3756601411 >> 172.21.15.28:0/3756601411 conn(0x7fdfe4078430 msgr2=0x7fdfe4078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.728+0000 7fdfe9600700 1 -- 172.21.15.28:0/3756601411 shutdown_connections 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.728+0000 7fdfe9600700 1 -- 172.21.15.28:0/3756601411 wait complete. 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.729+0000 7fdfe9600700 1 Processor -- start 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.729+0000 7fdfe9600700 1 -- start start 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.729+0000 7fdfe9600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfe406ac60 0x7fdfe4101400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.729+0000 7fdfe9600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfe406b620 0x7fdfe4101940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.729+0000 7fdfe9600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe4108580 0x7fdfe4101e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe9600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe4112810 con 0x7fdfe4108580 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe9600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe4112690 con 0x7fdfe406b620 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe9600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe4112990 con 0x7fdfe406ac60 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe3400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe4108580 0x7fdfe4101e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:08.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe2a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfe406ac60 0x7fdfe4101400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe3400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe4108580 0x7fdfe4101e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46916/0 (socket says 172.21.15.28:46916) 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe2a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfe406ac60 0x7fdfe4101400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:45144/0 (socket says 172.21.15.28:45144) 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe3400700 1 -- 172.21.15.28:0/2111705514 learned_addr learned my addr 172.21.15.28:0/2111705514 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe2000700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfe406b620 0x7fdfe4101940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe2a00700 1 -- 172.21.15.28:0/2111705514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfe406b620 msgr2=0x7fdfe4101940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe2a00700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfe406b620 0x7fdfe4101940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe2a00700 1 -- 172.21.15.28:0/2111705514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe4108580 msgr2=0x7fdfe4101e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe2a00700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe4108580 0x7fdfe4101e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe2a00700 1 -- 172.21.15.28:0/2111705514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe41a7130 con 0x7fdfe406ac60 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe2000700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfe406b620 0x7fdfe4101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.730+0000 7fdfe3400700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe4108580 0x7fdfe4101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.731+0000 7fdfe2a00700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfe406ac60 0x7fdfe4101400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40098e0 tx=0x7fdfd4003a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.731+0000 7fdfdb400700 1 -- 172.21.15.28:0/2111705514 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4003680 con 0x7fdfe406ac60 2024-06-06T08:42:08.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.731+0000 7fdfe9600700 1 -- 172.21.15.28:0/2111705514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe41a73c0 con 0x7fdfe406ac60 2024-06-06T08:42:08.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.731+0000 7fdfdb400700 1 -- 172.21.15.28:0/2111705514 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfd40055a0 con 0x7fdfe406ac60 2024-06-06T08:42:08.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.731+0000 7fdfdb400700 1 -- 172.21.15.28:0/2111705514 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd400fc90 con 0x7fdfe406ac60 2024-06-06T08:42:08.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.731+0000 7fdfe9600700 1 -- 172.21.15.28:0/2111705514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe41a7870 con 0x7fdfe406ac60 2024-06-06T08:42:08.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.732+0000 7fdfe9600700 1 -- 172.21.15.28:0/2111705514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe410aa10 con 0x7fdfe406ac60 2024-06-06T08:42:08.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.734+0000 7fdfdb400700 1 -- 172.21.15.28:0/2111705514 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdfd400f460 con 0x7fdfe406ac60 2024-06-06T08:42:08.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.736+0000 7fdfdb400700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdfc80a2e50 0x7fdfc80a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:08.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.736+0000 7fdfdb400700 1 -- 172.21.15.28:0/2111705514 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fdfd40d01c0 con 0x7fdfe406ac60 2024-06-06T08:42:08.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.736+0000 7fdfe2000700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdfc80a2e50 0x7fdfc80a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:08.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.736+0000 7fdfe2000700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdfc80a2e50 0x7fdfc80a5310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009680 tx=0x7fdfd0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:08.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.738+0000 7fdfdb400700 1 -- 172.21.15.28:0/2111705514 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdfd4013070 con 0x7fdfe406ac60 2024-06-06T08:42:08.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:08 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1026306727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-06T08:42:08.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.987+0000 7fdfe9600700 1 -- 172.21.15.28:0/2111705514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fdfe410a3f0 con 0x7fdfe406ac60 2024-06-06T08:42:08.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.987+0000 7fdfdb400700 1 -- 172.21.15.28:0/2111705514 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdfd409cf70 con 0x7fdfe406ac60 2024-06-06T08:42:08.986 INFO:teuthology.orchestra.run.smithi028.stdout:219043332161 2024-06-06T08:42:08.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.990+0000 7fdfe9600700 1 -- 172.21.15.28:0/2111705514 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdfc80a2e50 msgr2=0x7fdfc80a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:08.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.990+0000 7fdfe9600700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdfc80a2e50 0x7fdfc80a5310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009680 tx=0x7fdfd0009260 comp rx=0 tx=0).stop 2024-06-06T08:42:08.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.990+0000 7fdfe9600700 1 -- 172.21.15.28:0/2111705514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfe406ac60 msgr2=0x7fdfe4101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:08.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.990+0000 7fdfe9600700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfe406ac60 0x7fdfe4101400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40098e0 tx=0x7fdfd4003a90 comp rx=0 tx=0).stop 2024-06-06T08:42:08.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.990+0000 7fdfe9600700 1 -- 172.21.15.28:0/2111705514 shutdown_connections 2024-06-06T08:42:08.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.990+0000 7fdfe9600700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdfc80a2e50 0x7fdfc80a5310 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:08.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.990+0000 7fdfe9600700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe4108580 0x7fdfe4101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:08.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.991+0000 7fdfe9600700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfe406ac60 0x7fdfe4101400 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:08.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.991+0000 7fdfe9600700 1 --2- 172.21.15.28:0/2111705514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfe406b620 0x7fdfe4101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:08.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.991+0000 7fdfe9600700 1 -- 172.21.15.28:0/2111705514 >> 172.21.15.28:0/2111705514 conn(0x7fdfe4078430 msgr2=0x7fdfe40ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:08.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.991+0000 7fdfe9600700 1 -- 172.21.15.28:0/2111705514 shutdown_connections 2024-06-06T08:42:08.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:08.991+0000 7fdfe9600700 1 -- 172.21.15.28:0/2111705514 wait complete. 2024-06-06T08:42:09.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.463+0000 7fa0cca00700 1 -- 172.21.15.28:0/519796285 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0c8105090 msgr2=0x7fa0c81115a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:09.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.463+0000 7fa0cca00700 1 --2- 172.21.15.28:0/519796285 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0c8105090 0x7fa0c81115a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000b0a0 tx=0x7fa0c000b3b0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.463+0000 7fa0cca00700 1 -- 172.21.15.28:0/519796285 shutdown_connections 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.463+0000 7fa0cca00700 1 --2- 172.21.15.28:0/519796285 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0c8105090 0x7fa0c81115a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.463+0000 7fa0cca00700 1 --2- 172.21.15.28:0/519796285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0c810a6d0 0x7fa0c810aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.463+0000 7fa0cca00700 1 --2- 172.21.15.28:0/519796285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c81046d0 0x7fa0c8104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.463+0000 7fa0cca00700 1 -- 172.21.15.28:0/519796285 >> 172.21.15.28:0/519796285 conn(0x7fa0c81001c0 msgr2=0x7fa0c81025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.463+0000 7fa0cca00700 1 -- 172.21.15.28:0/519796285 shutdown_connections 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.463+0000 7fa0cca00700 1 -- 172.21.15.28:0/519796285 wait complete. 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.464+0000 7fa0cca00700 1 Processor -- start 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.464+0000 7fa0cca00700 1 -- start start 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.465+0000 7fa0cca00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0c81046d0 0x7fa0c819ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.465+0000 7fa0cca00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8105090 0x7fa0c819b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.465+0000 7fa0cca00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0c810a6d0 0x7fa0c819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.465+0000 7fa0cca00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c8114ab0 con 0x7fa0c81046d0 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.465+0000 7fa0cca00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c8114930 con 0x7fa0c8105090 2024-06-06T08:42:09.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.465+0000 7fa0cca00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c8114c30 con 0x7fa0c810a6d0 2024-06-06T08:42:09.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.465+0000 7fa0c5e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0c81046d0 0x7fa0c819ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:09.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.465+0000 7fa0c5e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0c81046d0 0x7fa0c819ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46924/0 (socket says 172.21.15.28:46924) 2024-06-06T08:42:09.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.465+0000 7fa0c5e00700 1 -- 172.21.15.28:0/1771098078 learned_addr learned my addr 172.21.15.28:0/1771098078 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:09.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.465+0000 7fa0c6800700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0c810a6d0 0x7fa0c819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:09.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.465+0000 7fa0c5400700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8105090 0x7fa0c819b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:09.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0c5e00700 1 -- 172.21.15.28:0/1771098078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0c810a6d0 msgr2=0x7fa0c819f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:09.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0c5e00700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0c810a6d0 0x7fa0c819f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0c5e00700 1 -- 172.21.15.28:0/1771098078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8105090 msgr2=0x7fa0c819b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:09.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0c5e00700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8105090 0x7fa0c819b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0c5e00700 1 -- 172.21.15.28:0/1771098078 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c819fe50 con 0x7fa0c81046d0 2024-06-06T08:42:09.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0c6800700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0c810a6d0 0x7fa0c819f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0c5e00700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0c81046d0 0x7fa0c819ae40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800e9a0 tx=0x7fa0b800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0bea00700 1 -- 172.21.15.28:0/1771098078 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800ca10 con 0x7fa0c81046d0 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0bea00700 1 -- 172.21.15.28:0/1771098078 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b800cbb0 con 0x7fa0c81046d0 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0bea00700 1 -- 172.21.15.28:0/1771098078 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8018680 con 0x7fa0c81046d0 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0cca00700 1 -- 172.21.15.28:0/1771098078 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c81a0140 con 0x7fa0c81046d0 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.466+0000 7fa0cca00700 1 -- 172.21.15.28:0/1771098078 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c81a79c0 con 0x7fa0c81046d0 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.467+0000 7fa0cca00700 1 -- 172.21.15.28:0/1771098078 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c8069180 con 0x7fa0c81046d0 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.470+0000 7fa0bea00700 1 -- 172.21.15.28:0/1771098078 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa0b8010430 con 0x7fa0c81046d0 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.471+0000 7fa0bea00700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa0ac0a2cb0 0x7fa0ac0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.471+0000 7fa0bea00700 1 -- 172.21.15.28:0/1771098078 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fa0b80cf460 con 0x7fa0c81046d0 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.471+0000 7fa0c5400700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa0ac0a2cb0 0x7fa0ac0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.472+0000 7fa0c5400700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa0ac0a2cb0 0x7fa0ac0a5170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8109c90 tx=0x7fa0b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:09.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.476+0000 7fa0bea00700 1 -- 172.21.15.28:0/1771098078 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa0b809c180 con 0x7fa0c81046d0 2024-06-06T08:42:09.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:09 smithi028 ceph-mon[31564]: pgmap v396: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:09.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:09 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2111705514' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-06T08:42:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.710+0000 7fa0cca00700 1 -- 172.21.15.28:0/1771098078 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fa0c81a7b90 con 0x7fa0c81046d0 2024-06-06T08:42:09.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.711+0000 7fa0bea00700 1 -- 172.21.15.28:0/1771098078 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa0b809ba80 con 0x7fa0c81046d0 2024-06-06T08:42:09.709 INFO:teuthology.orchestra.run.smithi028.stdout:287762808885 2024-06-06T08:42:09.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 -- 172.21.15.28:0/1771098078 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa0ac0a2cb0 msgr2=0x7fa0ac0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa0ac0a2cb0 0x7fa0ac0a5170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8109c90 tx=0x7fa0b4009260 comp rx=0 tx=0).stop 2024-06-06T08:42:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 -- 172.21.15.28:0/1771098078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0c81046d0 msgr2=0x7fa0c819ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0c81046d0 0x7fa0c819ae40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800e9a0 tx=0x7fa0b800ecb0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 -- 172.21.15.28:0/1771098078 shutdown_connections 2024-06-06T08:42:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa0ac0a2cb0 0x7fa0ac0a5170 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0c810a6d0 0x7fa0c819f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0c81046d0 0x7fa0c819ae40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 --2- 172.21.15.28:0/1771098078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8105090 0x7fa0c819b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 -- 172.21.15.28:0/1771098078 >> 172.21.15.28:0/1771098078 conn(0x7fa0c81001c0 msgr2=0x7fa0c81006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 -- 172.21.15.28:0/1771098078 shutdown_connections 2024-06-06T08:42:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.714+0000 7fa0cca00700 1 -- 172.21.15.28:0/1771098078 wait complete. 2024-06-06T08:42:09.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:09 smithi037 ceph-mon[36609]: pgmap v396: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:09.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:09 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2111705514' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-06T08:42:09.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.816+0000 7f14df400700 1 -- 172.21.15.28:0/1402751359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d8104ed0 msgr2=0x7f14d8105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:09.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.816+0000 7f14df400700 1 --2- 172.21.15.28:0/1402751359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d8104ed0 0x7f14d8105360 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14d000b0a0 tx=0x7f14d000b3b0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.816+0000 7f14df400700 1 -- 172.21.15.28:0/1402751359 shutdown_connections 2024-06-06T08:42:09.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.816+0000 7f14df400700 1 --2- 172.21.15.28:0/1402751359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d8104ed0 0x7f14d8105360 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.816+0000 7f14df400700 1 --2- 172.21.15.28:0/1402751359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14d81073c0 0x7f14d806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.816+0000 7f14df400700 1 --2- 172.21.15.28:0/1402751359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14d806a6e0 0x7f14d806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.816+0000 7f14df400700 1 -- 172.21.15.28:0/1402751359 >> 172.21.15.28:0/1402751359 conn(0x7f14d8078340 msgr2=0x7f14d8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:09.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.816+0000 7f14df400700 1 -- 172.21.15.28:0/1402751359 shutdown_connections 2024-06-06T08:42:09.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.816+0000 7f14df400700 1 -- 172.21.15.28:0/1402751359 wait complete. 2024-06-06T08:42:09.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.817+0000 7f14df400700 1 Processor -- start 2024-06-06T08:42:09.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.817+0000 7f14df400700 1 -- start start 2024-06-06T08:42:09.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.818+0000 7f14df400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14d806a6e0 0x7f14d819f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:09.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.818+0000 7f14df400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14d8104ed0 0x7f14d819f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:09.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.818+0000 7f14df400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d81073c0 0x7f14d81a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:09.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.818+0000 7f14df400700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f14d8118dd0 con 0x7f14d806a6e0 2024-06-06T08:42:09.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.818+0000 7f14df400700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f14d8118c50 con 0x7f14d81073c0 2024-06-06T08:42:09.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.818+0000 7f14df400700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f14d8118f50 con 0x7f14d8104ed0 2024-06-06T08:42:09.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.818+0000 7f14dca00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14d806a6e0 0x7f14d819f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:09.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.818+0000 7f14d7e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14d8104ed0 0x7f14d819f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:09.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.818+0000 7f14d7e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14d8104ed0 0x7f14d819f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:45176/0 (socket says 172.21.15.28:45176) 2024-06-06T08:42:09.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.818+0000 7f14d7e00700 1 -- 172.21.15.28:0/92521734 learned_addr learned my addr 172.21.15.28:0/92521734 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:09.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.818+0000 7f14dd400700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d81073c0 0x7f14d81a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:09.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.819+0000 7f14d7e00700 1 -- 172.21.15.28:0/92521734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d81073c0 msgr2=0x7f14d81a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:09.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.819+0000 7f14d7e00700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d81073c0 0x7f14d81a3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.819+0000 7f14d7e00700 1 -- 172.21.15.28:0/92521734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14d806a6e0 msgr2=0x7f14d819f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:09.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.819+0000 7f14d7e00700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14d806a6e0 0x7f14d819f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:09.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.819+0000 7f14d7e00700 1 -- 172.21.15.28:0/92521734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d81a4200 con 0x7f14d8104ed0 2024-06-06T08:42:09.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.819+0000 7f14dd400700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d81073c0 0x7f14d81a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:42:09.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.819+0000 7f14d7e00700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14d8104ed0 0x7f14d819f780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f14c400e9c0 tx=0x7f14c400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:09.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.819+0000 7f14d5600700 1 -- 172.21.15.28:0/92521734 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c400cbd0 con 0x7f14d8104ed0 2024-06-06T08:42:09.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.819+0000 7f14d5600700 1 -- 172.21.15.28:0/92521734 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14c400cd70 con 0x7f14d8104ed0 2024-06-06T08:42:09.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.819+0000 7f14df400700 1 -- 172.21.15.28:0/92521734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d81a44f0 con 0x7f14d8104ed0 2024-06-06T08:42:09.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.820+0000 7f14d5600700 1 -- 172.21.15.28:0/92521734 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4010430 con 0x7f14d8104ed0 2024-06-06T08:42:09.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.820+0000 7f14df400700 1 -- 172.21.15.28:0/92521734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d81abd70 con 0x7f14d8104ed0 2024-06-06T08:42:09.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.821+0000 7f14df400700 1 -- 172.21.15.28:0/92521734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d8069180 con 0x7f14d8104ed0 2024-06-06T08:42:09.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.823+0000 7f14d5600700 1 -- 172.21.15.28:0/92521734 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f14c4044b60 con 0x7f14d8104ed0 2024-06-06T08:42:09.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.824+0000 7f14d5600700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f14c00a2d30 0x7f14c00a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:09.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.825+0000 7f14d5600700 1 -- 172.21.15.28:0/92521734 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f14c40cf500 con 0x7f14d8104ed0 2024-06-06T08:42:09.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.825+0000 7f14dca00700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f14c00a2d30 0x7f14c00a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:09.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.825+0000 7f14dca00700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f14c00a2d30 0x7f14c00a51f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009680 tx=0x7f14cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:09.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:09.827+0000 7f14d5600700 1 -- 172.21.15.28:0/92521734 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f14c409c220 con 0x7f14d8104ed0 2024-06-06T08:42:09.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:09 smithi059 ceph-mon[36684]: pgmap v396: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:09.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:09 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2111705514' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-06T08:42:10.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.075+0000 7f14df400700 1 -- 172.21.15.28:0/92521734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f14d81ac030 con 0x7f14d8104ed0 2024-06-06T08:42:10.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.076+0000 7f14d5600700 1 -- 172.21.15.28:0/92521734 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f14c409bb20 con 0x7f14d8104ed0 2024-06-06T08:42:10.074 INFO:teuthology.orchestra.run.smithi028.stdout:253403070524 2024-06-06T08:42:10.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 -- 172.21.15.28:0/92521734 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f14c00a2d30 msgr2=0x7f14c00a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:10.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f14c00a2d30 0x7f14c00a51f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009680 tx=0x7f14cc009260 comp rx=0 tx=0).stop 2024-06-06T08:42:10.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 -- 172.21.15.28:0/92521734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14d8104ed0 msgr2=0x7f14d819f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:10.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14d8104ed0 0x7f14d819f780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f14c400e9c0 tx=0x7f14c400ecd0 comp rx=0 tx=0).stop 2024-06-06T08:42:10.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 -- 172.21.15.28:0/92521734 shutdown_connections 2024-06-06T08:42:10.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f14c00a2d30 0x7f14c00a51f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:10.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d81073c0 0x7f14d81a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:10.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14d806a6e0 0x7f14d819f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:10.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 --2- 172.21.15.28:0/92521734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14d8104ed0 0x7f14d819f780 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:10.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 -- 172.21.15.28:0/92521734 >> 172.21.15.28:0/92521734 conn(0x7f14d8078340 msgr2=0x7f14d8103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:10.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 -- 172.21.15.28:0/92521734 shutdown_connections 2024-06-06T08:42:10.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:10.079+0000 7f14df400700 1 -- 172.21.15.28:0/92521734 wait complete. 2024-06-06T08:42:10.749 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:10 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1771098078' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-06T08:42:10.749 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:10 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/92521734' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-06T08:42:10.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:10 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1771098078' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-06T08:42:10.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:10 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/92521734' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-06T08:42:10.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:10 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1771098078' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-06T08:42:10.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:10 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/92521734' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-06T08:42:11.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.394+0000 7f54b1c00700 1 -- 172.21.15.28:0/2662157605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac06ab30 msgr2=0x7f54ac10f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:11.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.394+0000 7f54b1c00700 1 --2- 172.21.15.28:0/2662157605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac06ab30 0x7f54ac10f320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f54a400b0a0 tx=0x7f54a400b3b0 comp rx=0 tx=0).stop 2024-06-06T08:42:11.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.394+0000 7f54b1c00700 1 -- 172.21.15.28:0/2662157605 shutdown_connections 2024-06-06T08:42:11.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.394+0000 7f54b1c00700 1 --2- 172.21.15.28:0/2662157605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac06ab30 0x7f54ac10f320 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:11.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.394+0000 7f54b1c00700 1 --2- 172.21.15.28:0/2662157605 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54ac108500 0x7f54ac1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:11.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.394+0000 7f54b1c00700 1 --2- 172.21.15.28:0/2662157605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54ac06a170 0x7f54ac06a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:11.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.394+0000 7f54b1c00700 1 -- 172.21.15.28:0/2662157605 >> 172.21.15.28:0/2662157605 conn(0x7f54ac078340 msgr2=0x7f54ac078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:11.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.395+0000 7f54b1c00700 1 -- 172.21.15.28:0/2662157605 shutdown_connections 2024-06-06T08:42:11.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.395+0000 7f54b1c00700 1 -- 172.21.15.28:0/2662157605 wait complete. 2024-06-06T08:42:11.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.396+0000 7f54b1c00700 1 Processor -- start 2024-06-06T08:42:11.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.396+0000 7f54b1c00700 1 -- start start 2024-06-06T08:42:11.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.397+0000 7f54b1c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54ac06a170 0x7f54ac19ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:11.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.397+0000 7f54b1c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54ac06ab30 0x7f54ac19b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:11.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.397+0000 7f54b1c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac108500 0x7f54ac19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:11.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.397+0000 7f54b1c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1127d0 con 0x7f54ac06ab30 2024-06-06T08:42:11.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.397+0000 7f54b1c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac112650 con 0x7f54ac108500 2024-06-06T08:42:11.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.397+0000 7f54b1c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac112950 con 0x7f54ac06a170 2024-06-06T08:42:11.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.397+0000 7f54aa000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54ac06ab30 0x7f54ac19b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:11.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.397+0000 7f54aaa00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54ac06a170 0x7f54ac19ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:11.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.397+0000 7f54aa000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54ac06ab30 0x7f54ac19b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46962/0 (socket says 172.21.15.28:46962) 2024-06-06T08:42:11.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.397+0000 7f54aa000700 1 -- 172.21.15.28:0/700833584 learned_addr learned my addr 172.21.15.28:0/700833584 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:11.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.397+0000 7f54ab400700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac108500 0x7f54ac19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:11.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.398+0000 7f54ab400700 1 -- 172.21.15.28:0/700833584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54ac06a170 msgr2=0x7f54ac19ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:11.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.398+0000 7f54ab400700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54ac06a170 0x7f54ac19ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:11.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.398+0000 7f54ab400700 1 -- 172.21.15.28:0/700833584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54ac06ab30 msgr2=0x7f54ac19b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:11.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.398+0000 7f54ab400700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54ac06ab30 0x7f54ac19b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:11.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.398+0000 7f54ab400700 1 -- 172.21.15.28:0/700833584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac19fe10 con 0x7f54ac108500 2024-06-06T08:42:11.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.398+0000 7f54ab400700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac108500 0x7f54ac19f6d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f54a400b070 tx=0x7f54a4004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:11.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.398+0000 7f54a3400700 1 -- 172.21.15.28:0/700833584 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4021070 con 0x7f54ac108500 2024-06-06T08:42:11.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.398+0000 7f54a3400700 1 -- 172.21.15.28:0/700833584 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54a4007b80 con 0x7f54ac108500 2024-06-06T08:42:11.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.398+0000 7f54a3400700 1 -- 172.21.15.28:0/700833584 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4005040 con 0x7f54ac108500 2024-06-06T08:42:11.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.398+0000 7f54b1c00700 1 -- 172.21.15.28:0/700833584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac1a00a0 con 0x7f54ac108500 2024-06-06T08:42:11.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.399+0000 7f54b1c00700 1 -- 172.21.15.28:0/700833584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac1a7980 con 0x7f54ac108500 2024-06-06T08:42:11.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.400+0000 7f54b1c00700 1 -- 172.21.15.28:0/700833584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ac069180 con 0x7f54ac108500 2024-06-06T08:42:11.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.401+0000 7f54a3400700 1 -- 172.21.15.28:0/700833584 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f54a4024070 con 0x7f54ac108500 2024-06-06T08:42:11.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.403+0000 7f54a3400700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f54900a2ca0 0x7f54900a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:11.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.403+0000 7f54a3400700 1 -- 172.21.15.28:0/700833584 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f54a40cff40 con 0x7f54ac108500 2024-06-06T08:42:11.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.403+0000 7f54aaa00700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f54900a2ca0 0x7f54900a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:11.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.404+0000 7f54aaa00700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f54900a2ca0 0x7f54900a5160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f549c009be0 tx=0x7f549c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:11.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.407+0000 7f54a3400700 1 -- 172.21.15.28:0/700833584 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f54a4007d30 con 0x7f54ac108500 2024-06-06T08:42:11.643 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:11 smithi028 ceph-mon[31564]: pgmap v397: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:11.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.644+0000 7f54b1c00700 1 -- 172.21.15.28:0/700833584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f54ac1a7b50 con 0x7f54ac108500 2024-06-06T08:42:11.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.651+0000 7f54a3400700 1 -- 172.21.15.28:0/700833584 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f54a409ce50 con 0x7f54ac108500 2024-06-06T08:42:11.649 INFO:teuthology.orchestra.run.smithi028.stdout:197568495687 2024-06-06T08:42:11.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.654+0000 7f54b1c00700 1 -- 172.21.15.28:0/700833584 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f54900a2ca0 msgr2=0x7f54900a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:11.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.654+0000 7f54b1c00700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f54900a2ca0 0x7f54900a5160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f549c009be0 tx=0x7f549c009260 comp rx=0 tx=0).stop 2024-06-06T08:42:11.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.654+0000 7f54b1c00700 1 -- 172.21.15.28:0/700833584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac108500 msgr2=0x7f54ac19f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:11.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.654+0000 7f54b1c00700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac108500 0x7f54ac19f6d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f54a400b070 tx=0x7f54a4004c80 comp rx=0 tx=0).stop 2024-06-06T08:42:11.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.655+0000 7f54b1c00700 1 -- 172.21.15.28:0/700833584 shutdown_connections 2024-06-06T08:42:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.655+0000 7f54b1c00700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f54900a2ca0 0x7f54900a5160 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.655+0000 7f54b1c00700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac108500 0x7f54ac19f6d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.655+0000 7f54b1c00700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54ac06a170 0x7f54ac19ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.655+0000 7f54b1c00700 1 --2- 172.21.15.28:0/700833584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54ac06ab30 0x7f54ac19b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.655+0000 7f54b1c00700 1 -- 172.21.15.28:0/700833584 >> 172.21.15.28:0/700833584 conn(0x7f54ac078340 msgr2=0x7f54ac0ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.655+0000 7f54b1c00700 1 -- 172.21.15.28:0/700833584 shutdown_connections 2024-06-06T08:42:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:11.655+0000 7f54b1c00700 1 -- 172.21.15.28:0/700833584 wait complete. 2024-06-06T08:42:11.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:11 smithi037 ceph-mon[36609]: pgmap v397: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:11.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:11 smithi059 ceph-mon[36684]: pgmap v397: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:12.256 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070518 got 253403070524 for osd.8 2024-06-06T08:42:12.256 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:12.463 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:12 smithi028 ceph-mon[31564]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-06-06T08:42:12.463 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:12 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/700833584' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-06T08:42:12.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:12 smithi037 ceph-mon[36609]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-06-06T08:42:12.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:12 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/700833584' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-06T08:42:12.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:12 smithi059 ceph-mon[36684]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-06-06T08:42:12.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:12 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/700833584' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-06T08:42:13.416 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411418 got 77309411424 for osd.2 2024-06-06T08:42:13.416 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:13.470 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:13 smithi028 ceph-mon[31564]: pgmap v398: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-06-06T08:42:13.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.642+0000 7f7900a00700 1 -- 172.21.15.28:0/2520783959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78fc06ac60 msgr2=0x7f78fc06b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:13.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.642+0000 7f7900a00700 1 --2- 172.21.15.28:0/2520783959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78fc06ac60 0x7f78fc06b040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0098f0 tx=0x7f78ec009c00 comp rx=0 tx=0).stop 2024-06-06T08:42:13.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.642+0000 7f7900a00700 1 -- 172.21.15.28:0/2520783959 shutdown_connections 2024-06-06T08:42:13.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.642+0000 7f7900a00700 1 --2- 172.21.15.28:0/2520783959 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78fc1077c0 0x7f78fc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.642+0000 7f7900a00700 1 --2- 172.21.15.28:0/2520783959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78fc06ac60 0x7f78fc06b040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.642+0000 7f7900a00700 1 --2- 172.21.15.28:0/2520783959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78fc06b610 0x7f78fc107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.642+0000 7f7900a00700 1 -- 172.21.15.28:0/2520783959 >> 172.21.15.28:0/2520783959 conn(0x7f78fc0781d0 msgr2=0x7f78fc0785e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:13.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.642+0000 7f7900a00700 1 -- 172.21.15.28:0/2520783959 shutdown_connections 2024-06-06T08:42:13.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.642+0000 7f7900a00700 1 -- 172.21.15.28:0/2520783959 wait complete. 2024-06-06T08:42:13.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.643+0000 7f7900a00700 1 Processor -- start 2024-06-06T08:42:13.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.643+0000 7f7900a00700 1 -- start start 2024-06-06T08:42:13.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f7900a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78fc06ac60 0x7f78fc19ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:13.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f7900a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78fc06b610 0x7f78fc19b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:13.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f7900a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78fc1077c0 0x7f78fc19f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:13.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f7900a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc112740 con 0x7f78fc06b610 2024-06-06T08:42:13.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f7900a00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1125c0 con 0x7f78fc06ac60 2024-06-06T08:42:13.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f7900a00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1128c0 con 0x7f78fc1077c0 2024-06-06T08:42:13.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f78fb400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78fc06ac60 0x7f78fc19ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:13.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f78faa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78fc06b610 0x7f78fc19b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:13.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f78fbe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78fc1077c0 0x7f78fc19f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:13.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f78fb400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78fc06ac60 0x7f78fc19ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:43616/0 (socket says 172.21.15.28:43616) 2024-06-06T08:42:13.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f78fb400700 1 -- 172.21.15.28:0/2127371390 learned_addr learned my addr 172.21.15.28:0/2127371390 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f78faa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78fc06b610 0x7f78fc19b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47008/0 (socket says 172.21.15.28:47008) 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.644+0000 7f78fbe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78fc1077c0 0x7f78fc19f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:45226/0 (socket says 172.21.15.28:45226) 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.645+0000 7f78fb400700 1 -- 172.21.15.28:0/2127371390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78fc1077c0 msgr2=0x7f78fc19f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.645+0000 7f78fb400700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78fc1077c0 0x7f78fc19f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.645+0000 7f78fb400700 1 -- 172.21.15.28:0/2127371390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78fc06b610 msgr2=0x7f78fc19b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.645+0000 7f78fb400700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78fc06b610 0x7f78fc19b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.645+0000 7f78fb400700 1 -- 172.21.15.28:0/2127371390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78fc19fdf0 con 0x7f78fc06ac60 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.645+0000 7f78fb400700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78fc06ac60 0x7f78fc19ade0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f78ec005950 tx=0x7f78ec00fb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.645+0000 7f78f3e00700 1 -- 172.21.15.28:0/2127371390 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec005140 con 0x7f78fc06ac60 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.645+0000 7f78f3e00700 1 -- 172.21.15.28:0/2127371390 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78ec00b560 con 0x7f78fc06ac60 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.645+0000 7f78f3e00700 1 -- 172.21.15.28:0/2127371390 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec003ae0 con 0x7f78fc06ac60 2024-06-06T08:42:13.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.645+0000 7f7900a00700 1 -- 172.21.15.28:0/2127371390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78fc1a0080 con 0x7f78fc06ac60 2024-06-06T08:42:13.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.646+0000 7f7900a00700 1 -- 172.21.15.28:0/2127371390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78fc1a7960 con 0x7f78fc06ac60 2024-06-06T08:42:13.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.647+0000 7f7900a00700 1 -- 172.21.15.28:0/2127371390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78fc069180 con 0x7f78fc06ac60 2024-06-06T08:42:13.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.649+0000 7f78f3e00700 1 -- 172.21.15.28:0/2127371390 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f78ec00ba80 con 0x7f78fc06ac60 2024-06-06T08:42:13.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.651+0000 7f78f3e00700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f78e00a2ca0 0x7f78e00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:13.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.651+0000 7f78f3e00700 1 -- 172.21.15.28:0/2127371390 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f78ec0d0620 con 0x7f78fc06ac60 2024-06-06T08:42:13.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.651+0000 7f78faa00700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f78e00a2ca0 0x7f78e00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:13.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.652+0000 7f78faa00700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f78e00a2ca0 0x7f78e00a5160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f78fc108a10 tx=0x7f78e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:13.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.653+0000 7f78f3e00700 1 -- 172.21.15.28:0/2127371390 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f78ec031020 con 0x7f78fc06ac60 2024-06-06T08:42:13.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:13 smithi037 ceph-mon[36609]: pgmap v398: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-06-06T08:42:13.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:13 smithi059 ceph-mon[36684]: pgmap v398: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-06-06T08:42:13.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.214+0000 7f816f200700 1 -- 172.21.15.28:0/3749378737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8170109390 msgr2=0x7f8170115830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:13.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.214+0000 7f816f200700 1 --2- 172.21.15.28:0/3749378737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8170109390 0x7f8170115830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f816800b0a0 tx=0x7f816800b3b0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.214+0000 7f816f200700 1 -- 172.21.15.28:0/3749378737 shutdown_connections 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.214+0000 7f816f200700 1 --2- 172.21.15.28:0/3749378737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8170109390 0x7f8170115830 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.214+0000 7f816f200700 1 --2- 172.21.15.28:0/3749378737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f817010d8a0 0x7f817010dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.214+0000 7f816f200700 1 --2- 172.21.15.28:0/3749378737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81701089d0 0x7f8170108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.214+0000 7f816f200700 1 -- 172.21.15.28:0/3749378737 >> 172.21.15.28:0/3749378737 conn(0x7f8170078220 msgr2=0x7f81701072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.214+0000 7f816f200700 1 -- 172.21.15.28:0/3749378737 shutdown_connections 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.214+0000 7f816f200700 1 -- 172.21.15.28:0/3749378737 wait complete. 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.215+0000 7f816f200700 1 Processor -- start 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816f200700 1 -- start start 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816f200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81701089d0 0x7f817019f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816f200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8170109390 0x7f817019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816f200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f817010d8a0 0x7f81701a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816f200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8170118cd0 con 0x7f81701089d0 2024-06-06T08:42:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816f200700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8170118b50 con 0x7f8170109390 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816f200700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8170118e50 con 0x7f817010d8a0 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816de00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81701089d0 0x7f817019f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816e800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f817010d8a0 0x7f81701a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816de00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81701089d0 0x7f817019f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46982/0 (socket says 172.21.15.28:46982) 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816de00700 1 -- 172.21.15.28:0/3296017782 learned_addr learned my addr 172.21.15.28:0/3296017782 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.216+0000 7f816d400700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8170109390 0x7f817019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.217+0000 7f816e800700 1 -- 172.21.15.28:0/3296017782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8170109390 msgr2=0x7f817019f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.217+0000 7f816e800700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8170109390 0x7f817019f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.217+0000 7f816e800700 1 -- 172.21.15.28:0/3296017782 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81701089d0 msgr2=0x7f817019f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.217+0000 7f816e800700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81701089d0 0x7f817019f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.217+0000 7f816e800700 1 -- 172.21.15.28:0/3296017782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81701a40a0 con 0x7f817010d8a0 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.217+0000 7f816e800700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f817010d8a0 0x7f81701a3960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f816800b0a0 tx=0x7f8168004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.217+0000 7f8166a00700 1 -- 172.21.15.28:0/3296017782 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8168021070 con 0x7f817010d8a0 2024-06-06T08:42:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.217+0000 7f816f200700 1 -- 172.21.15.28:0/3296017782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81701a4330 con 0x7f817010d8a0 2024-06-06T08:42:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.218+0000 7f8166a00700 1 -- 172.21.15.28:0/3296017782 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8168007b80 con 0x7f817010d8a0 2024-06-06T08:42:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.218+0000 7f8166a00700 1 -- 172.21.15.28:0/3296017782 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8168005040 con 0x7f817010d8a0 2024-06-06T08:42:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.218+0000 7f816f200700 1 -- 172.21.15.28:0/3296017782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81701abc10 con 0x7f817010d8a0 2024-06-06T08:42:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.219+0000 7f816f200700 1 -- 172.21.15.28:0/3296017782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8170069180 con 0x7f817010d8a0 2024-06-06T08:42:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.221+0000 7f8166a00700 1 -- 172.21.15.28:0/3296017782 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8168024070 con 0x7f817010d8a0 2024-06-06T08:42:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.222+0000 7f8166a00700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f81540a2c20 0x7f81540a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.222+0000 7f8166a00700 1 -- 172.21.15.28:0/3296017782 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f81680cff80 con 0x7f817010d8a0 2024-06-06T08:42:13.879 INFO:teuthology.orchestra.run.smithi028.stdout:141733920852 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.222+0000 7f816de00700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f81540a2c20 0x7f81540a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.223+0000 7f816de00700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f81540a2c20 0x7f81540a50e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8160009ca0 tx=0x7f8160009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.227+0000 7f8166a00700 1 -- 172.21.15.28:0/3296017782 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8168007d30 con 0x7f817010d8a0 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.475+0000 7f816f200700 1 -- 172.21.15.28:0/3296017782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f817002dca0 con 0x7f817010d8a0 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.476+0000 7f8166a00700 1 -- 172.21.15.28:0/3296017782 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f816809ce90 con 0x7f817010d8a0 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 -- 172.21.15.28:0/3296017782 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f81540a2c20 msgr2=0x7f81540a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f81540a2c20 0x7f81540a50e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8160009ca0 tx=0x7f8160009260 comp rx=0 tx=0).stop 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 -- 172.21.15.28:0/3296017782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f817010d8a0 msgr2=0x7f81701a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f817010d8a0 0x7f81701a3960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f816800b0a0 tx=0x7f8168004d00 comp rx=0 tx=0).stop 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 -- 172.21.15.28:0/3296017782 shutdown_connections 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f81540a2c20 0x7f81540a50e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f817010d8a0 0x7f81701a3960 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81701089d0 0x7f817019f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 --2- 172.21.15.28:0/3296017782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8170109390 0x7f817019f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 -- 172.21.15.28:0/3296017782 >> 172.21.15.28:0/3296017782 conn(0x7f8170078220 msgr2=0x7f81700787e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:13.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 -- 172.21.15.28:0/3296017782 shutdown_connections 2024-06-06T08:42:13.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.479+0000 7f816f200700 1 -- 172.21.15.28:0/3296017782 wait complete. 2024-06-06T08:42:13.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.898+0000 7f7900a00700 1 -- 172.21.15.28:0/2127371390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f78fc1a7b30 con 0x7f78fc06ac60 2024-06-06T08:42:13.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.898+0000 7f78f3e00700 1 -- 172.21.15.28:0/2127371390 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f78ec013030 con 0x7f78fc06ac60 2024-06-06T08:42:13.897 INFO:teuthology.orchestra.run.smithi028.stdout:55834574949 2024-06-06T08:42:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.903+0000 7f7900a00700 1 -- 172.21.15.28:0/2127371390 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f78e00a2ca0 msgr2=0x7f78e00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.903+0000 7f7900a00700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f78e00a2ca0 0x7f78e00a5160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f78fc108a10 tx=0x7f78e8009260 comp rx=0 tx=0).stop 2024-06-06T08:42:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.903+0000 7f7900a00700 1 -- 172.21.15.28:0/2127371390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78fc06ac60 msgr2=0x7f78fc19ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.903+0000 7f7900a00700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78fc06ac60 0x7f78fc19ade0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f78ec005950 tx=0x7f78ec00fb20 comp rx=0 tx=0).stop 2024-06-06T08:42:13.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.904+0000 7f7900a00700 1 -- 172.21.15.28:0/2127371390 shutdown_connections 2024-06-06T08:42:13.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.904+0000 7f7900a00700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f78e00a2ca0 0x7f78e00a5160 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.904+0000 7f7900a00700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78fc1077c0 0x7f78fc19f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.904+0000 7f7900a00700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78fc06ac60 0x7f78fc19ade0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.904+0000 7f7900a00700 1 --2- 172.21.15.28:0/2127371390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78fc06b610 0x7f78fc19b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:13.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.904+0000 7f7900a00700 1 -- 172.21.15.28:0/2127371390 >> 172.21.15.28:0/2127371390 conn(0x7f78fc0781d0 msgr2=0x7f78fc10d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:13.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.904+0000 7f7900a00700 1 -- 172.21.15.28:0/2127371390 shutdown_connections 2024-06-06T08:42:13.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:13.904+0000 7f7900a00700 1 -- 172.21.15.28:0/2127371390 wait complete. 2024-06-06T08:42:14.515 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:14 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/3296017782' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-06T08:42:14.515 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:14 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2127371390' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-06T08:42:14.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.516+0000 7f0b33200700 1 -- 172.21.15.28:0/3991840314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b34101e80 msgr2=0x7f0b34105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:14.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.516+0000 7f0b33200700 1 --2- 172.21.15.28:0/3991840314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b34101e80 0x7f0b34105ed0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b200099c0 tx=0x7f0b20009cd0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.516+0000 7f0b33200700 1 -- 172.21.15.28:0/3991840314 shutdown_connections 2024-06-06T08:42:14.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.516+0000 7f0b33200700 1 --2- 172.21.15.28:0/3991840314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b341065b0 0x7f0b3410e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.516+0000 7f0b33200700 1 --2- 172.21.15.28:0/3991840314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b341014d0 0x7f0b341018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.516+0000 7f0b33200700 1 --2- 172.21.15.28:0/3991840314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b34101e80 0x7f0b34105ed0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.516+0000 7f0b33200700 1 -- 172.21.15.28:0/3991840314 >> 172.21.15.28:0/3991840314 conn(0x7f0b340fcd80 msgr2=0x7f0b340ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:14.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.516+0000 7f0b33200700 1 -- 172.21.15.28:0/3991840314 shutdown_connections 2024-06-06T08:42:14.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.517+0000 7f0b33200700 1 -- 172.21.15.28:0/3991840314 wait complete. 2024-06-06T08:42:14.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.518+0000 7f0b33200700 1 Processor -- start 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.518+0000 7f0b33200700 1 -- start start 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.518+0000 7f0b33200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b341014d0 0x7f0b3419ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.518+0000 7f0b33200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b34101e80 0x7f0b3419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.518+0000 7f0b33200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b341065b0 0x7f0b3419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.518+0000 7f0b33200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b341115c0 con 0x7f0b341014d0 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.518+0000 7f0b33200700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b34111440 con 0x7f0b341065b0 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.519+0000 7f0b33200700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0b34111740 con 0x7f0b34101e80 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.519+0000 7f0b31e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b341014d0 0x7f0b3419ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.519+0000 7f0b31e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b341014d0 0x7f0b3419ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47020/0 (socket says 172.21.15.28:47020) 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.519+0000 7f0b31e00700 1 -- 172.21.15.28:0/2361978538 learned_addr learned my addr 172.21.15.28:0/2361978538 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.519+0000 7f0b31400700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b34101e80 0x7f0b3419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:14.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.519+0000 7f0b32800700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b341065b0 0x7f0b3419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.519+0000 7f0b31e00700 1 -- 172.21.15.28:0/2361978538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b34101e80 msgr2=0x7f0b3419b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.519+0000 7f0b31e00700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b34101e80 0x7f0b3419b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.519+0000 7f0b31e00700 1 -- 172.21.15.28:0/2361978538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b341065b0 msgr2=0x7f0b3419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.519+0000 7f0b31e00700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b341065b0 0x7f0b3419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.519+0000 7f0b31e00700 1 -- 172.21.15.28:0/2361978538 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3419fd20 con 0x7f0b341014d0 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.520+0000 7f0b31e00700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b341014d0 0x7f0b3419ad10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400e9a0 tx=0x7f0b2400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.520+0000 7f0b2aa00700 1 -- 172.21.15.28:0/2361978538 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2400ca10 con 0x7f0b341014d0 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.520+0000 7f0b2aa00700 1 -- 172.21.15.28:0/2361978538 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b2400cbb0 con 0x7f0b341014d0 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.520+0000 7f0b33200700 1 -- 172.21.15.28:0/2361978538 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b341a0010 con 0x7f0b341014d0 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.520+0000 7f0b2aa00700 1 -- 172.21.15.28:0/2361978538 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24018680 con 0x7f0b341014d0 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.520+0000 7f0b33200700 1 -- 172.21.15.28:0/2361978538 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b341a7890 con 0x7f0b341014d0 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.521+0000 7f0b33200700 1 -- 172.21.15.28:0/2361978538 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b14005330 con 0x7f0b341014d0 2024-06-06T08:42:14.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.524+0000 7f0b2aa00700 1 -- 172.21.15.28:0/2361978538 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0b24018820 con 0x7f0b341014d0 2024-06-06T08:42:14.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.526+0000 7f0b2aa00700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b180a2c20 0x7f0b180a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:14.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.526+0000 7f0b2aa00700 1 -- 172.21.15.28:0/2361978538 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f0b240cf1c0 con 0x7f0b341014d0 2024-06-06T08:42:14.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.526+0000 7f0b31400700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b180a2c20 0x7f0b180a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:14.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.527+0000 7f0b31400700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b180a2c20 0x7f0b180a50e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b20000c00 tx=0x7f0b20005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:14.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.531+0000 7f0b2aa00700 1 -- 172.21.15.28:0/2361978538 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0b2409c0a0 con 0x7f0b341014d0 2024-06-06T08:42:14.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.759+0000 7f0b33200700 1 -- 172.21.15.28:0/2361978538 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f0b14005620 con 0x7f0b341014d0 2024-06-06T08:42:14.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.759+0000 7f0b2aa00700 1 -- 172.21.15.28:0/2361978538 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0b2409b9a0 con 0x7f0b341014d0 2024-06-06T08:42:14.758 INFO:teuthology.orchestra.run.smithi028.stdout:343597383723 2024-06-06T08:42:14.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.762+0000 7f0b33200700 1 -- 172.21.15.28:0/2361978538 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b180a2c20 msgr2=0x7f0b180a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:14.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.762+0000 7f0b33200700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b180a2c20 0x7f0b180a50e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b20000c00 tx=0x7f0b20005fb0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.762+0000 7f0b33200700 1 -- 172.21.15.28:0/2361978538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b341014d0 msgr2=0x7f0b3419ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:14.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.762+0000 7f0b33200700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b341014d0 0x7f0b3419ad10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400e9a0 tx=0x7f0b2400ecb0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.762+0000 7f0b33200700 1 -- 172.21.15.28:0/2361978538 shutdown_connections 2024-06-06T08:42:14.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.762+0000 7f0b33200700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0b180a2c20 0x7f0b180a50e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.762+0000 7f0b33200700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b341065b0 0x7f0b3419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.762+0000 7f0b33200700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b341014d0 0x7f0b3419ad10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.762+0000 7f0b33200700 1 --2- 172.21.15.28:0/2361978538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b34101e80 0x7f0b3419b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:14.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.762+0000 7f0b33200700 1 -- 172.21.15.28:0/2361978538 >> 172.21.15.28:0/2361978538 conn(0x7f0b340fcd80 msgr2=0x7f0b340fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:14.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.762+0000 7f0b33200700 1 -- 172.21.15.28:0/2361978538 shutdown_connections 2024-06-06T08:42:14.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:14.763+0000 7f0b33200700 1 -- 172.21.15.28:0/2361978538 wait complete. 2024-06-06T08:42:14.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:14 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/3296017782' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-06T08:42:14.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:14 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2127371390' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-06T08:42:14.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:14 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/3296017782' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-06T08:42:14.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:14 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2127371390' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-06T08:42:14.858 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920846 got 141733920852 for osd.4 2024-06-06T08:42:14.858 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:15.683 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:15 smithi028 ceph-mon[31564]: pgmap v399: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-06T08:42:15.683 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:15 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2361978538' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-06T08:42:15.751 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383717 got 343597383723 for osd.11 2024-06-06T08:42:15.751 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:15.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:15 smithi037 ceph-mon[36609]: pgmap v399: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-06T08:42:15.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:15 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2361978538' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-06T08:42:15.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:15 smithi059 ceph-mon[36684]: pgmap v399: 97 pgs: 97 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-06T08:42:15.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:15 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2361978538' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-06T08:42:16.103 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808881 got 287762808885 for osd.9 2024-06-06T08:42:16.103 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:16.603 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:42:16.638 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332155 got 219043332161 for osd.7 2024-06-06T08:42:16.638 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:17.227 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495681 got 197568495687 for osd.6 2024-06-06T08:42:17.227 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:17.414 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:17 smithi028 ceph-mon[31564]: pgmap v400: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-06T08:42:17.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:17 smithi037 ceph-mon[36609]: pgmap v400: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-06T08:42:17.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:17 smithi059 ceph-mon[36684]: pgmap v400: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-06T08:42:17.955 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574941 got 55834574949 for osd.1 2024-06-06T08:42:17.955 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:19.511 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:19 smithi028 ceph-mon[31564]: pgmap v401: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-06T08:42:19.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:19 smithi037 ceph-mon[36609]: pgmap v401: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-06T08:42:19.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:19 smithi059 ceph-mon[36684]: pgmap v401: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-06T08:42:20.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.124+0000 7fc3a2000700 1 -- 172.21.15.28:0/4239673797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39c074fe0 msgr2=0x7fc39c10e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:20.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.124+0000 7fc3a2000700 1 --2- 172.21.15.28:0/4239673797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39c074fe0 0x7fc39c10e950 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc3880098f0 tx=0x7fc388009c00 comp rx=0 tx=0).stop 2024-06-06T08:42:20.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.124+0000 7fc3a2000700 1 -- 172.21.15.28:0/4239673797 shutdown_connections 2024-06-06T08:42:20.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.124+0000 7fc3a2000700 1 --2- 172.21.15.28:0/4239673797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39c10ee90 0x7fc39c111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:20.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.124+0000 7fc3a2000700 1 --2- 172.21.15.28:0/4239673797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc39c0746c0 0x7fc39c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:20.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.124+0000 7fc3a2000700 1 --2- 172.21.15.28:0/4239673797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39c074fe0 0x7fc39c10e950 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:20.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.124+0000 7fc3a2000700 1 -- 172.21.15.28:0/4239673797 >> 172.21.15.28:0/4239673797 conn(0x7fc39c0795f0 msgr2=0x7fc39c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:20.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.124+0000 7fc3a2000700 1 -- 172.21.15.28:0/4239673797 shutdown_connections 2024-06-06T08:42:20.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.124+0000 7fc3a2000700 1 -- 172.21.15.28:0/4239673797 wait complete. 2024-06-06T08:42:20.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.126+0000 7fc3a2000700 1 Processor -- start 2024-06-06T08:42:20.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.126+0000 7fc3a2000700 1 -- start start 2024-06-06T08:42:20.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc3a2000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39c0746c0 0x7fc39c1025b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:20.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc3a2000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39c074fe0 0x7fc39c102af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:20.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc3a2000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc39c10ee90 0x7fc39c103030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:20.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc3a2000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1149f0 con 0x7fc39c10ee90 2024-06-06T08:42:20.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc3a2000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c114870 con 0x7fc39c0746c0 2024-06-06T08:42:20.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc3a2000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c114b70 con 0x7fc39c074fe0 2024-06-06T08:42:20.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc39b400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39c0746c0 0x7fc39c1025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:20.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc39aa00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39c074fe0 0x7fc39c102af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:20.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc39b400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39c0746c0 0x7fc39c1025b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:58644/0 (socket says 172.21.15.28:58644) 2024-06-06T08:42:20.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc39aa00700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39c074fe0 0x7fc39c102af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:42580/0 (socket says 172.21.15.28:42580) 2024-06-06T08:42:20.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc39b400700 1 -- 172.21.15.28:0/251704275 learned_addr learned my addr 172.21.15.28:0/251704275 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc39aa00700 1 -- 172.21.15.28:0/251704275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39c0746c0 msgr2=0x7fc39c1025b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc39aa00700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39c0746c0 0x7fc39c1025b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc39aa00700 1 -- 172.21.15.28:0/251704275 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc39c10ee90 msgr2=0x7fc39c103030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc39aa00700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc39c10ee90 0x7fc39c103030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.127+0000 7fc39aa00700 1 -- 172.21.15.28:0/251704275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39c1ab5f0 con 0x7fc39c074fe0 2024-06-06T08:42:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.128+0000 7fc39aa00700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39c074fe0 0x7fc39c102af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc388009230 tx=0x7fc38800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:20.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.128+0000 7fc393e00700 1 -- 172.21.15.28:0/251704275 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388025070 con 0x7fc39c074fe0 2024-06-06T08:42:20.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.128+0000 7fc3a2000700 1 -- 172.21.15.28:0/251704275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39c1ab880 con 0x7fc39c074fe0 2024-06-06T08:42:20.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.128+0000 7fc3a2000700 1 -- 172.21.15.28:0/251704275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc39c1abd30 con 0x7fc39c074fe0 2024-06-06T08:42:20.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.129+0000 7fc393e00700 1 -- 172.21.15.28:0/251704275 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc38800b560 con 0x7fc39c074fe0 2024-06-06T08:42:20.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.129+0000 7fc393e00700 1 -- 172.21.15.28:0/251704275 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388003a70 con 0x7fc39c074fe0 2024-06-06T08:42:20.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.130+0000 7fc3a2000700 1 -- 172.21.15.28:0/251704275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37c005330 con 0x7fc39c074fe0 2024-06-06T08:42:20.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.132+0000 7fc393e00700 1 -- 172.21.15.28:0/251704275 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc388028070 con 0x7fc39c074fe0 2024-06-06T08:42:20.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.135+0000 7fc393e00700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc3800a2cd0 0x7fc3800a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:20.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.135+0000 7fc393e00700 1 -- 172.21.15.28:0/251704275 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fc3880cf670 con 0x7fc39c074fe0 2024-06-06T08:42:20.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.135+0000 7fc39b400700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc3800a2cd0 0x7fc3800a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:20.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.136+0000 7fc39b400700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc3800a2cd0 0x7fc3800a5190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005d10 tx=0x7fc38c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:20.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.138+0000 7fc393e00700 1 -- 172.21.15.28:0/251704275 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc38805c850 con 0x7fc39c074fe0 2024-06-06T08:42:20.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.403+0000 7fc3a2000700 1 -- 172.21.15.28:0/251704275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc37c005620 con 0x7fc39c074fe0 2024-06-06T08:42:20.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.403+0000 7fc393e00700 1 -- 172.21.15.28:0/251704275 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc388013030 con 0x7fc39c074fe0 2024-06-06T08:42:20.403 INFO:teuthology.orchestra.run.smithi028.stdout:107374182490 2024-06-06T08:42:20.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 -- 172.21.15.28:0/251704275 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc3800a2cd0 msgr2=0x7fc3800a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:20.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc3800a2cd0 0x7fc3800a5190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005d10 tx=0x7fc38c009310 comp rx=0 tx=0).stop 2024-06-06T08:42:20.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 -- 172.21.15.28:0/251704275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39c074fe0 msgr2=0x7fc39c102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:20.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39c074fe0 0x7fc39c102af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc388009230 tx=0x7fc38800fa00 comp rx=0 tx=0).stop 2024-06-06T08:42:20.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 -- 172.21.15.28:0/251704275 shutdown_connections 2024-06-06T08:42:20.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fc3800a2cd0 0x7fc3800a5190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:20.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc39c10ee90 0x7fc39c103030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:20.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39c0746c0 0x7fc39c1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:20.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 --2- 172.21.15.28:0/251704275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc39c074fe0 0x7fc39c102af0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:20.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 -- 172.21.15.28:0/251704275 >> 172.21.15.28:0/251704275 conn(0x7fc39c0795f0 msgr2=0x7fc39c100980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:20.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 -- 172.21.15.28:0/251704275 shutdown_connections 2024-06-06T08:42:20.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:20.407+0000 7fc3a2000700 1 -- 172.21.15.28:0/251704275 wait complete. 2024-06-06T08:42:20.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:20 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/251704275' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-06T08:42:20.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:20 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/251704275' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-06T08:42:20.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:20 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/251704275' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-06T08:42:21.306 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182485 got 107374182490 for osd.3 2024-06-06T08:42:21.307 DEBUG:teuthology.parallel:result is None 2024-06-06T08:42:21.307 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-06T08:42:21.307 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T08:42:21.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:21 smithi028 ceph-mon[31564]: pgmap v402: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-06T08:42:21.762 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:42:21.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:21 smithi037 ceph-mon[36609]: pgmap v402: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-06T08:42:21.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:21 smithi059 ceph-mon[36684]: pgmap v402: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-06T08:42:22.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:22.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:22 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:22.970 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:22.970 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:22 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:23.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:23.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:22 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:23.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:23 smithi028 ceph-mon[31564]: pgmap v403: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-06T08:42:23.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:42:23.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:42:23.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:23.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:23 smithi059 ceph-mon[36684]: pgmap v403: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-06T08:42:23.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:42:23.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:42:23.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.038+0000 7f8f52400700 1 -- 172.21.15.28:0/2999973195 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f4c10a6b0 msgr2=0x7f8f4c10aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.038+0000 7f8f52400700 1 --2- 172.21.15.28:0/2999973195 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f4c10a6b0 0x7f8f4c10aa90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009990 tx=0x7f8f3c009ca0 comp rx=0 tx=0).stop 2024-06-06T08:42:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.039+0000 7f8f52400700 1 -- 172.21.15.28:0/2999973195 shutdown_connections 2024-06-06T08:42:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.039+0000 7f8f52400700 1 --2- 172.21.15.28:0/2999973195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4c105070 0x7f8f4c111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.039+0000 7f8f52400700 1 --2- 172.21.15.28:0/2999973195 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f4c10a6b0 0x7f8f4c10aa90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.039+0000 7f8f52400700 1 --2- 172.21.15.28:0/2999973195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f4c1046b0 0x7f8f4c104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.039+0000 7f8f52400700 1 -- 172.21.15.28:0/2999973195 >> 172.21.15.28:0/2999973195 conn(0x7f8f4c100160 msgr2=0x7f8f4c102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.039+0000 7f8f52400700 1 -- 172.21.15.28:0/2999973195 shutdown_connections 2024-06-06T08:42:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.039+0000 7f8f52400700 1 -- 172.21.15.28:0/2999973195 wait complete. 2024-06-06T08:42:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.040+0000 7f8f52400700 1 Processor -- start 2024-06-06T08:42:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.040+0000 7f8f52400700 1 -- start start 2024-06-06T08:42:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.040+0000 7f8f52400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f4c1046b0 0x7f8f4c19ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.040+0000 7f8f52400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4c105070 0x7f8f4c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.040+0000 7f8f52400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f4c10a6b0 0x7f8f4c19f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f52400700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c1149e0 con 0x7f8f4c10a6b0 2024-06-06T08:42:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f52400700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c114860 con 0x7f8f4c1046b0 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f52400700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c114b60 con 0x7f8f4c105070 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f4be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f4c10a6b0 0x7f8f4c19f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f4be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f4c10a6b0 0x7f8f4c19f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39492/0 (socket says 172.21.15.28:39492) 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f4be00700 1 -- 172.21.15.28:0/2733273594 learned_addr learned my addr 172.21.15.28:0/2733273594 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f4b400700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f4c1046b0 0x7f8f4c19ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f4aa00700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4c105070 0x7f8f4c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f4be00700 1 -- 172.21.15.28:0/2733273594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4c105070 msgr2=0x7f8f4c19b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f4be00700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4c105070 0x7f8f4c19b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f4be00700 1 -- 172.21.15.28:0/2733273594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f4c1046b0 msgr2=0x7f8f4c19ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f4be00700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f4c1046b0 0x7f8f4c19ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f4be00700 1 -- 172.21.15.28:0/2733273594 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4c19fe20 con 0x7f8f4c10a6b0 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.041+0000 7f8f4b400700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f4c1046b0 0x7f8f4c19ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.042+0000 7f8f4be00700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f4c10a6b0 0x7f8f4c19f6e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8f44007ee0 tx=0x7f8f4400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.042+0000 7f8f43e00700 1 -- 172.21.15.28:0/2733273594 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44004bb0 con 0x7f8f4c10a6b0 2024-06-06T08:42:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.042+0000 7f8f43e00700 1 -- 172.21.15.28:0/2733273594 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f44004d50 con 0x7f8f4c10a6b0 2024-06-06T08:42:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.042+0000 7f8f52400700 1 -- 172.21.15.28:0/2733273594 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4c1a0110 con 0x7f8f4c10a6b0 2024-06-06T08:42:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.042+0000 7f8f43e00700 1 -- 172.21.15.28:0/2733273594 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44005960 con 0x7f8f4c10a6b0 2024-06-06T08:42:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.042+0000 7f8f52400700 1 -- 172.21.15.28:0/2733273594 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4c1a7990 con 0x7f8f4c10a6b0 2024-06-06T08:42:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.043+0000 7f8f52400700 1 -- 172.21.15.28:0/2733273594 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f4c069180 con 0x7f8f4c10a6b0 2024-06-06T08:42:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.045+0000 7f8f43e00700 1 -- 172.21.15.28:0/2733273594 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8f4401a020 con 0x7f8f4c10a6b0 2024-06-06T08:42:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.047+0000 7f8f43e00700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8f300a2ca0 0x7f8f300a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.047+0000 7f8f43e00700 1 -- 172.21.15.28:0/2733273594 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f8f440cee40 con 0x7f8f4c10a6b0 2024-06-06T08:42:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.047+0000 7f8f4b400700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8f300a2ca0 0x7f8f300a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.048+0000 7f8f4b400700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8f300a2ca0 0x7f8f300a5160 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00b2e0 tx=0x7f8f3c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:24.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.050+0000 7f8f43e00700 1 -- 172.21.15.28:0/2733273594 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8f44010070 con 0x7f8f4c10a6b0 2024-06-06T08:42:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:23 smithi037 ceph-mon[36609]: pgmap v403: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-06T08:42:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:42:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:42:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:42:24.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.279+0000 7f8f52400700 1 -- 172.21.15.28:0/2733273594 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f4c0628d0 con 0x7f8f300a2ca0 2024-06-06T08:42:24.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.291+0000 7f8f43e00700 1 -- 172.21.15.28:0/2733273594 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259186 (secure 0 0 0) 0x7f8f3c067490 con 0x7f8f300a2ca0 2024-06-06T08:42:24.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:42:24.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.296+0000 7f8f52400700 1 -- 172.21.15.28:0/2733273594 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8f300a2ca0 msgr2=0x7f8f300a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:24.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.296+0000 7f8f52400700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8f300a2ca0 0x7f8f300a5160 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00b2e0 tx=0x7f8f3c005960 comp rx=0 tx=0).stop 2024-06-06T08:42:24.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.296+0000 7f8f52400700 1 -- 172.21.15.28:0/2733273594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f4c10a6b0 msgr2=0x7f8f4c19f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:24.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.296+0000 7f8f52400700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f4c10a6b0 0x7f8f4c19f6e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8f44007ee0 tx=0x7f8f4400d3b0 comp rx=0 tx=0).stop 2024-06-06T08:42:24.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.296+0000 7f8f52400700 1 -- 172.21.15.28:0/2733273594 shutdown_connections 2024-06-06T08:42:24.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.296+0000 7f8f52400700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f8f300a2ca0 0x7f8f300a5160 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:24.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.296+0000 7f8f52400700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f4c10a6b0 0x7f8f4c19f6e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:24.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.296+0000 7f8f52400700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f4c1046b0 0x7f8f4c19ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:24.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.296+0000 7f8f52400700 1 --2- 172.21.15.28:0/2733273594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f4c105070 0x7f8f4c19b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:24.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.296+0000 7f8f52400700 1 -- 172.21.15.28:0/2733273594 >> 172.21.15.28:0/2733273594 conn(0x7f8f4c100160 msgr2=0x7f8f4c100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:24.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.297+0000 7f8f52400700 1 -- 172.21.15.28:0/2733273594 shutdown_connections 2024-06-06T08:42:24.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:24.297+0000 7f8f52400700 1 -- 172.21.15.28:0/2733273594 wait complete. 2024-06-06T08:42:24.298 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-06-06T08:42:25.245 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":404,"stamp":"2024-06-06T08:42:24.277370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659044,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1230,"num_read_kb":772,"num_write":436,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1183702,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353264,"kb_used_data":12432,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588560,"statfs":{"total":1151940427776,"available":1151578685440,"internally_reserved":0,"allocated":12730368,"data_stored":7937364,"data_compressed":247569,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19140,"internal_metadata":348894524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":56,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005357"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.234928+0000","last_change":"2024-06-06T08:40:02.522544+0000","last_active":"2024-06-06T08:42:10.234928+0000","last_peered":"2024-06-06T08:42:10.234928+0000","last_clean":"2024-06-06T08:42:10.234928+0000","last_became_active":"2024-06-06T08:40:02.522223+0000","last_became_peered":"2024-06-06T08:40:02.522223+0000","last_unstale":"2024-06-06T08:42:10.234928+0000","last_undegraded":"2024-06-06T08:42:10.234928+0000","last_fullsized":"2024-06-06T08:42:10.234928+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:54:39.779392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.222883+0000","last_change":"2024-06-06T08:40:02.537841+0000","last_active":"2024-06-06T08:42:10.222883+0000","last_peered":"2024-06-06T08:42:10.222883+0000","last_clean":"2024-06-06T08:42:10.222883+0000","last_became_active":"2024-06-06T08:40:02.537418+0000","last_became_peered":"2024-06-06T08:40:02.537418+0000","last_unstale":"2024-06-06T08:42:10.222883+0000","last_undegraded":"2024-06-06T08:42:10.222883+0000","last_fullsized":"2024-06-06T08:42:10.222883+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:42:13.835530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235645+0000","last_change":"2024-06-06T08:40:02.532747+0000","last_active":"2024-06-06T08:42:10.235645+0000","last_peered":"2024-06-06T08:42:10.235645+0000","last_clean":"2024-06-06T08:42:10.235645+0000","last_became_active":"2024-06-06T08:40:02.528275+0000","last_became_peered":"2024-06-06T08:40:02.528275+0000","last_unstale":"2024-06-06T08:42:10.235645+0000","last_undegraded":"2024-06-06T08:42:10.235645+0000","last_fullsized":"2024-06-06T08:42:10.235645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:36:40.467396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.221947+0000","last_change":"2024-06-06T08:40:02.506597+0000","last_active":"2024-06-06T08:42:10.221947+0000","last_peered":"2024-06-06T08:42:10.221947+0000","last_clean":"2024-06-06T08:42:10.221947+0000","last_became_active":"2024-06-06T08:40:02.505934+0000","last_became_peered":"2024-06-06T08:40:02.505934+0000","last_unstale":"2024-06-06T08:42:10.221947+0000","last_undegraded":"2024-06-06T08:42:10.221947+0000","last_fullsized":"2024-06-06T08:42:10.221947+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:03:19.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.204831+0000","last_change":"2024-06-06T08:40:02.531151+0000","last_active":"2024-06-06T08:42:10.204831+0000","last_peered":"2024-06-06T08:42:10.204831+0000","last_clean":"2024-06-06T08:42:10.204831+0000","last_became_active":"2024-06-06T08:40:02.530742+0000","last_became_peered":"2024-06-06T08:40:02.530742+0000","last_unstale":"2024-06-06T08:42:10.204831+0000","last_undegraded":"2024-06-06T08:42:10.204831+0000","last_fullsized":"2024-06-06T08:42:10.204831+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:58:53.422609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229850+0000","last_change":"2024-06-06T08:40:02.514294+0000","last_active":"2024-06-06T08:42:10.229850+0000","last_peered":"2024-06-06T08:42:10.229850+0000","last_clean":"2024-06-06T08:42:10.229850+0000","last_became_active":"2024-06-06T08:40:02.513935+0000","last_became_peered":"2024-06-06T08:40:02.513935+0000","last_unstale":"2024-06-06T08:42:10.229850+0000","last_undegraded":"2024-06-06T08:42:10.229850+0000","last_fullsized":"2024-06-06T08:42:10.229850+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:51:07.863317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.226107+0000","last_change":"2024-06-06T08:40:02.508559+0000","last_active":"2024-06-06T08:42:10.226107+0000","last_peered":"2024-06-06T08:42:10.226107+0000","last_clean":"2024-06-06T08:42:10.226107+0000","last_became_active":"2024-06-06T08:40:02.508133+0000","last_became_peered":"2024-06-06T08:40:02.508133+0000","last_unstale":"2024-06-06T08:42:10.226107+0000","last_undegraded":"2024-06-06T08:42:10.226107+0000","last_fullsized":"2024-06-06T08:42:10.226107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:03:26.458397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.225926+0000","last_change":"2024-06-06T08:40:41.923413+0000","last_active":"2024-06-06T08:42:10.225926+0000","last_peered":"2024-06-06T08:42:10.225926+0000","last_clean":"2024-06-06T08:42:10.225926+0000","last_became_active":"2024-06-06T08:40:41.922347+0000","last_became_peered":"2024-06-06T08:40:41.922347+0000","last_unstale":"2024-06-06T08:42:10.225926+0000","last_undegraded":"2024-06-06T08:42:10.225926+0000","last_fullsized":"2024-06-06T08:42:10.225926+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:01:13.867302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235584+0000","last_change":"2024-06-06T08:40:02.508684+0000","last_active":"2024-06-06T08:42:10.235584+0000","last_peered":"2024-06-06T08:42:10.235584+0000","last_clean":"2024-06-06T08:42:10.235584+0000","last_became_active":"2024-06-06T08:40:02.507633+0000","last_became_peered":"2024-06-06T08:40:02.507633+0000","last_unstale":"2024-06-06T08:42:10.235584+0000","last_undegraded":"2024-06-06T08:42:10.235584+0000","last_fullsized":"2024-06-06T08:42:10.235584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:13:44.072978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.231916+0000","last_change":"2024-06-06T08:40:02.511816+0000","last_active":"2024-06-06T08:42:10.231916+0000","last_peered":"2024-06-06T08:42:10.231916+0000","last_clean":"2024-06-06T08:42:10.231916+0000","last_became_active":"2024-06-06T08:40:02.511445+0000","last_became_peered":"2024-06-06T08:40:02.511445+0000","last_unstale":"2024-06-06T08:42:10.231916+0000","last_undegraded":"2024-06-06T08:42:10.231916+0000","last_fullsized":"2024-06-06T08:42:10.231916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:40:29.517937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.238455+0000","last_change":"2024-06-06T08:40:02.502964+0000","last_active":"2024-06-06T08:42:10.238455+0000","last_peered":"2024-06-06T08:42:10.238455+0000","last_clean":"2024-06-06T08:42:10.238455+0000","last_became_active":"2024-06-06T08:40:02.502568+0000","last_became_peered":"2024-06-06T08:40:02.502568+0000","last_unstale":"2024-06-06T08:42:10.238455+0000","last_undegraded":"2024-06-06T08:42:10.238455+0000","last_fullsized":"2024-06-06T08:42:10.238455+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:53:46.243293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.230934+0000","last_change":"2024-06-06T08:40:02.508686+0000","last_active":"2024-06-06T08:42:10.230934+0000","last_peered":"2024-06-06T08:42:10.230934+0000","last_clean":"2024-06-06T08:42:10.230934+0000","last_became_active":"2024-06-06T08:40:02.508318+0000","last_became_peered":"2024-06-06T08:40:02.508318+0000","last_unstale":"2024-06-06T08:42:10.230934+0000","last_undegraded":"2024-06-06T08:42:10.230934+0000","last_fullsized":"2024-06-06T08:42:10.230934+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:05:55.260194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.239021+0000","last_change":"2024-06-06T08:40:02.517055+0000","last_active":"2024-06-06T08:42:10.239021+0000","last_peered":"2024-06-06T08:42:10.239021+0000","last_clean":"2024-06-06T08:42:10.239021+0000","last_became_active":"2024-06-06T08:40:02.515866+0000","last_became_peered":"2024-06-06T08:40:02.515866+0000","last_unstale":"2024-06-06T08:42:10.239021+0000","last_undegraded":"2024-06-06T08:42:10.239021+0000","last_fullsized":"2024-06-06T08:42:10.239021+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:09:50.597303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.236842+0000","last_change":"2024-06-06T08:40:02.523035+0000","last_active":"2024-06-06T08:42:10.236842+0000","last_peered":"2024-06-06T08:42:10.236842+0000","last_clean":"2024-06-06T08:42:10.236842+0000","last_became_active":"2024-06-06T08:40:02.522257+0000","last_became_peered":"2024-06-06T08:40:02.522257+0000","last_unstale":"2024-06-06T08:42:10.236842+0000","last_undegraded":"2024-06-06T08:42:10.236842+0000","last_fullsized":"2024-06-06T08:42:10.236842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:14:08.287703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.231899+0000","last_change":"2024-06-06T08:40:02.532053+0000","last_active":"2024-06-06T08:42:10.231899+0000","last_peered":"2024-06-06T08:42:10.231899+0000","last_clean":"2024-06-06T08:42:10.231899+0000","last_became_active":"2024-06-06T08:40:02.531575+0000","last_became_peered":"2024-06-06T08:40:02.531575+0000","last_unstale":"2024-06-06T08:42:10.231899+0000","last_undegraded":"2024-06-06T08:42:10.231899+0000","last_fullsized":"2024-06-06T08:42:10.231899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:58:13.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.239599+0000","last_change":"2024-06-06T08:40:02.518220+0000","last_active":"2024-06-06T08:42:10.239599+0000","last_peered":"2024-06-06T08:42:10.239599+0000","last_clean":"2024-06-06T08:42:10.239599+0000","last_became_active":"2024-06-06T08:40:02.517771+0000","last_became_peered":"2024-06-06T08:40:02.517771+0000","last_unstale":"2024-06-06T08:42:10.239599+0000","last_undegraded":"2024-06-06T08:42:10.239599+0000","last_fullsized":"2024-06-06T08:42:10.239599+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:22:13.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235452+0000","last_change":"2024-06-06T08:40:02.537122+0000","last_active":"2024-06-06T08:42:10.235452+0000","last_peered":"2024-06-06T08:42:10.235452+0000","last_clean":"2024-06-06T08:42:10.235452+0000","last_became_active":"2024-06-06T08:40:02.536752+0000","last_became_peered":"2024-06-06T08:40:02.536752+0000","last_unstale":"2024-06-06T08:42:10.235452+0000","last_undegraded":"2024-06-06T08:42:10.235452+0000","last_fullsized":"2024-06-06T08:42:10.235452+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:03:09.537236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.238673+0000","last_change":"2024-06-06T08:40:02.515397+0000","last_active":"2024-06-06T08:42:10.238673+0000","last_peered":"2024-06-06T08:42:10.238673+0000","last_clean":"2024-06-06T08:42:10.238673+0000","last_became_active":"2024-06-06T08:40:02.514968+0000","last_became_peered":"2024-06-06T08:40:02.514968+0000","last_unstale":"2024-06-06T08:42:10.238673+0000","last_undegraded":"2024-06-06T08:42:10.238673+0000","last_fullsized":"2024-06-06T08:42:10.238673+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:41:42.724392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229708+0000","last_change":"2024-06-06T08:40:02.526875+0000","last_active":"2024-06-06T08:42:10.229708+0000","last_peered":"2024-06-06T08:42:10.229708+0000","last_clean":"2024-06-06T08:42:10.229708+0000","last_became_active":"2024-06-06T08:40:02.526583+0000","last_became_peered":"2024-06-06T08:40:02.526583+0000","last_unstale":"2024-06-06T08:42:10.229708+0000","last_undegraded":"2024-06-06T08:42:10.229708+0000","last_fullsized":"2024-06-06T08:42:10.229708+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:27:05.391768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":182,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:21.928717+0000","last_change":"2024-06-06T08:41:41.859497+0000","last_active":"2024-06-06T08:42:21.928717+0000","last_peered":"2024-06-06T08:42:21.928717+0000","last_clean":"2024-06-06T08:42:21.928717+0000","last_became_active":"2024-06-06T08:41:41.844210+0000","last_became_peered":"2024-06-06T08:41:41.844210+0000","last_unstale":"2024-06-06T08:42:21.928717+0000","last_undegraded":"2024-06-06T08:42:21.928717+0000","last_fullsized":"2024-06-06T08:42:21.928717+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:01:04.144517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.231790+0000","last_change":"2024-06-06T08:40:02.527761+0000","last_active":"2024-06-06T08:42:10.231790+0000","last_peered":"2024-06-06T08:42:10.231790+0000","last_clean":"2024-06-06T08:42:10.231790+0000","last_became_active":"2024-06-06T08:40:02.527346+0000","last_became_peered":"2024-06-06T08:40:02.527346+0000","last_unstale":"2024-06-06T08:42:10.231790+0000","last_undegraded":"2024-06-06T08:42:10.231790+0000","last_fullsized":"2024-06-06T08:42:10.231790+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:25:28.443496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838659+0000","last_change":"2024-06-06T08:39:57.664207+0000","last_active":"2024-06-06T08:41:41.838659+0000","last_peered":"2024-06-06T08:41:41.838659+0000","last_clean":"2024-06-06T08:41:41.838659+0000","last_became_active":"2024-06-06T08:39:57.663809+0000","last_became_peered":"2024-06-06T08:39:57.663809+0000","last_unstale":"2024-06-06T08:41:41.838659+0000","last_undegraded":"2024-06-06T08:41:41.838659+0000","last_fullsized":"2024-06-06T08:41:41.838659+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:49.140662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235723+0000","last_change":"2024-06-06T08:40:41.923126+0000","last_active":"2024-06-06T08:42:10.235723+0000","last_peered":"2024-06-06T08:42:10.235723+0000","last_clean":"2024-06-06T08:42:10.235723+0000","last_became_active":"2024-06-06T08:40:41.921580+0000","last_became_peered":"2024-06-06T08:40:41.921580+0000","last_unstale":"2024-06-06T08:42:10.235723+0000","last_undegraded":"2024-06-06T08:42:10.235723+0000","last_fullsized":"2024-06-06T08:42:10.235723+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:03:32.027832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,9],"acting":[0,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838488+0000","last_change":"2024-06-06T08:39:57.451584+0000","last_active":"2024-06-06T08:41:41.838488+0000","last_peered":"2024-06-06T08:41:41.838488+0000","last_clean":"2024-06-06T08:41:41.838488+0000","last_became_active":"2024-06-06T08:39:57.451213+0000","last_became_peered":"2024-06-06T08:39:57.451213+0000","last_unstale":"2024-06-06T08:41:41.838488+0000","last_undegraded":"2024-06-06T08:41:41.838488+0000","last_fullsized":"2024-06-06T08:41:41.838488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:49:14.346303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.241382+0000","last_change":"2024-06-06T08:40:02.516354+0000","last_active":"2024-06-06T08:42:10.241382+0000","last_peered":"2024-06-06T08:42:10.241382+0000","last_clean":"2024-06-06T08:42:10.241382+0000","last_became_active":"2024-06-06T08:40:02.516008+0000","last_became_peered":"2024-06-06T08:40:02.516008+0000","last_unstale":"2024-06-06T08:42:10.241382+0000","last_undegraded":"2024-06-06T08:42:10.241382+0000","last_fullsized":"2024-06-06T08:42:10.241382+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:21:51.826299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838349+0000","last_change":"2024-06-06T08:39:57.448570+0000","last_active":"2024-06-06T08:41:41.838349+0000","last_peered":"2024-06-06T08:41:41.838349+0000","last_clean":"2024-06-06T08:41:41.838349+0000","last_became_active":"2024-06-06T08:39:57.448183+0000","last_became_peered":"2024-06-06T08:39:57.448183+0000","last_unstale":"2024-06-06T08:41:41.838349+0000","last_undegraded":"2024-06-06T08:41:41.838349+0000","last_fullsized":"2024-06-06T08:41:41.838349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:13:17.209091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235376+0000","last_change":"2024-06-06T08:40:02.505583+0000","last_active":"2024-06-06T08:42:10.235376+0000","last_peered":"2024-06-06T08:42:10.235376+0000","last_clean":"2024-06-06T08:42:10.235376+0000","last_became_active":"2024-06-06T08:40:02.505187+0000","last_became_peered":"2024-06-06T08:40:02.505187+0000","last_unstale":"2024-06-06T08:42:10.235376+0000","last_undegraded":"2024-06-06T08:42:10.235376+0000","last_fullsized":"2024-06-06T08:42:10.235376+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:48:35.082993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'7","reported_seq":169,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:20.027505+0000","last_change":"2024-06-06T08:41:41.974591+0000","last_active":"2024-06-06T08:42:20.027505+0000","last_peered":"2024-06-06T08:42:20.027505+0000","last_clean":"2024-06-06T08:42:20.027505+0000","last_became_active":"2024-06-06T08:41:41.970790+0000","last_became_peered":"2024-06-06T08:41:41.970790+0000","last_unstale":"2024-06-06T08:42:20.027505+0000","last_undegraded":"2024-06-06T08:42:20.027505+0000","last_fullsized":"2024-06-06T08:42:20.027505+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:26:00.567897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.207894+0000","last_change":"2024-06-06T08:40:02.508540+0000","last_active":"2024-06-06T08:42:10.207894+0000","last_peered":"2024-06-06T08:42:10.207894+0000","last_clean":"2024-06-06T08:42:10.207894+0000","last_became_active":"2024-06-06T08:40:02.508162+0000","last_became_peered":"2024-06-06T08:40:02.508162+0000","last_unstale":"2024-06-06T08:42:10.207894+0000","last_undegraded":"2024-06-06T08:42:10.207894+0000","last_fullsized":"2024-06-06T08:42:10.207894+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:21:53.273212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:42.227187+0000","last_change":"2024-06-06T08:39:57.461796+0000","last_active":"2024-06-06T08:41:42.227187+0000","last_peered":"2024-06-06T08:41:42.227187+0000","last_clean":"2024-06-06T08:41:42.227187+0000","last_became_active":"2024-06-06T08:39:57.461334+0000","last_became_peered":"2024-06-06T08:39:57.461334+0000","last_unstale":"2024-06-06T08:41:42.227187+0000","last_undegraded":"2024-06-06T08:41:42.227187+0000","last_fullsized":"2024-06-06T08:41:42.227187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:46:41.904550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229136+0000","last_change":"2024-06-06T08:40:41.922968+0000","last_active":"2024-06-06T08:42:10.229136+0000","last_peered":"2024-06-06T08:42:10.229136+0000","last_clean":"2024-06-06T08:42:10.229136+0000","last_became_active":"2024-06-06T08:40:41.922079+0000","last_became_peered":"2024-06-06T08:40:41.922079+0000","last_unstale":"2024-06-06T08:42:10.229136+0000","last_undegraded":"2024-06-06T08:42:10.229136+0000","last_fullsized":"2024-06-06T08:42:10.229136+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:34:22.185719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:42.227417+0000","last_change":"2024-06-06T08:39:57.464355+0000","last_active":"2024-06-06T08:41:42.227417+0000","last_peered":"2024-06-06T08:41:42.227417+0000","last_clean":"2024-06-06T08:41:42.227417+0000","last_became_active":"2024-06-06T08:39:57.463639+0000","last_became_peered":"2024-06-06T08:39:57.463639+0000","last_unstale":"2024-06-06T08:41:42.227417+0000","last_undegraded":"2024-06-06T08:41:42.227417+0000","last_fullsized":"2024-06-06T08:41:42.227417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:55:23.456001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.230593+0000","last_change":"2024-06-06T08:40:02.524130+0000","last_active":"2024-06-06T08:42:10.230593+0000","last_peered":"2024-06-06T08:42:10.230593+0000","last_clean":"2024-06-06T08:42:10.230593+0000","last_became_active":"2024-06-06T08:40:02.523788+0000","last_became_peered":"2024-06-06T08:40:02.523788+0000","last_unstale":"2024-06-06T08:42:10.230593+0000","last_undegraded":"2024-06-06T08:42:10.230593+0000","last_fullsized":"2024-06-06T08:42:10.230593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:39:11.300028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.842185+0000","last_change":"2024-06-06T08:39:57.447392+0000","last_active":"2024-06-06T08:41:41.842185+0000","last_peered":"2024-06-06T08:41:41.842185+0000","last_clean":"2024-06-06T08:41:41.842185+0000","last_became_active":"2024-06-06T08:39:57.446995+0000","last_became_peered":"2024-06-06T08:39:57.446995+0000","last_unstale":"2024-06-06T08:41:41.842185+0000","last_undegraded":"2024-06-06T08:41:41.842185+0000","last_fullsized":"2024-06-06T08:41:41.842185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:18:50.166795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.224485+0000","last_change":"2024-06-06T08:40:02.530192+0000","last_active":"2024-06-06T08:42:10.224485+0000","last_peered":"2024-06-06T08:42:10.224485+0000","last_clean":"2024-06-06T08:42:10.224485+0000","last_became_active":"2024-06-06T08:40:02.529801+0000","last_became_peered":"2024-06-06T08:40:02.529801+0000","last_unstale":"2024-06-06T08:42:10.224485+0000","last_undegraded":"2024-06-06T08:42:10.224485+0000","last_fullsized":"2024-06-06T08:42:10.224485+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:25:31.767403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'5","reported_seq":265,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:19.925178+0000","last_change":"2024-06-06T08:39:57.451666+0000","last_active":"2024-06-06T08:42:19.925178+0000","last_peered":"2024-06-06T08:42:19.925178+0000","last_clean":"2024-06-06T08:42:19.925178+0000","last_became_active":"2024-06-06T08:39:57.451242+0000","last_became_peered":"2024-06-06T08:39:57.451242+0000","last_unstale":"2024-06-06T08:42:19.925178+0000","last_undegraded":"2024-06-06T08:42:19.925178+0000","last_fullsized":"2024-06-06T08:42:19.925178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:42:02.614485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":230,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.237176+0000","last_change":"2024-06-06T08:40:02.521368+0000","last_active":"2024-06-06T08:42:10.237176+0000","last_peered":"2024-06-06T08:42:10.237176+0000","last_clean":"2024-06-06T08:42:10.237176+0000","last_became_active":"2024-06-06T08:40:02.520948+0000","last_became_peered":"2024-06-06T08:40:02.520948+0000","last_unstale":"2024-06-06T08:42:10.237176+0000","last_undegraded":"2024-06-06T08:42:10.237176+0000","last_fullsized":"2024-06-06T08:42:10.237176+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:09:29.844472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.843510+0000","last_change":"2024-06-06T08:39:57.448966+0000","last_active":"2024-06-06T08:41:41.843510+0000","last_peered":"2024-06-06T08:41:41.843510+0000","last_clean":"2024-06-06T08:41:41.843510+0000","last_became_active":"2024-06-06T08:39:57.448449+0000","last_became_peered":"2024-06-06T08:39:57.448449+0000","last_unstale":"2024-06-06T08:41:41.843510+0000","last_undegraded":"2024-06-06T08:41:41.843510+0000","last_fullsized":"2024-06-06T08:41:41.843510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:48:38.313936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.236163+0000","last_change":"2024-06-06T08:40:02.531021+0000","last_active":"2024-06-06T08:42:10.236163+0000","last_peered":"2024-06-06T08:42:10.236163+0000","last_clean":"2024-06-06T08:42:10.236163+0000","last_became_active":"2024-06-06T08:40:02.530677+0000","last_became_peered":"2024-06-06T08:40:02.530677+0000","last_unstale":"2024-06-06T08:42:10.236163+0000","last_undegraded":"2024-06-06T08:42:10.236163+0000","last_fullsized":"2024-06-06T08:42:10.236163+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:58:42.237943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.843028+0000","last_change":"2024-06-06T08:39:57.663293+0000","last_active":"2024-06-06T08:41:41.843028+0000","last_peered":"2024-06-06T08:41:41.843028+0000","last_clean":"2024-06-06T08:41:41.843028+0000","last_became_active":"2024-06-06T08:39:57.662865+0000","last_became_peered":"2024-06-06T08:39:57.662865+0000","last_unstale":"2024-06-06T08:41:41.843028+0000","last_undegraded":"2024-06-06T08:41:41.843028+0000","last_fullsized":"2024-06-06T08:41:41.843028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:50:57.783422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.241588+0000","last_change":"2024-06-06T08:40:02.505731+0000","last_active":"2024-06-06T08:42:10.241588+0000","last_peered":"2024-06-06T08:42:10.241588+0000","last_clean":"2024-06-06T08:42:10.241588+0000","last_became_active":"2024-06-06T08:40:02.504801+0000","last_became_peered":"2024-06-06T08:40:02.504801+0000","last_unstale":"2024-06-06T08:42:10.241588+0000","last_undegraded":"2024-06-06T08:42:10.241588+0000","last_fullsized":"2024-06-06T08:42:10.241588+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:19:02.928913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'35","reported_seq":306,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:20.027630+0000","last_change":"2024-06-06T08:39:57.447508+0000","last_active":"2024-06-06T08:42:20.027630+0000","last_peered":"2024-06-06T08:42:20.027630+0000","last_clean":"2024-06-06T08:42:20.027630+0000","last_became_active":"2024-06-06T08:39:57.447118+0000","last_became_peered":"2024-06-06T08:39:57.447118+0000","last_unstale":"2024-06-06T08:42:20.027630+0000","last_undegraded":"2024-06-06T08:42:20.027630+0000","last_fullsized":"2024-06-06T08:42:20.027630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:32:37.805274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61489,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":240,"num_read_kb":179,"num_write":37,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.227789+0000","last_change":"2024-06-06T08:40:02.508523+0000","last_active":"2024-06-06T08:42:10.227789+0000","last_peered":"2024-06-06T08:42:10.227789+0000","last_clean":"2024-06-06T08:42:10.227789+0000","last_became_active":"2024-06-06T08:40:02.507699+0000","last_became_peered":"2024-06-06T08:40:02.507699+0000","last_unstale":"2024-06-06T08:42:10.227789+0000","last_undegraded":"2024-06-06T08:42:10.227789+0000","last_fullsized":"2024-06-06T08:42:10.227789+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:55:39.091047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.844475+0000","last_change":"2024-06-06T08:39:57.446777+0000","last_active":"2024-06-06T08:41:41.844475+0000","last_peered":"2024-06-06T08:41:41.844475+0000","last_clean":"2024-06-06T08:41:41.844475+0000","last_became_active":"2024-06-06T08:39:57.446401+0000","last_became_peered":"2024-06-06T08:39:57.446401+0000","last_unstale":"2024-06-06T08:41:41.844475+0000","last_undegraded":"2024-06-06T08:41:41.844475+0000","last_fullsized":"2024-06-06T08:41:41.844475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:23:10.166458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235059+0000","last_change":"2024-06-06T08:40:02.534562+0000","last_active":"2024-06-06T08:42:10.235059+0000","last_peered":"2024-06-06T08:42:10.235059+0000","last_clean":"2024-06-06T08:42:10.235059+0000","last_became_active":"2024-06-06T08:40:02.534204+0000","last_became_peered":"2024-06-06T08:40:02.534204+0000","last_unstale":"2024-06-06T08:42:10.235059+0000","last_undegraded":"2024-06-06T08:42:10.235059+0000","last_fullsized":"2024-06-06T08:42:10.235059+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:46:53.695281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.843143+0000","last_change":"2024-06-06T08:39:57.451764+0000","last_active":"2024-06-06T08:41:41.843143+0000","last_peered":"2024-06-06T08:41:41.843143+0000","last_clean":"2024-06-06T08:41:41.843143+0000","last_became_active":"2024-06-06T08:39:57.451394+0000","last_became_peered":"2024-06-06T08:39:57.451394+0000","last_unstale":"2024-06-06T08:41:41.843143+0000","last_undegraded":"2024-06-06T08:41:41.843143+0000","last_fullsized":"2024-06-06T08:41:41.843143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:43.575913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.239556+0000","last_change":"2024-06-06T08:40:02.515017+0000","last_active":"2024-06-06T08:42:10.239556+0000","last_peered":"2024-06-06T08:42:10.239556+0000","last_clean":"2024-06-06T08:42:10.239556+0000","last_became_active":"2024-06-06T08:40:02.513242+0000","last_became_peered":"2024-06-06T08:40:02.513242+0000","last_unstale":"2024-06-06T08:42:10.239556+0000","last_undegraded":"2024-06-06T08:42:10.239556+0000","last_fullsized":"2024-06-06T08:42:10.239556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:15:13.581022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":153,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:19.918082+0000","last_change":"2024-06-06T08:39:57.451337+0000","last_active":"2024-06-06T08:42:19.918082+0000","last_peered":"2024-06-06T08:42:19.918082+0000","last_clean":"2024-06-06T08:42:19.918082+0000","last_became_active":"2024-06-06T08:39:57.450924+0000","last_became_peered":"2024-06-06T08:39:57.450924+0000","last_unstale":"2024-06-06T08:42:19.918082+0000","last_undegraded":"2024-06-06T08:42:19.918082+0000","last_fullsized":"2024-06-06T08:42:19.918082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:18:09.022874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.230367+0000","last_change":"2024-06-06T08:40:02.498665+0000","last_active":"2024-06-06T08:42:10.230367+0000","last_peered":"2024-06-06T08:42:10.230367+0000","last_clean":"2024-06-06T08:42:10.230367+0000","last_became_active":"2024-06-06T08:40:02.498261+0000","last_became_peered":"2024-06-06T08:40:02.498261+0000","last_unstale":"2024-06-06T08:42:10.230367+0000","last_undegraded":"2024-06-06T08:42:10.230367+0000","last_fullsized":"2024-06-06T08:42:10.230367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:29:03.217175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.837903+0000","last_change":"2024-06-06T08:39:57.663480+0000","last_active":"2024-06-06T08:41:41.837903+0000","last_peered":"2024-06-06T08:41:41.837903+0000","last_clean":"2024-06-06T08:41:41.837903+0000","last_became_active":"2024-06-06T08:39:57.663087+0000","last_became_peered":"2024-06-06T08:39:57.663087+0000","last_unstale":"2024-06-06T08:41:41.837903+0000","last_undegraded":"2024-06-06T08:41:41.837903+0000","last_fullsized":"2024-06-06T08:41:41.837903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:56:33.556397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.234911+0000","last_change":"2024-06-06T08:40:02.503083+0000","last_active":"2024-06-06T08:42:10.234911+0000","last_peered":"2024-06-06T08:42:10.234911+0000","last_clean":"2024-06-06T08:42:10.234911+0000","last_became_active":"2024-06-06T08:40:02.502713+0000","last_became_peered":"2024-06-06T08:40:02.502713+0000","last_unstale":"2024-06-06T08:42:10.234911+0000","last_undegraded":"2024-06-06T08:42:10.234911+0000","last_fullsized":"2024-06-06T08:42:10.234911+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:08:47.340528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838623+0000","last_change":"2024-06-06T08:39:57.448410+0000","last_active":"2024-06-06T08:41:41.838623+0000","last_peered":"2024-06-06T08:41:41.838623+0000","last_clean":"2024-06-06T08:41:41.838623+0000","last_became_active":"2024-06-06T08:39:57.447956+0000","last_became_peered":"2024-06-06T08:39:57.447956+0000","last_unstale":"2024-06-06T08:41:41.838623+0000","last_undegraded":"2024-06-06T08:41:41.838623+0000","last_fullsized":"2024-06-06T08:41:41.838623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:02:15.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.222563+0000","last_change":"2024-06-06T08:40:41.923452+0000","last_active":"2024-06-06T08:42:10.222563+0000","last_peered":"2024-06-06T08:42:10.222563+0000","last_clean":"2024-06-06T08:42:10.222563+0000","last_became_active":"2024-06-06T08:40:41.922936+0000","last_became_peered":"2024-06-06T08:40:41.922936+0000","last_unstale":"2024-06-06T08:42:10.222563+0000","last_undegraded":"2024-06-06T08:42:10.222563+0000","last_fullsized":"2024-06-06T08:42:10.222563+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:25:38.840662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.841237+0000","last_change":"2024-06-06T08:39:57.666054+0000","last_active":"2024-06-06T08:41:41.841237+0000","last_peered":"2024-06-06T08:41:41.841237+0000","last_clean":"2024-06-06T08:41:41.841237+0000","last_became_active":"2024-06-06T08:39:57.665084+0000","last_became_peered":"2024-06-06T08:39:57.665084+0000","last_unstale":"2024-06-06T08:41:41.841237+0000","last_undegraded":"2024-06-06T08:41:41.841237+0000","last_fullsized":"2024-06-06T08:41:41.841237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:18:51.576755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.234791+0000","last_change":"2024-06-06T08:40:02.529152+0000","last_active":"2024-06-06T08:42:10.234791+0000","last_peered":"2024-06-06T08:42:10.234791+0000","last_clean":"2024-06-06T08:42:10.234791+0000","last_became_active":"2024-06-06T08:40:02.528881+0000","last_became_peered":"2024-06-06T08:40:02.528881+0000","last_unstale":"2024-06-06T08:42:10.234791+0000","last_undegraded":"2024-06-06T08:42:10.234791+0000","last_fullsized":"2024-06-06T08:42:10.234791+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:18:17.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:21.929612+0000","last_change":"2024-06-06T08:39:57.461109+0000","last_active":"2024-06-06T08:42:21.929612+0000","last_peered":"2024-06-06T08:42:21.929612+0000","last_clean":"2024-06-06T08:42:21.929612+0000","last_became_active":"2024-06-06T08:39:57.460701+0000","last_became_peered":"2024-06-06T08:39:57.460701+0000","last_unstale":"2024-06-06T08:42:21.929612+0000","last_undegraded":"2024-06-06T08:42:21.929612+0000","last_fullsized":"2024-06-06T08:42:21.929612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:40:39.834903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229403+0000","last_change":"2024-06-06T08:40:02.525590+0000","last_active":"2024-06-06T08:42:10.229403+0000","last_peered":"2024-06-06T08:42:10.229403+0000","last_clean":"2024-06-06T08:42:10.229403+0000","last_became_active":"2024-06-06T08:40:02.525242+0000","last_became_peered":"2024-06-06T08:40:02.525242+0000","last_unstale":"2024-06-06T08:42:10.229403+0000","last_undegraded":"2024-06-06T08:42:10.229403+0000","last_fullsized":"2024-06-06T08:42:10.229403+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:46:42.121170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.223520+0000","last_change":"2024-06-06T08:40:41.921045+0000","last_active":"2024-06-06T08:42:10.223520+0000","last_peered":"2024-06-06T08:42:10.223520+0000","last_clean":"2024-06-06T08:42:10.223520+0000","last_became_active":"2024-06-06T08:40:41.920644+0000","last_became_peered":"2024-06-06T08:40:41.920644+0000","last_unstale":"2024-06-06T08:42:10.223520+0000","last_undegraded":"2024-06-06T08:42:10.223520+0000","last_fullsized":"2024-06-06T08:42:10.223520+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:01:26.880961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":152,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:18.914765+0000","last_change":"2024-06-06T08:39:57.658255+0000","last_active":"2024-06-06T08:42:18.914765+0000","last_peered":"2024-06-06T08:42:18.914765+0000","last_clean":"2024-06-06T08:42:18.914765+0000","last_became_active":"2024-06-06T08:39:57.657820+0000","last_became_peered":"2024-06-06T08:39:57.657820+0000","last_unstale":"2024-06-06T08:42:18.914765+0000","last_undegraded":"2024-06-06T08:42:18.914765+0000","last_fullsized":"2024-06-06T08:42:18.914765+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:16:16.475843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.240321+0000","last_change":"2024-06-06T08:40:41.927007+0000","last_active":"2024-06-06T08:42:10.240321+0000","last_peered":"2024-06-06T08:42:10.240321+0000","last_clean":"2024-06-06T08:42:10.240321+0000","last_became_active":"2024-06-06T08:40:41.925980+0000","last_became_peered":"2024-06-06T08:40:41.925980+0000","last_unstale":"2024-06-06T08:42:10.240321+0000","last_undegraded":"2024-06-06T08:42:10.240321+0000","last_fullsized":"2024-06-06T08:42:10.240321+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:12:56.234260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,1],"acting":[3,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.970048+0000","last_change":"2024-06-06T08:39:57.453405+0000","last_active":"2024-06-06T08:41:41.970048+0000","last_peered":"2024-06-06T08:41:41.970048+0000","last_clean":"2024-06-06T08:41:41.970048+0000","last_became_active":"2024-06-06T08:39:57.453009+0000","last_became_peered":"2024-06-06T08:39:57.453009+0000","last_unstale":"2024-06-06T08:41:41.970048+0000","last_undegraded":"2024-06-06T08:41:41.970048+0000","last_fullsized":"2024-06-06T08:41:41.970048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:07:53.568537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":354,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.842949+0000","last_change":"2024-06-06T08:38:24.084478+0000","last_active":"2024-06-06T08:41:41.842949+0000","last_peered":"2024-06-06T08:41:41.842949+0000","last_clean":"2024-06-06T08:41:41.842949+0000","last_became_active":"2024-06-06T08:38:24.083876+0000","last_became_peered":"2024-06-06T08:38:24.083876+0000","last_unstale":"2024-06-06T08:41:41.842949+0000","last_undegraded":"2024-06-06T08:41:41.842949+0000","last_fullsized":"2024-06-06T08:41:41.842949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:34:26.807146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:34:26.807146+0000","last_clean_scrub_stamp":"2024-06-06T08:34:26.807146+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:35:23.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229314+0000","last_change":"2024-06-06T08:40:02.514489+0000","last_active":"2024-06-06T08:42:10.229314+0000","last_peered":"2024-06-06T08:42:10.229314+0000","last_clean":"2024-06-06T08:42:10.229314+0000","last_became_active":"2024-06-06T08:40:02.514072+0000","last_became_peered":"2024-06-06T08:40:02.514072+0000","last_unstale":"2024-06-06T08:42:10.229314+0000","last_undegraded":"2024-06-06T08:42:10.229314+0000","last_fullsized":"2024-06-06T08:42:10.229314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:56:05.779543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.843210+0000","last_change":"2024-06-06T08:39:57.450613+0000","last_active":"2024-06-06T08:41:41.843210+0000","last_peered":"2024-06-06T08:41:41.843210+0000","last_clean":"2024-06-06T08:41:41.843210+0000","last_became_active":"2024-06-06T08:39:57.449109+0000","last_became_peered":"2024-06-06T08:39:57.449109+0000","last_unstale":"2024-06-06T08:41:41.843210+0000","last_undegraded":"2024-06-06T08:41:41.843210+0000","last_fullsized":"2024-06-06T08:41:41.843210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:15:10.622436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.856429+0000","last_change":"2024-06-06T08:41:41.855981+0000","last_active":"2024-06-06T08:41:41.856429+0000","last_peered":"2024-06-06T08:41:41.856429+0000","last_clean":"2024-06-06T08:41:41.856429+0000","last_became_active":"2024-06-06T08:41:41.844307+0000","last_became_peered":"2024-06-06T08:41:41.844307+0000","last_unstale":"2024-06-06T08:41:41.856429+0000","last_undegraded":"2024-06-06T08:41:41.856429+0000","last_fullsized":"2024-06-06T08:41:41.856429+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:55:47.584643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.230160+0000","last_change":"2024-06-06T08:40:02.522412+0000","last_active":"2024-06-06T08:42:10.230160+0000","last_peered":"2024-06-06T08:42:10.230160+0000","last_clean":"2024-06-06T08:42:10.230160+0000","last_became_active":"2024-06-06T08:40:02.521880+0000","last_became_peered":"2024-06-06T08:40:02.521880+0000","last_unstale":"2024-06-06T08:42:10.230160+0000","last_undegraded":"2024-06-06T08:42:10.230160+0000","last_fullsized":"2024-06-06T08:42:10.230160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:31:46.611810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'17","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:08.672769+0000","last_change":"2024-06-06T08:39:57.459036+0000","last_active":"2024-06-06T08:42:08.672769+0000","last_peered":"2024-06-06T08:42:08.672769+0000","last_clean":"2024-06-06T08:42:08.672769+0000","last_became_active":"2024-06-06T08:39:57.458500+0000","last_became_peered":"2024-06-06T08:39:57.458500+0000","last_unstale":"2024-06-06T08:42:08.672769+0000","last_undegraded":"2024-06-06T08:42:08.672769+0000","last_fullsized":"2024-06-06T08:42:08.672769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:25:35.968887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.232782+0000","last_change":"2024-06-06T08:40:02.534130+0000","last_active":"2024-06-06T08:42:10.232782+0000","last_peered":"2024-06-06T08:42:10.232782+0000","last_clean":"2024-06-06T08:42:10.232782+0000","last_became_active":"2024-06-06T08:40:02.527085+0000","last_became_peered":"2024-06-06T08:40:02.527085+0000","last_unstale":"2024-06-06T08:42:10.232782+0000","last_undegraded":"2024-06-06T08:42:10.232782+0000","last_fullsized":"2024-06-06T08:42:10.232782+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:06:07.606127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.969955+0000","last_change":"2024-06-06T08:39:57.507621+0000","last_active":"2024-06-06T08:41:41.969955+0000","last_peered":"2024-06-06T08:41:41.969955+0000","last_clean":"2024-06-06T08:41:41.969955+0000","last_became_active":"2024-06-06T08:39:57.507268+0000","last_became_peered":"2024-06-06T08:39:57.507268+0000","last_unstale":"2024-06-06T08:41:41.969955+0000","last_undegraded":"2024-06-06T08:41:41.969955+0000","last_fullsized":"2024-06-06T08:41:41.969955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:15:58.191318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235783+0000","last_change":"2024-06-06T08:40:41.923084+0000","last_active":"2024-06-06T08:42:10.235783+0000","last_peered":"2024-06-06T08:42:10.235783+0000","last_clean":"2024-06-06T08:42:10.235783+0000","last_became_active":"2024-06-06T08:40:41.922562+0000","last_became_peered":"2024-06-06T08:40:41.922562+0000","last_unstale":"2024-06-06T08:42:10.235783+0000","last_undegraded":"2024-06-06T08:42:10.235783+0000","last_fullsized":"2024-06-06T08:42:10.235783+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:12:45.467112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.841857+0000","last_change":"2024-06-06T08:39:57.663754+0000","last_active":"2024-06-06T08:41:41.841857+0000","last_peered":"2024-06-06T08:41:41.841857+0000","last_clean":"2024-06-06T08:41:41.841857+0000","last_became_active":"2024-06-06T08:39:57.663356+0000","last_became_peered":"2024-06-06T08:39:57.663356+0000","last_unstale":"2024-06-06T08:41:41.841857+0000","last_undegraded":"2024-06-06T08:41:41.841857+0000","last_fullsized":"2024-06-06T08:41:41.841857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:35:33.372951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.209244+0000","last_change":"2024-06-06T08:40:02.508300+0000","last_active":"2024-06-06T08:42:10.209244+0000","last_peered":"2024-06-06T08:42:10.209244+0000","last_clean":"2024-06-06T08:42:10.209244+0000","last_became_active":"2024-06-06T08:40:02.507880+0000","last_became_peered":"2024-06-06T08:40:02.507880+0000","last_unstale":"2024-06-06T08:42:10.209244+0000","last_undegraded":"2024-06-06T08:42:10.209244+0000","last_fullsized":"2024-06-06T08:42:10.209244+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:08:32.068060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838051+0000","last_change":"2024-06-06T08:39:57.456657+0000","last_active":"2024-06-06T08:41:41.838051+0000","last_peered":"2024-06-06T08:41:41.838051+0000","last_clean":"2024-06-06T08:41:41.838051+0000","last_became_active":"2024-06-06T08:39:57.455401+0000","last_became_peered":"2024-06-06T08:39:57.455401+0000","last_unstale":"2024-06-06T08:41:41.838051+0000","last_undegraded":"2024-06-06T08:41:41.838051+0000","last_fullsized":"2024-06-06T08:41:41.838051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:21:04.840297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.232406+0000","last_change":"2024-06-06T08:40:02.520755+0000","last_active":"2024-06-06T08:42:10.232406+0000","last_peered":"2024-06-06T08:42:10.232406+0000","last_clean":"2024-06-06T08:42:10.232406+0000","last_became_active":"2024-06-06T08:40:02.520349+0000","last_became_peered":"2024-06-06T08:40:02.520349+0000","last_unstale":"2024-06-06T08:42:10.232406+0000","last_undegraded":"2024-06-06T08:42:10.232406+0000","last_fullsized":"2024-06-06T08:42:10.232406+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:19:09.549764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.844234+0000","last_change":"2024-06-06T08:39:57.448342+0000","last_active":"2024-06-06T08:41:41.844234+0000","last_peered":"2024-06-06T08:41:41.844234+0000","last_clean":"2024-06-06T08:41:41.844234+0000","last_became_active":"2024-06-06T08:39:57.447966+0000","last_became_peered":"2024-06-06T08:39:57.447966+0000","last_unstale":"2024-06-06T08:41:41.844234+0000","last_undegraded":"2024-06-06T08:41:41.844234+0000","last_fullsized":"2024-06-06T08:41:41.844234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:49:47.211202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.236266+0000","last_change":"2024-06-06T08:40:02.527976+0000","last_active":"2024-06-06T08:42:10.236266+0000","last_peered":"2024-06-06T08:42:10.236266+0000","last_clean":"2024-06-06T08:42:10.236266+0000","last_became_active":"2024-06-06T08:40:02.526288+0000","last_became_peered":"2024-06-06T08:40:02.526288+0000","last_unstale":"2024-06-06T08:42:10.236266+0000","last_undegraded":"2024-06-06T08:42:10.236266+0000","last_fullsized":"2024-06-06T08:42:10.236266+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:21:34.363207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838164+0000","last_change":"2024-06-06T08:39:57.450301+0000","last_active":"2024-06-06T08:41:41.838164+0000","last_peered":"2024-06-06T08:41:41.838164+0000","last_clean":"2024-06-06T08:41:41.838164+0000","last_became_active":"2024-06-06T08:39:57.449867+0000","last_became_peered":"2024-06-06T08:39:57.449867+0000","last_unstale":"2024-06-06T08:41:41.838164+0000","last_undegraded":"2024-06-06T08:41:41.838164+0000","last_fullsized":"2024-06-06T08:41:41.838164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:00:53.571075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.240728+0000","last_change":"2024-06-06T08:40:02.513543+0000","last_active":"2024-06-06T08:42:10.240728+0000","last_peered":"2024-06-06T08:42:10.240728+0000","last_clean":"2024-06-06T08:42:10.240728+0000","last_became_active":"2024-06-06T08:40:02.513175+0000","last_became_peered":"2024-06-06T08:40:02.513175+0000","last_unstale":"2024-06-06T08:42:10.240728+0000","last_undegraded":"2024-06-06T08:42:10.240728+0000","last_fullsized":"2024-06-06T08:42:10.240728+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:31:31.032249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":59,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:19.925747+0000","last_change":"2024-06-06T08:41:41.849343+0000","last_active":"2024-06-06T08:42:19.925747+0000","last_peered":"2024-06-06T08:42:19.925747+0000","last_clean":"2024-06-06T08:42:19.925747+0000","last_became_active":"2024-06-06T08:41:41.844231+0000","last_became_peered":"2024-06-06T08:41:41.844231+0000","last_unstale":"2024-06-06T08:42:19.925747+0000","last_undegraded":"2024-06-06T08:42:19.925747+0000","last_fullsized":"2024-06-06T08:42:19.925747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:29:35.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.240045+0000","last_change":"2024-06-06T08:40:02.507607+0000","last_active":"2024-06-06T08:42:10.240045+0000","last_peered":"2024-06-06T08:42:10.240045+0000","last_clean":"2024-06-06T08:42:10.240045+0000","last_became_active":"2024-06-06T08:40:02.507225+0000","last_became_peered":"2024-06-06T08:40:02.507225+0000","last_unstale":"2024-06-06T08:42:10.240045+0000","last_undegraded":"2024-06-06T08:42:10.240045+0000","last_fullsized":"2024-06-06T08:42:10.240045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:18:14.161368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.842767+0000","last_change":"2024-06-06T08:39:57.455145+0000","last_active":"2024-06-06T08:41:41.842767+0000","last_peered":"2024-06-06T08:41:41.842767+0000","last_clean":"2024-06-06T08:41:41.842767+0000","last_became_active":"2024-06-06T08:39:57.454802+0000","last_became_peered":"2024-06-06T08:39:57.454802+0000","last_unstale":"2024-06-06T08:41:41.842767+0000","last_undegraded":"2024-06-06T08:41:41.842767+0000","last_fullsized":"2024-06-06T08:41:41.842767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:13:37.287584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.232307+0000","last_change":"2024-06-06T08:40:02.531229+0000","last_active":"2024-06-06T08:42:10.232307+0000","last_peered":"2024-06-06T08:42:10.232307+0000","last_clean":"2024-06-06T08:42:10.232307+0000","last_became_active":"2024-06-06T08:40:02.530944+0000","last_became_peered":"2024-06-06T08:40:02.530944+0000","last_unstale":"2024-06-06T08:42:10.232307+0000","last_undegraded":"2024-06-06T08:42:10.232307+0000","last_fullsized":"2024-06-06T08:42:10.232307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:38:42.733919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:42.227503+0000","last_change":"2024-06-06T08:39:57.463387+0000","last_active":"2024-06-06T08:41:42.227503+0000","last_peered":"2024-06-06T08:41:42.227503+0000","last_clean":"2024-06-06T08:41:42.227503+0000","last_became_active":"2024-06-06T08:39:57.462946+0000","last_became_peered":"2024-06-06T08:39:57.462946+0000","last_unstale":"2024-06-06T08:41:42.227503+0000","last_undegraded":"2024-06-06T08:41:42.227503+0000","last_fullsized":"2024-06-06T08:41:42.227503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:42:28.270765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.233480+0000","last_change":"2024-06-06T08:40:02.508752+0000","last_active":"2024-06-06T08:42:10.233480+0000","last_peered":"2024-06-06T08:42:10.233480+0000","last_clean":"2024-06-06T08:42:10.233480+0000","last_became_active":"2024-06-06T08:40:02.508395+0000","last_became_peered":"2024-06-06T08:40:02.508395+0000","last_unstale":"2024-06-06T08:42:10.233480+0000","last_undegraded":"2024-06-06T08:42:10.233480+0000","last_fullsized":"2024-06-06T08:42:10.233480+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:49:11.516680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.224370+0000","last_change":"2024-06-06T08:40:41.920976+0000","last_active":"2024-06-06T08:42:10.224370+0000","last_peered":"2024-06-06T08:42:10.224370+0000","last_clean":"2024-06-06T08:42:10.224370+0000","last_became_active":"2024-06-06T08:40:41.920483+0000","last_became_peered":"2024-06-06T08:40:41.920483+0000","last_unstale":"2024-06-06T08:42:10.224370+0000","last_undegraded":"2024-06-06T08:42:10.224370+0000","last_fullsized":"2024-06-06T08:42:10.224370+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:12:02.631659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.212782+0000","last_change":"2024-06-06T08:40:02.509533+0000","last_active":"2024-06-06T08:42:10.212782+0000","last_peered":"2024-06-06T08:42:10.212782+0000","last_clean":"2024-06-06T08:42:10.212782+0000","last_became_active":"2024-06-06T08:40:02.508698+0000","last_became_peered":"2024-06-06T08:40:02.508698+0000","last_unstale":"2024-06-06T08:42:10.212782+0000","last_undegraded":"2024-06-06T08:42:10.212782+0000","last_fullsized":"2024-06-06T08:42:10.212782+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:18:05.840254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229046+0000","last_change":"2024-06-06T08:40:02.532089+0000","last_active":"2024-06-06T08:42:10.229046+0000","last_peered":"2024-06-06T08:42:10.229046+0000","last_clean":"2024-06-06T08:42:10.229046+0000","last_became_active":"2024-06-06T08:40:02.531841+0000","last_became_peered":"2024-06-06T08:40:02.531841+0000","last_unstale":"2024-06-06T08:42:10.229046+0000","last_undegraded":"2024-06-06T08:42:10.229046+0000","last_fullsized":"2024-06-06T08:42:10.229046+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:52:04.975610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.239479+0000","last_change":"2024-06-06T08:40:02.534539+0000","last_active":"2024-06-06T08:42:10.239479+0000","last_peered":"2024-06-06T08:42:10.239479+0000","last_clean":"2024-06-06T08:42:10.239479+0000","last_became_active":"2024-06-06T08:40:02.533756+0000","last_became_peered":"2024-06-06T08:40:02.533756+0000","last_unstale":"2024-06-06T08:42:10.239479+0000","last_undegraded":"2024-06-06T08:42:10.239479+0000","last_fullsized":"2024-06-06T08:42:10.239479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:30:19.277210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.237380+0000","last_change":"2024-06-06T08:40:02.540186+0000","last_active":"2024-06-06T08:42:10.237380+0000","last_peered":"2024-06-06T08:42:10.237380+0000","last_clean":"2024-06-06T08:42:10.237380+0000","last_became_active":"2024-06-06T08:40:02.539768+0000","last_became_peered":"2024-06-06T08:40:02.539768+0000","last_unstale":"2024-06-06T08:42:10.237380+0000","last_undegraded":"2024-06-06T08:42:10.237380+0000","last_fullsized":"2024-06-06T08:42:10.237380+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:44:41.203835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.223120+0000","last_change":"2024-06-06T08:40:02.508392+0000","last_active":"2024-06-06T08:42:10.223120+0000","last_peered":"2024-06-06T08:42:10.223120+0000","last_clean":"2024-06-06T08:42:10.223120+0000","last_became_active":"2024-06-06T08:40:02.508054+0000","last_became_peered":"2024-06-06T08:40:02.508054+0000","last_unstale":"2024-06-06T08:42:10.223120+0000","last_undegraded":"2024-06-06T08:42:10.223120+0000","last_fullsized":"2024-06-06T08:42:10.223120+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:59:16.879294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.238462+0000","last_change":"2024-06-06T08:40:02.508451+0000","last_active":"2024-06-06T08:42:10.238462+0000","last_peered":"2024-06-06T08:42:10.238462+0000","last_clean":"2024-06-06T08:42:10.238462+0000","last_became_active":"2024-06-06T08:40:02.505407+0000","last_became_peered":"2024-06-06T08:40:02.505407+0000","last_unstale":"2024-06-06T08:42:10.238462+0000","last_undegraded":"2024-06-06T08:42:10.238462+0000","last_fullsized":"2024-06-06T08:42:10.238462+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:55:23.080525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.231389+0000","last_change":"2024-06-06T08:40:02.534845+0000","last_active":"2024-06-06T08:42:10.231389+0000","last_peered":"2024-06-06T08:42:10.231389+0000","last_clean":"2024-06-06T08:42:10.231389+0000","last_became_active":"2024-06-06T08:40:02.534463+0000","last_became_peered":"2024-06-06T08:40:02.534463+0000","last_unstale":"2024-06-06T08:42:10.231389+0000","last_undegraded":"2024-06-06T08:42:10.231389+0000","last_fullsized":"2024-06-06T08:42:10.231389+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:25:17.693197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.234104+0000","last_change":"2024-06-06T08:40:41.843054+0000","last_active":"2024-06-06T08:42:10.234104+0000","last_peered":"2024-06-06T08:42:10.234104+0000","last_clean":"2024-06-06T08:42:10.234104+0000","last_became_active":"2024-06-06T08:40:41.842726+0000","last_became_peered":"2024-06-06T08:40:41.842726+0000","last_unstale":"2024-06-06T08:42:10.234104+0000","last_undegraded":"2024-06-06T08:42:10.234104+0000","last_fullsized":"2024-06-06T08:42:10.234104+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:10:46.018896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.231952+0000","last_change":"2024-06-06T08:40:02.529939+0000","last_active":"2024-06-06T08:42:10.231952+0000","last_peered":"2024-06-06T08:42:10.231952+0000","last_clean":"2024-06-06T08:42:10.231952+0000","last_became_active":"2024-06-06T08:40:02.529500+0000","last_became_peered":"2024-06-06T08:40:02.529500+0000","last_unstale":"2024-06-06T08:42:10.231952+0000","last_undegraded":"2024-06-06T08:42:10.231952+0000","last_fullsized":"2024-06-06T08:42:10.231952+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:03:35.832111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.240131+0000","last_change":"2024-06-06T08:40:02.536434+0000","last_active":"2024-06-06T08:42:10.240131+0000","last_peered":"2024-06-06T08:42:10.240131+0000","last_clean":"2024-06-06T08:42:10.240131+0000","last_became_active":"2024-06-06T08:40:02.536077+0000","last_became_peered":"2024-06-06T08:40:02.536077+0000","last_unstale":"2024-06-06T08:42:10.240131+0000","last_undegraded":"2024-06-06T08:42:10.240131+0000","last_fullsized":"2024-06-06T08:42:10.240131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:04:45.438724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.240014+0000","last_change":"2024-06-06T08:40:02.540402+0000","last_active":"2024-06-06T08:42:10.240014+0000","last_peered":"2024-06-06T08:42:10.240014+0000","last_clean":"2024-06-06T08:42:10.240014+0000","last_became_active":"2024-06-06T08:40:02.539884+0000","last_became_peered":"2024-06-06T08:40:02.539884+0000","last_unstale":"2024-06-06T08:42:10.240014+0000","last_undegraded":"2024-06-06T08:42:10.240014+0000","last_fullsized":"2024-06-06T08:42:10.240014+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:07:58.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.225172+0000","last_change":"2024-06-06T08:40:02.511737+0000","last_active":"2024-06-06T08:42:10.225172+0000","last_peered":"2024-06-06T08:42:10.225172+0000","last_clean":"2024-06-06T08:42:10.225172+0000","last_became_active":"2024-06-06T08:40:02.511373+0000","last_became_peered":"2024-06-06T08:40:02.511373+0000","last_unstale":"2024-06-06T08:42:10.225172+0000","last_undegraded":"2024-06-06T08:42:10.225172+0000","last_fullsized":"2024-06-06T08:42:10.225172+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:00:25.251603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284445,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68442,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1104,"num_read_kb":663,"num_write":253,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2966,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":205326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383725,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":498662,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645362,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1167360,"data_stored":1150396,"data_compressed":47759,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808889,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":497808,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070527,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1024000,"data_stored":498074,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332164,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":1090172,"data_compressed":47759,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495690,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1019904,"data_stored":497525,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":561097,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":498864,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1085440,"data_stored":558355,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182492,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":497350,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":498539,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757330,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":1090522,"data_compressed":47759,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":64411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":61669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T08:42:25.249 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T08:42:25.783 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:42:25.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:25 smithi028 ceph-mon[31564]: pgmap v404: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-06T08:42:25.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:25 smithi028 ceph-mon[31564]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:42:25.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:25 smithi059 ceph-mon[36684]: pgmap v404: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-06T08:42:25.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:25 smithi059 ceph-mon[36684]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:42:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:25 smithi037 ceph-mon[36609]: pgmap v404: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-06T08:42:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:25 smithi037 ceph-mon[36609]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:42:27.696 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:27 smithi028 ceph-mon[31564]: pgmap v405: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-06-06T08:42:27.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:27 smithi059 ceph-mon[36684]: pgmap v405: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-06-06T08:42:27.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.959+0000 7ff951e00700 1 -- 172.21.15.28:0/3650205977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94c101d00 msgr2=0x7ff94c1061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:27.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.959+0000 7ff951e00700 1 --2- 172.21.15.28:0/3650205977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94c101d00 0x7ff94c1061d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff938009990 tx=0x7ff938009ca0 comp rx=0 tx=0).stop 2024-06-06T08:42:27.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.959+0000 7ff951e00700 1 -- 172.21.15.28:0/3650205977 shutdown_connections 2024-06-06T08:42:27.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.959+0000 7ff951e00700 1 --2- 172.21.15.28:0/3650205977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c1067f0 0x7ff94c106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:27.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.959+0000 7ff951e00700 1 --2- 172.21.15.28:0/3650205977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff94c1013e0 0x7ff94c1017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:27.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.959+0000 7ff951e00700 1 --2- 172.21.15.28:0/3650205977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94c101d00 0x7ff94c1061d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:27.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.959+0000 7ff951e00700 1 -- 172.21.15.28:0/3650205977 >> 172.21.15.28:0/3650205977 conn(0x7ff94c0fce40 msgr2=0x7ff94c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:27.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.959+0000 7ff951e00700 1 -- 172.21.15.28:0/3650205977 shutdown_connections 2024-06-06T08:42:27.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.959+0000 7ff951e00700 1 -- 172.21.15.28:0/3650205977 wait complete. 2024-06-06T08:42:27.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.961+0000 7ff951e00700 1 Processor -- start 2024-06-06T08:42:27.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.961+0000 7ff951e00700 1 -- start start 2024-06-06T08:42:27.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.962+0000 7ff951e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff94c1013e0 0x7ff94c19f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:27.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.962+0000 7ff951e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94c101d00 0x7ff94c19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:27.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.962+0000 7ff951e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c1067f0 0x7ff94c1a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:27.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.962+0000 7ff951e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c118da0 con 0x7ff94c1067f0 2024-06-06T08:42:27.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.962+0000 7ff951e00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c118c20 con 0x7ff94c1013e0 2024-06-06T08:42:27.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.962+0000 7ff951e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c118f20 con 0x7ff94c101d00 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.962+0000 7ff94be00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94c101d00 0x7ff94c19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.962+0000 7ff94be00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94c101d00 0x7ff94c19f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:42714/0 (socket says 172.21.15.28:42714) 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.962+0000 7ff950a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff94c1013e0 0x7ff94c19f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.962+0000 7ff94be00700 1 -- 172.21.15.28:0/2758396520 learned_addr learned my addr 172.21.15.28:0/2758396520 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.962+0000 7ff951400700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c1067f0 0x7ff94c1a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.963+0000 7ff94be00700 1 -- 172.21.15.28:0/2758396520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff94c1013e0 msgr2=0x7ff94c19f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.963+0000 7ff94be00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff94c1013e0 0x7ff94c19f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.963+0000 7ff94be00700 1 -- 172.21.15.28:0/2758396520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c1067f0 msgr2=0x7ff94c1a3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.963+0000 7ff94be00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c1067f0 0x7ff94c1a3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.963+0000 7ff94be00700 1 -- 172.21.15.28:0/2758396520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c1a4230 con 0x7ff94c101d00 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.963+0000 7ff950a00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff94c1013e0 0x7ff94c19f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.963+0000 7ff94be00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94c101d00 0x7ff94c19f7b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff938000c00 tx=0x7ff938005810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.963+0000 7ff949600700 1 -- 172.21.15.28:0/2758396520 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938027070 con 0x7ff94c101d00 2024-06-06T08:42:27.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.963+0000 7ff951e00700 1 -- 172.21.15.28:0/2758396520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94c1a44c0 con 0x7ff94c101d00 2024-06-06T08:42:27.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.963+0000 7ff949600700 1 -- 172.21.15.28:0/2758396520 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff938003b60 con 0x7ff94c101d00 2024-06-06T08:42:27.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.963+0000 7ff949600700 1 -- 172.21.15.28:0/2758396520 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938022d40 con 0x7ff94c101d00 2024-06-06T08:42:27.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.964+0000 7ff951e00700 1 -- 172.21.15.28:0/2758396520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94c1abda0 con 0x7ff94c101d00 2024-06-06T08:42:27.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.965+0000 7ff951e00700 1 -- 172.21.15.28:0/2758396520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94c069180 con 0x7ff94c101d00 2024-06-06T08:42:27.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.967+0000 7ff949600700 1 -- 172.21.15.28:0/2758396520 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff93802a070 con 0x7ff94c101d00 2024-06-06T08:42:27.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.969+0000 7ff949600700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff9340a2c20 0x7ff9340a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:27.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.969+0000 7ff949600700 1 -- 172.21.15.28:0/2758396520 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7ff9380d0620 con 0x7ff94c101d00 2024-06-06T08:42:27.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.969+0000 7ff950a00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff9340a2c20 0x7ff9340a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:27.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.969+0000 7ff950a00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff9340a2c20 0x7ff9340a50e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff940011490 tx=0x7ff940009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:27.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:27.970+0000 7ff949600700 1 -- 172.21.15.28:0/2758396520 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff938031020 con 0x7ff94c101d00 2024-06-06T08:42:28.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:27 smithi037 ceph-mon[36609]: pgmap v405: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-06-06T08:42:28.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.198+0000 7ff951e00700 1 -- 172.21.15.28:0/2758396520 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff94c1058c0 con 0x7ff9340a2c20 2024-06-06T08:42:28.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.209+0000 7ff949600700 1 -- 172.21.15.28:0/2758396520 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259186 (secure 0 0 0) 0x7ff94c1058c0 con 0x7ff9340a2c20 2024-06-06T08:42:28.212 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:42:28.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.214+0000 7ff951e00700 1 -- 172.21.15.28:0/2758396520 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff9340a2c20 msgr2=0x7ff9340a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.214+0000 7ff951e00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff9340a2c20 0x7ff9340a50e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff940011490 tx=0x7ff940009260 comp rx=0 tx=0).stop 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.214+0000 7ff951e00700 1 -- 172.21.15.28:0/2758396520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94c101d00 msgr2=0x7ff94c19f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.214+0000 7ff951e00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94c101d00 0x7ff94c19f7b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff938000c00 tx=0x7ff938005810 comp rx=0 tx=0).stop 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.214+0000 7ff951e00700 1 -- 172.21.15.28:0/2758396520 shutdown_connections 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.214+0000 7ff951e00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff9340a2c20 0x7ff9340a50e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.214+0000 7ff951e00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c1067f0 0x7ff94c1a3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.214+0000 7ff951e00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff94c1013e0 0x7ff94c19f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.214+0000 7ff951e00700 1 --2- 172.21.15.28:0/2758396520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff94c101d00 0x7ff94c19f7b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.214+0000 7ff951e00700 1 -- 172.21.15.28:0/2758396520 >> 172.21.15.28:0/2758396520 conn(0x7ff94c0fce40 msgr2=0x7ff94c1041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.214+0000 7ff951e00700 1 -- 172.21.15.28:0/2758396520 shutdown_connections 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:28.215+0000 7ff951e00700 1 -- 172.21.15.28:0/2758396520 wait complete. 2024-06-06T08:42:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-06-06T08:42:29.112 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":405,"stamp":"2024-06-06T08:42:26.278261+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659044,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1260,"num_read_kb":792,"num_write":436,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1183702,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353264,"kb_used_data":12432,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588560,"statfs":{"total":1151940427776,"available":1151578685440,"internally_reserved":0,"allocated":12730368,"data_stored":7937364,"data_compressed":247569,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19140,"internal_metadata":348894524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":71,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005255"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.234928+0000","last_change":"2024-06-06T08:40:02.522544+0000","last_active":"2024-06-06T08:42:10.234928+0000","last_peered":"2024-06-06T08:42:10.234928+0000","last_clean":"2024-06-06T08:42:10.234928+0000","last_became_active":"2024-06-06T08:40:02.522223+0000","last_became_peered":"2024-06-06T08:40:02.522223+0000","last_unstale":"2024-06-06T08:42:10.234928+0000","last_undegraded":"2024-06-06T08:42:10.234928+0000","last_fullsized":"2024-06-06T08:42:10.234928+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:54:39.779392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.222883+0000","last_change":"2024-06-06T08:40:02.537841+0000","last_active":"2024-06-06T08:42:10.222883+0000","last_peered":"2024-06-06T08:42:10.222883+0000","last_clean":"2024-06-06T08:42:10.222883+0000","last_became_active":"2024-06-06T08:40:02.537418+0000","last_became_peered":"2024-06-06T08:40:02.537418+0000","last_unstale":"2024-06-06T08:42:10.222883+0000","last_undegraded":"2024-06-06T08:42:10.222883+0000","last_fullsized":"2024-06-06T08:42:10.222883+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:42:13.835530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235645+0000","last_change":"2024-06-06T08:40:02.532747+0000","last_active":"2024-06-06T08:42:10.235645+0000","last_peered":"2024-06-06T08:42:10.235645+0000","last_clean":"2024-06-06T08:42:10.235645+0000","last_became_active":"2024-06-06T08:40:02.528275+0000","last_became_peered":"2024-06-06T08:40:02.528275+0000","last_unstale":"2024-06-06T08:42:10.235645+0000","last_undegraded":"2024-06-06T08:42:10.235645+0000","last_fullsized":"2024-06-06T08:42:10.235645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:36:40.467396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.221947+0000","last_change":"2024-06-06T08:40:02.506597+0000","last_active":"2024-06-06T08:42:10.221947+0000","last_peered":"2024-06-06T08:42:10.221947+0000","last_clean":"2024-06-06T08:42:10.221947+0000","last_became_active":"2024-06-06T08:40:02.505934+0000","last_became_peered":"2024-06-06T08:40:02.505934+0000","last_unstale":"2024-06-06T08:42:10.221947+0000","last_undegraded":"2024-06-06T08:42:10.221947+0000","last_fullsized":"2024-06-06T08:42:10.221947+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:03:19.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.204831+0000","last_change":"2024-06-06T08:40:02.531151+0000","last_active":"2024-06-06T08:42:10.204831+0000","last_peered":"2024-06-06T08:42:10.204831+0000","last_clean":"2024-06-06T08:42:10.204831+0000","last_became_active":"2024-06-06T08:40:02.530742+0000","last_became_peered":"2024-06-06T08:40:02.530742+0000","last_unstale":"2024-06-06T08:42:10.204831+0000","last_undegraded":"2024-06-06T08:42:10.204831+0000","last_fullsized":"2024-06-06T08:42:10.204831+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:58:53.422609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229850+0000","last_change":"2024-06-06T08:40:02.514294+0000","last_active":"2024-06-06T08:42:10.229850+0000","last_peered":"2024-06-06T08:42:10.229850+0000","last_clean":"2024-06-06T08:42:10.229850+0000","last_became_active":"2024-06-06T08:40:02.513935+0000","last_became_peered":"2024-06-06T08:40:02.513935+0000","last_unstale":"2024-06-06T08:42:10.229850+0000","last_undegraded":"2024-06-06T08:42:10.229850+0000","last_fullsized":"2024-06-06T08:42:10.229850+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:51:07.863317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.226107+0000","last_change":"2024-06-06T08:40:02.508559+0000","last_active":"2024-06-06T08:42:10.226107+0000","last_peered":"2024-06-06T08:42:10.226107+0000","last_clean":"2024-06-06T08:42:10.226107+0000","last_became_active":"2024-06-06T08:40:02.508133+0000","last_became_peered":"2024-06-06T08:40:02.508133+0000","last_unstale":"2024-06-06T08:42:10.226107+0000","last_undegraded":"2024-06-06T08:42:10.226107+0000","last_fullsized":"2024-06-06T08:42:10.226107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:03:26.458397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.225926+0000","last_change":"2024-06-06T08:40:41.923413+0000","last_active":"2024-06-06T08:42:10.225926+0000","last_peered":"2024-06-06T08:42:10.225926+0000","last_clean":"2024-06-06T08:42:10.225926+0000","last_became_active":"2024-06-06T08:40:41.922347+0000","last_became_peered":"2024-06-06T08:40:41.922347+0000","last_unstale":"2024-06-06T08:42:10.225926+0000","last_undegraded":"2024-06-06T08:42:10.225926+0000","last_fullsized":"2024-06-06T08:42:10.225926+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:01:13.867302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235584+0000","last_change":"2024-06-06T08:40:02.508684+0000","last_active":"2024-06-06T08:42:10.235584+0000","last_peered":"2024-06-06T08:42:10.235584+0000","last_clean":"2024-06-06T08:42:10.235584+0000","last_became_active":"2024-06-06T08:40:02.507633+0000","last_became_peered":"2024-06-06T08:40:02.507633+0000","last_unstale":"2024-06-06T08:42:10.235584+0000","last_undegraded":"2024-06-06T08:42:10.235584+0000","last_fullsized":"2024-06-06T08:42:10.235584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:13:44.072978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.231916+0000","last_change":"2024-06-06T08:40:02.511816+0000","last_active":"2024-06-06T08:42:10.231916+0000","last_peered":"2024-06-06T08:42:10.231916+0000","last_clean":"2024-06-06T08:42:10.231916+0000","last_became_active":"2024-06-06T08:40:02.511445+0000","last_became_peered":"2024-06-06T08:40:02.511445+0000","last_unstale":"2024-06-06T08:42:10.231916+0000","last_undegraded":"2024-06-06T08:42:10.231916+0000","last_fullsized":"2024-06-06T08:42:10.231916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:40:29.517937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.238455+0000","last_change":"2024-06-06T08:40:02.502964+0000","last_active":"2024-06-06T08:42:10.238455+0000","last_peered":"2024-06-06T08:42:10.238455+0000","last_clean":"2024-06-06T08:42:10.238455+0000","last_became_active":"2024-06-06T08:40:02.502568+0000","last_became_peered":"2024-06-06T08:40:02.502568+0000","last_unstale":"2024-06-06T08:42:10.238455+0000","last_undegraded":"2024-06-06T08:42:10.238455+0000","last_fullsized":"2024-06-06T08:42:10.238455+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:53:46.243293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.230934+0000","last_change":"2024-06-06T08:40:02.508686+0000","last_active":"2024-06-06T08:42:10.230934+0000","last_peered":"2024-06-06T08:42:10.230934+0000","last_clean":"2024-06-06T08:42:10.230934+0000","last_became_active":"2024-06-06T08:40:02.508318+0000","last_became_peered":"2024-06-06T08:40:02.508318+0000","last_unstale":"2024-06-06T08:42:10.230934+0000","last_undegraded":"2024-06-06T08:42:10.230934+0000","last_fullsized":"2024-06-06T08:42:10.230934+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:05:55.260194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.239021+0000","last_change":"2024-06-06T08:40:02.517055+0000","last_active":"2024-06-06T08:42:10.239021+0000","last_peered":"2024-06-06T08:42:10.239021+0000","last_clean":"2024-06-06T08:42:10.239021+0000","last_became_active":"2024-06-06T08:40:02.515866+0000","last_became_peered":"2024-06-06T08:40:02.515866+0000","last_unstale":"2024-06-06T08:42:10.239021+0000","last_undegraded":"2024-06-06T08:42:10.239021+0000","last_fullsized":"2024-06-06T08:42:10.239021+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:09:50.597303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.236842+0000","last_change":"2024-06-06T08:40:02.523035+0000","last_active":"2024-06-06T08:42:10.236842+0000","last_peered":"2024-06-06T08:42:10.236842+0000","last_clean":"2024-06-06T08:42:10.236842+0000","last_became_active":"2024-06-06T08:40:02.522257+0000","last_became_peered":"2024-06-06T08:40:02.522257+0000","last_unstale":"2024-06-06T08:42:10.236842+0000","last_undegraded":"2024-06-06T08:42:10.236842+0000","last_fullsized":"2024-06-06T08:42:10.236842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:14:08.287703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.231899+0000","last_change":"2024-06-06T08:40:02.532053+0000","last_active":"2024-06-06T08:42:10.231899+0000","last_peered":"2024-06-06T08:42:10.231899+0000","last_clean":"2024-06-06T08:42:10.231899+0000","last_became_active":"2024-06-06T08:40:02.531575+0000","last_became_peered":"2024-06-06T08:40:02.531575+0000","last_unstale":"2024-06-06T08:42:10.231899+0000","last_undegraded":"2024-06-06T08:42:10.231899+0000","last_fullsized":"2024-06-06T08:42:10.231899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:58:13.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.239599+0000","last_change":"2024-06-06T08:40:02.518220+0000","last_active":"2024-06-06T08:42:10.239599+0000","last_peered":"2024-06-06T08:42:10.239599+0000","last_clean":"2024-06-06T08:42:10.239599+0000","last_became_active":"2024-06-06T08:40:02.517771+0000","last_became_peered":"2024-06-06T08:40:02.517771+0000","last_unstale":"2024-06-06T08:42:10.239599+0000","last_undegraded":"2024-06-06T08:42:10.239599+0000","last_fullsized":"2024-06-06T08:42:10.239599+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:22:13.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235452+0000","last_change":"2024-06-06T08:40:02.537122+0000","last_active":"2024-06-06T08:42:10.235452+0000","last_peered":"2024-06-06T08:42:10.235452+0000","last_clean":"2024-06-06T08:42:10.235452+0000","last_became_active":"2024-06-06T08:40:02.536752+0000","last_became_peered":"2024-06-06T08:40:02.536752+0000","last_unstale":"2024-06-06T08:42:10.235452+0000","last_undegraded":"2024-06-06T08:42:10.235452+0000","last_fullsized":"2024-06-06T08:42:10.235452+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:03:09.537236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.238673+0000","last_change":"2024-06-06T08:40:02.515397+0000","last_active":"2024-06-06T08:42:10.238673+0000","last_peered":"2024-06-06T08:42:10.238673+0000","last_clean":"2024-06-06T08:42:10.238673+0000","last_became_active":"2024-06-06T08:40:02.514968+0000","last_became_peered":"2024-06-06T08:40:02.514968+0000","last_unstale":"2024-06-06T08:42:10.238673+0000","last_undegraded":"2024-06-06T08:42:10.238673+0000","last_fullsized":"2024-06-06T08:42:10.238673+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:41:42.724392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229708+0000","last_change":"2024-06-06T08:40:02.526875+0000","last_active":"2024-06-06T08:42:10.229708+0000","last_peered":"2024-06-06T08:42:10.229708+0000","last_clean":"2024-06-06T08:42:10.229708+0000","last_became_active":"2024-06-06T08:40:02.526583+0000","last_became_peered":"2024-06-06T08:40:02.526583+0000","last_unstale":"2024-06-06T08:42:10.229708+0000","last_undegraded":"2024-06-06T08:42:10.229708+0000","last_fullsized":"2024-06-06T08:42:10.229708+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:27:05.391768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":182,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:21.928717+0000","last_change":"2024-06-06T08:41:41.859497+0000","last_active":"2024-06-06T08:42:21.928717+0000","last_peered":"2024-06-06T08:42:21.928717+0000","last_clean":"2024-06-06T08:42:21.928717+0000","last_became_active":"2024-06-06T08:41:41.844210+0000","last_became_peered":"2024-06-06T08:41:41.844210+0000","last_unstale":"2024-06-06T08:42:21.928717+0000","last_undegraded":"2024-06-06T08:42:21.928717+0000","last_fullsized":"2024-06-06T08:42:21.928717+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:01:04.144517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.231790+0000","last_change":"2024-06-06T08:40:02.527761+0000","last_active":"2024-06-06T08:42:10.231790+0000","last_peered":"2024-06-06T08:42:10.231790+0000","last_clean":"2024-06-06T08:42:10.231790+0000","last_became_active":"2024-06-06T08:40:02.527346+0000","last_became_peered":"2024-06-06T08:40:02.527346+0000","last_unstale":"2024-06-06T08:42:10.231790+0000","last_undegraded":"2024-06-06T08:42:10.231790+0000","last_fullsized":"2024-06-06T08:42:10.231790+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:25:28.443496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838659+0000","last_change":"2024-06-06T08:39:57.664207+0000","last_active":"2024-06-06T08:41:41.838659+0000","last_peered":"2024-06-06T08:41:41.838659+0000","last_clean":"2024-06-06T08:41:41.838659+0000","last_became_active":"2024-06-06T08:39:57.663809+0000","last_became_peered":"2024-06-06T08:39:57.663809+0000","last_unstale":"2024-06-06T08:41:41.838659+0000","last_undegraded":"2024-06-06T08:41:41.838659+0000","last_fullsized":"2024-06-06T08:41:41.838659+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:12:49.140662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235723+0000","last_change":"2024-06-06T08:40:41.923126+0000","last_active":"2024-06-06T08:42:10.235723+0000","last_peered":"2024-06-06T08:42:10.235723+0000","last_clean":"2024-06-06T08:42:10.235723+0000","last_became_active":"2024-06-06T08:40:41.921580+0000","last_became_peered":"2024-06-06T08:40:41.921580+0000","last_unstale":"2024-06-06T08:42:10.235723+0000","last_undegraded":"2024-06-06T08:42:10.235723+0000","last_fullsized":"2024-06-06T08:42:10.235723+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:03:32.027832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,9],"acting":[0,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838488+0000","last_change":"2024-06-06T08:39:57.451584+0000","last_active":"2024-06-06T08:41:41.838488+0000","last_peered":"2024-06-06T08:41:41.838488+0000","last_clean":"2024-06-06T08:41:41.838488+0000","last_became_active":"2024-06-06T08:39:57.451213+0000","last_became_peered":"2024-06-06T08:39:57.451213+0000","last_unstale":"2024-06-06T08:41:41.838488+0000","last_undegraded":"2024-06-06T08:41:41.838488+0000","last_fullsized":"2024-06-06T08:41:41.838488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:49:14.346303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.241382+0000","last_change":"2024-06-06T08:40:02.516354+0000","last_active":"2024-06-06T08:42:10.241382+0000","last_peered":"2024-06-06T08:42:10.241382+0000","last_clean":"2024-06-06T08:42:10.241382+0000","last_became_active":"2024-06-06T08:40:02.516008+0000","last_became_peered":"2024-06-06T08:40:02.516008+0000","last_unstale":"2024-06-06T08:42:10.241382+0000","last_undegraded":"2024-06-06T08:42:10.241382+0000","last_fullsized":"2024-06-06T08:42:10.241382+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:21:51.826299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838349+0000","last_change":"2024-06-06T08:39:57.448570+0000","last_active":"2024-06-06T08:41:41.838349+0000","last_peered":"2024-06-06T08:41:41.838349+0000","last_clean":"2024-06-06T08:41:41.838349+0000","last_became_active":"2024-06-06T08:39:57.448183+0000","last_became_peered":"2024-06-06T08:39:57.448183+0000","last_unstale":"2024-06-06T08:41:41.838349+0000","last_undegraded":"2024-06-06T08:41:41.838349+0000","last_fullsized":"2024-06-06T08:41:41.838349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:13:17.209091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235376+0000","last_change":"2024-06-06T08:40:02.505583+0000","last_active":"2024-06-06T08:42:10.235376+0000","last_peered":"2024-06-06T08:42:10.235376+0000","last_clean":"2024-06-06T08:42:10.235376+0000","last_became_active":"2024-06-06T08:40:02.505187+0000","last_became_peered":"2024-06-06T08:40:02.505187+0000","last_unstale":"2024-06-06T08:42:10.235376+0000","last_undegraded":"2024-06-06T08:42:10.235376+0000","last_fullsized":"2024-06-06T08:42:10.235376+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:48:35.082993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'7","reported_seq":169,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:20.027505+0000","last_change":"2024-06-06T08:41:41.974591+0000","last_active":"2024-06-06T08:42:20.027505+0000","last_peered":"2024-06-06T08:42:20.027505+0000","last_clean":"2024-06-06T08:42:20.027505+0000","last_became_active":"2024-06-06T08:41:41.970790+0000","last_became_peered":"2024-06-06T08:41:41.970790+0000","last_unstale":"2024-06-06T08:42:20.027505+0000","last_undegraded":"2024-06-06T08:42:20.027505+0000","last_fullsized":"2024-06-06T08:42:20.027505+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:26:00.567897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1012,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.207894+0000","last_change":"2024-06-06T08:40:02.508540+0000","last_active":"2024-06-06T08:42:10.207894+0000","last_peered":"2024-06-06T08:42:10.207894+0000","last_clean":"2024-06-06T08:42:10.207894+0000","last_became_active":"2024-06-06T08:40:02.508162+0000","last_became_peered":"2024-06-06T08:40:02.508162+0000","last_unstale":"2024-06-06T08:42:10.207894+0000","last_undegraded":"2024-06-06T08:42:10.207894+0000","last_fullsized":"2024-06-06T08:42:10.207894+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:21:53.273212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:42.227187+0000","last_change":"2024-06-06T08:39:57.461796+0000","last_active":"2024-06-06T08:41:42.227187+0000","last_peered":"2024-06-06T08:41:42.227187+0000","last_clean":"2024-06-06T08:41:42.227187+0000","last_became_active":"2024-06-06T08:39:57.461334+0000","last_became_peered":"2024-06-06T08:39:57.461334+0000","last_unstale":"2024-06-06T08:41:42.227187+0000","last_undegraded":"2024-06-06T08:41:42.227187+0000","last_fullsized":"2024-06-06T08:41:42.227187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:46:41.904550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229136+0000","last_change":"2024-06-06T08:40:41.922968+0000","last_active":"2024-06-06T08:42:10.229136+0000","last_peered":"2024-06-06T08:42:10.229136+0000","last_clean":"2024-06-06T08:42:10.229136+0000","last_became_active":"2024-06-06T08:40:41.922079+0000","last_became_peered":"2024-06-06T08:40:41.922079+0000","last_unstale":"2024-06-06T08:42:10.229136+0000","last_undegraded":"2024-06-06T08:42:10.229136+0000","last_fullsized":"2024-06-06T08:42:10.229136+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:34:22.185719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:42.227499+0000","last_change":"2024-06-06T08:39:57.464355+0000","last_active":"2024-06-06T08:41:42.227499+0000","last_peered":"2024-06-06T08:41:42.227499+0000","last_clean":"2024-06-06T08:41:42.227499+0000","last_became_active":"2024-06-06T08:39:57.463639+0000","last_became_peered":"2024-06-06T08:39:57.463639+0000","last_unstale":"2024-06-06T08:41:42.227499+0000","last_undegraded":"2024-06-06T08:41:42.227499+0000","last_fullsized":"2024-06-06T08:41:42.227499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:55:23.456001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.230593+0000","last_change":"2024-06-06T08:40:02.524130+0000","last_active":"2024-06-06T08:42:10.230593+0000","last_peered":"2024-06-06T08:42:10.230593+0000","last_clean":"2024-06-06T08:42:10.230593+0000","last_became_active":"2024-06-06T08:40:02.523788+0000","last_became_peered":"2024-06-06T08:40:02.523788+0000","last_unstale":"2024-06-06T08:42:10.230593+0000","last_undegraded":"2024-06-06T08:42:10.230593+0000","last_fullsized":"2024-06-06T08:42:10.230593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:39:11.300028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.842185+0000","last_change":"2024-06-06T08:39:57.447392+0000","last_active":"2024-06-06T08:41:41.842185+0000","last_peered":"2024-06-06T08:41:41.842185+0000","last_clean":"2024-06-06T08:41:41.842185+0000","last_became_active":"2024-06-06T08:39:57.446995+0000","last_became_peered":"2024-06-06T08:39:57.446995+0000","last_unstale":"2024-06-06T08:41:41.842185+0000","last_undegraded":"2024-06-06T08:41:41.842185+0000","last_fullsized":"2024-06-06T08:41:41.842185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:18:50.166795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.224485+0000","last_change":"2024-06-06T08:40:02.530192+0000","last_active":"2024-06-06T08:42:10.224485+0000","last_peered":"2024-06-06T08:42:10.224485+0000","last_clean":"2024-06-06T08:42:10.224485+0000","last_became_active":"2024-06-06T08:40:02.529801+0000","last_became_peered":"2024-06-06T08:40:02.529801+0000","last_unstale":"2024-06-06T08:42:10.224485+0000","last_undegraded":"2024-06-06T08:42:10.224485+0000","last_fullsized":"2024-06-06T08:42:10.224485+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:25:31.767403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'5","reported_seq":276,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:25.034223+0000","last_change":"2024-06-06T08:39:57.451666+0000","last_active":"2024-06-06T08:42:25.034223+0000","last_peered":"2024-06-06T08:42:25.034223+0000","last_clean":"2024-06-06T08:42:25.034223+0000","last_became_active":"2024-06-06T08:39:57.451242+0000","last_became_peered":"2024-06-06T08:39:57.451242+0000","last_unstale":"2024-06-06T08:42:25.034223+0000","last_undegraded":"2024-06-06T08:42:25.034223+0000","last_fullsized":"2024-06-06T08:42:25.034223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:42:02.614485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.237176+0000","last_change":"2024-06-06T08:40:02.521368+0000","last_active":"2024-06-06T08:42:10.237176+0000","last_peered":"2024-06-06T08:42:10.237176+0000","last_clean":"2024-06-06T08:42:10.237176+0000","last_became_active":"2024-06-06T08:40:02.520948+0000","last_became_peered":"2024-06-06T08:40:02.520948+0000","last_unstale":"2024-06-06T08:42:10.237176+0000","last_undegraded":"2024-06-06T08:42:10.237176+0000","last_fullsized":"2024-06-06T08:42:10.237176+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:09:29.844472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.843510+0000","last_change":"2024-06-06T08:39:57.448966+0000","last_active":"2024-06-06T08:41:41.843510+0000","last_peered":"2024-06-06T08:41:41.843510+0000","last_clean":"2024-06-06T08:41:41.843510+0000","last_became_active":"2024-06-06T08:39:57.448449+0000","last_became_peered":"2024-06-06T08:39:57.448449+0000","last_unstale":"2024-06-06T08:41:41.843510+0000","last_undegraded":"2024-06-06T08:41:41.843510+0000","last_fullsized":"2024-06-06T08:41:41.843510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:48:38.313936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.236163+0000","last_change":"2024-06-06T08:40:02.531021+0000","last_active":"2024-06-06T08:42:10.236163+0000","last_peered":"2024-06-06T08:42:10.236163+0000","last_clean":"2024-06-06T08:42:10.236163+0000","last_became_active":"2024-06-06T08:40:02.530677+0000","last_became_peered":"2024-06-06T08:40:02.530677+0000","last_unstale":"2024-06-06T08:42:10.236163+0000","last_undegraded":"2024-06-06T08:42:10.236163+0000","last_fullsized":"2024-06-06T08:42:10.236163+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:58:42.237943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.843028+0000","last_change":"2024-06-06T08:39:57.663293+0000","last_active":"2024-06-06T08:41:41.843028+0000","last_peered":"2024-06-06T08:41:41.843028+0000","last_clean":"2024-06-06T08:41:41.843028+0000","last_became_active":"2024-06-06T08:39:57.662865+0000","last_became_peered":"2024-06-06T08:39:57.662865+0000","last_unstale":"2024-06-06T08:41:41.843028+0000","last_undegraded":"2024-06-06T08:41:41.843028+0000","last_fullsized":"2024-06-06T08:41:41.843028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:50:57.783422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.241588+0000","last_change":"2024-06-06T08:40:02.505731+0000","last_active":"2024-06-06T08:42:10.241588+0000","last_peered":"2024-06-06T08:42:10.241588+0000","last_clean":"2024-06-06T08:42:10.241588+0000","last_became_active":"2024-06-06T08:40:02.504801+0000","last_became_peered":"2024-06-06T08:40:02.504801+0000","last_unstale":"2024-06-06T08:42:10.241588+0000","last_undegraded":"2024-06-06T08:42:10.241588+0000","last_fullsized":"2024-06-06T08:42:10.241588+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:19:02.928913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'35","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:25.034203+0000","last_change":"2024-06-06T08:39:57.447508+0000","last_active":"2024-06-06T08:42:25.034203+0000","last_peered":"2024-06-06T08:42:25.034203+0000","last_clean":"2024-06-06T08:42:25.034203+0000","last_became_active":"2024-06-06T08:39:57.447118+0000","last_became_peered":"2024-06-06T08:39:57.447118+0000","last_unstale":"2024-06-06T08:42:25.034203+0000","last_undegraded":"2024-06-06T08:42:25.034203+0000","last_fullsized":"2024-06-06T08:42:25.034203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:32:37.805274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61489,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":250,"num_read_kb":184,"num_write":37,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.227789+0000","last_change":"2024-06-06T08:40:02.508523+0000","last_active":"2024-06-06T08:42:10.227789+0000","last_peered":"2024-06-06T08:42:10.227789+0000","last_clean":"2024-06-06T08:42:10.227789+0000","last_became_active":"2024-06-06T08:40:02.507699+0000","last_became_peered":"2024-06-06T08:40:02.507699+0000","last_unstale":"2024-06-06T08:42:10.227789+0000","last_undegraded":"2024-06-06T08:42:10.227789+0000","last_fullsized":"2024-06-06T08:42:10.227789+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:55:39.091047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.844475+0000","last_change":"2024-06-06T08:39:57.446777+0000","last_active":"2024-06-06T08:41:41.844475+0000","last_peered":"2024-06-06T08:41:41.844475+0000","last_clean":"2024-06-06T08:41:41.844475+0000","last_became_active":"2024-06-06T08:39:57.446401+0000","last_became_peered":"2024-06-06T08:39:57.446401+0000","last_unstale":"2024-06-06T08:41:41.844475+0000","last_undegraded":"2024-06-06T08:41:41.844475+0000","last_fullsized":"2024-06-06T08:41:41.844475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:23:10.166458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235171+0000","last_change":"2024-06-06T08:40:02.534562+0000","last_active":"2024-06-06T08:42:10.235171+0000","last_peered":"2024-06-06T08:42:10.235171+0000","last_clean":"2024-06-06T08:42:10.235171+0000","last_became_active":"2024-06-06T08:40:02.534204+0000","last_became_peered":"2024-06-06T08:40:02.534204+0000","last_unstale":"2024-06-06T08:42:10.235171+0000","last_undegraded":"2024-06-06T08:42:10.235171+0000","last_fullsized":"2024-06-06T08:42:10.235171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:46:53.695281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.843143+0000","last_change":"2024-06-06T08:39:57.451764+0000","last_active":"2024-06-06T08:41:41.843143+0000","last_peered":"2024-06-06T08:41:41.843143+0000","last_clean":"2024-06-06T08:41:41.843143+0000","last_became_active":"2024-06-06T08:39:57.451394+0000","last_became_peered":"2024-06-06T08:39:57.451394+0000","last_unstale":"2024-06-06T08:41:41.843143+0000","last_undegraded":"2024-06-06T08:41:41.843143+0000","last_fullsized":"2024-06-06T08:41:41.843143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:11:43.575913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.239556+0000","last_change":"2024-06-06T08:40:02.515017+0000","last_active":"2024-06-06T08:42:10.239556+0000","last_peered":"2024-06-06T08:42:10.239556+0000","last_clean":"2024-06-06T08:42:10.239556+0000","last_became_active":"2024-06-06T08:40:02.513242+0000","last_became_peered":"2024-06-06T08:40:02.513242+0000","last_unstale":"2024-06-06T08:42:10.239556+0000","last_undegraded":"2024-06-06T08:42:10.239556+0000","last_fullsized":"2024-06-06T08:42:10.239556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:15:13.581022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":158,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:23.926441+0000","last_change":"2024-06-06T08:39:57.451337+0000","last_active":"2024-06-06T08:42:23.926441+0000","last_peered":"2024-06-06T08:42:23.926441+0000","last_clean":"2024-06-06T08:42:23.926441+0000","last_became_active":"2024-06-06T08:39:57.450924+0000","last_became_peered":"2024-06-06T08:39:57.450924+0000","last_unstale":"2024-06-06T08:42:23.926441+0000","last_undegraded":"2024-06-06T08:42:23.926441+0000","last_fullsized":"2024-06-06T08:42:23.926441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:18:09.022874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.230367+0000","last_change":"2024-06-06T08:40:02.498665+0000","last_active":"2024-06-06T08:42:10.230367+0000","last_peered":"2024-06-06T08:42:10.230367+0000","last_clean":"2024-06-06T08:42:10.230367+0000","last_became_active":"2024-06-06T08:40:02.498261+0000","last_became_peered":"2024-06-06T08:40:02.498261+0000","last_unstale":"2024-06-06T08:42:10.230367+0000","last_undegraded":"2024-06-06T08:42:10.230367+0000","last_fullsized":"2024-06-06T08:42:10.230367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:29:03.217175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.837903+0000","last_change":"2024-06-06T08:39:57.663480+0000","last_active":"2024-06-06T08:41:41.837903+0000","last_peered":"2024-06-06T08:41:41.837903+0000","last_clean":"2024-06-06T08:41:41.837903+0000","last_became_active":"2024-06-06T08:39:57.663087+0000","last_became_peered":"2024-06-06T08:39:57.663087+0000","last_unstale":"2024-06-06T08:41:41.837903+0000","last_undegraded":"2024-06-06T08:41:41.837903+0000","last_fullsized":"2024-06-06T08:41:41.837903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:56:33.556397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.234911+0000","last_change":"2024-06-06T08:40:02.503083+0000","last_active":"2024-06-06T08:42:10.234911+0000","last_peered":"2024-06-06T08:42:10.234911+0000","last_clean":"2024-06-06T08:42:10.234911+0000","last_became_active":"2024-06-06T08:40:02.502713+0000","last_became_peered":"2024-06-06T08:40:02.502713+0000","last_unstale":"2024-06-06T08:42:10.234911+0000","last_undegraded":"2024-06-06T08:42:10.234911+0000","last_fullsized":"2024-06-06T08:42:10.234911+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:08:47.340528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838623+0000","last_change":"2024-06-06T08:39:57.448410+0000","last_active":"2024-06-06T08:41:41.838623+0000","last_peered":"2024-06-06T08:41:41.838623+0000","last_clean":"2024-06-06T08:41:41.838623+0000","last_became_active":"2024-06-06T08:39:57.447956+0000","last_became_peered":"2024-06-06T08:39:57.447956+0000","last_unstale":"2024-06-06T08:41:41.838623+0000","last_undegraded":"2024-06-06T08:41:41.838623+0000","last_fullsized":"2024-06-06T08:41:41.838623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:02:15.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.222563+0000","last_change":"2024-06-06T08:40:41.923452+0000","last_active":"2024-06-06T08:42:10.222563+0000","last_peered":"2024-06-06T08:42:10.222563+0000","last_clean":"2024-06-06T08:42:10.222563+0000","last_became_active":"2024-06-06T08:40:41.922936+0000","last_became_peered":"2024-06-06T08:40:41.922936+0000","last_unstale":"2024-06-06T08:42:10.222563+0000","last_undegraded":"2024-06-06T08:42:10.222563+0000","last_fullsized":"2024-06-06T08:42:10.222563+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:25:38.840662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.841237+0000","last_change":"2024-06-06T08:39:57.666054+0000","last_active":"2024-06-06T08:41:41.841237+0000","last_peered":"2024-06-06T08:41:41.841237+0000","last_clean":"2024-06-06T08:41:41.841237+0000","last_became_active":"2024-06-06T08:39:57.665084+0000","last_became_peered":"2024-06-06T08:39:57.665084+0000","last_unstale":"2024-06-06T08:41:41.841237+0000","last_undegraded":"2024-06-06T08:41:41.841237+0000","last_fullsized":"2024-06-06T08:41:41.841237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:18:51.576755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.234791+0000","last_change":"2024-06-06T08:40:02.529152+0000","last_active":"2024-06-06T08:42:10.234791+0000","last_peered":"2024-06-06T08:42:10.234791+0000","last_clean":"2024-06-06T08:42:10.234791+0000","last_became_active":"2024-06-06T08:40:02.528881+0000","last_became_peered":"2024-06-06T08:40:02.528881+0000","last_unstale":"2024-06-06T08:42:10.234791+0000","last_undegraded":"2024-06-06T08:42:10.234791+0000","last_fullsized":"2024-06-06T08:42:10.234791+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:18:17.188693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:21.929612+0000","last_change":"2024-06-06T08:39:57.461109+0000","last_active":"2024-06-06T08:42:21.929612+0000","last_peered":"2024-06-06T08:42:21.929612+0000","last_clean":"2024-06-06T08:42:21.929612+0000","last_became_active":"2024-06-06T08:39:57.460701+0000","last_became_peered":"2024-06-06T08:39:57.460701+0000","last_unstale":"2024-06-06T08:42:21.929612+0000","last_undegraded":"2024-06-06T08:42:21.929612+0000","last_fullsized":"2024-06-06T08:42:21.929612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:40:39.834903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229403+0000","last_change":"2024-06-06T08:40:02.525590+0000","last_active":"2024-06-06T08:42:10.229403+0000","last_peered":"2024-06-06T08:42:10.229403+0000","last_clean":"2024-06-06T08:42:10.229403+0000","last_became_active":"2024-06-06T08:40:02.525242+0000","last_became_peered":"2024-06-06T08:40:02.525242+0000","last_unstale":"2024-06-06T08:42:10.229403+0000","last_undegraded":"2024-06-06T08:42:10.229403+0000","last_fullsized":"2024-06-06T08:42:10.229403+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:46:42.121170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.223520+0000","last_change":"2024-06-06T08:40:41.921045+0000","last_active":"2024-06-06T08:42:10.223520+0000","last_peered":"2024-06-06T08:42:10.223520+0000","last_clean":"2024-06-06T08:42:10.223520+0000","last_became_active":"2024-06-06T08:40:41.920644+0000","last_became_peered":"2024-06-06T08:40:41.920644+0000","last_unstale":"2024-06-06T08:42:10.223520+0000","last_undegraded":"2024-06-06T08:42:10.223520+0000","last_fullsized":"2024-06-06T08:42:10.223520+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:01:26.880961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":157,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:23.925299+0000","last_change":"2024-06-06T08:39:57.658255+0000","last_active":"2024-06-06T08:42:23.925299+0000","last_peered":"2024-06-06T08:42:23.925299+0000","last_clean":"2024-06-06T08:42:23.925299+0000","last_became_active":"2024-06-06T08:39:57.657820+0000","last_became_peered":"2024-06-06T08:39:57.657820+0000","last_unstale":"2024-06-06T08:42:23.925299+0000","last_undegraded":"2024-06-06T08:42:23.925299+0000","last_fullsized":"2024-06-06T08:42:23.925299+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:16:16.475843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.240321+0000","last_change":"2024-06-06T08:40:41.927007+0000","last_active":"2024-06-06T08:42:10.240321+0000","last_peered":"2024-06-06T08:42:10.240321+0000","last_clean":"2024-06-06T08:42:10.240321+0000","last_became_active":"2024-06-06T08:40:41.925980+0000","last_became_peered":"2024-06-06T08:40:41.925980+0000","last_unstale":"2024-06-06T08:42:10.240321+0000","last_undegraded":"2024-06-06T08:42:10.240321+0000","last_fullsized":"2024-06-06T08:42:10.240321+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:12:56.234260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,1],"acting":[3,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.970048+0000","last_change":"2024-06-06T08:39:57.453405+0000","last_active":"2024-06-06T08:41:41.970048+0000","last_peered":"2024-06-06T08:41:41.970048+0000","last_clean":"2024-06-06T08:41:41.970048+0000","last_became_active":"2024-06-06T08:39:57.453009+0000","last_became_peered":"2024-06-06T08:39:57.453009+0000","last_unstale":"2024-06-06T08:41:41.970048+0000","last_undegraded":"2024-06-06T08:41:41.970048+0000","last_fullsized":"2024-06-06T08:41:41.970048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:07:53.568537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":354,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.842949+0000","last_change":"2024-06-06T08:38:24.084478+0000","last_active":"2024-06-06T08:41:41.842949+0000","last_peered":"2024-06-06T08:41:41.842949+0000","last_clean":"2024-06-06T08:41:41.842949+0000","last_became_active":"2024-06-06T08:38:24.083876+0000","last_became_peered":"2024-06-06T08:38:24.083876+0000","last_unstale":"2024-06-06T08:41:41.842949+0000","last_undegraded":"2024-06-06T08:41:41.842949+0000","last_fullsized":"2024-06-06T08:41:41.842949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:34:26.807146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:34:26.807146+0000","last_clean_scrub_stamp":"2024-06-06T08:34:26.807146+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:35:23.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229314+0000","last_change":"2024-06-06T08:40:02.514489+0000","last_active":"2024-06-06T08:42:10.229314+0000","last_peered":"2024-06-06T08:42:10.229314+0000","last_clean":"2024-06-06T08:42:10.229314+0000","last_became_active":"2024-06-06T08:40:02.514072+0000","last_became_peered":"2024-06-06T08:40:02.514072+0000","last_unstale":"2024-06-06T08:42:10.229314+0000","last_undegraded":"2024-06-06T08:42:10.229314+0000","last_fullsized":"2024-06-06T08:42:10.229314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:56:05.779543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.843210+0000","last_change":"2024-06-06T08:39:57.450613+0000","last_active":"2024-06-06T08:41:41.843210+0000","last_peered":"2024-06-06T08:41:41.843210+0000","last_clean":"2024-06-06T08:41:41.843210+0000","last_became_active":"2024-06-06T08:39:57.449109+0000","last_became_peered":"2024-06-06T08:39:57.449109+0000","last_unstale":"2024-06-06T08:41:41.843210+0000","last_undegraded":"2024-06-06T08:41:41.843210+0000","last_fullsized":"2024-06-06T08:41:41.843210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T19:15:10.622436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.856429+0000","last_change":"2024-06-06T08:41:41.855981+0000","last_active":"2024-06-06T08:41:41.856429+0000","last_peered":"2024-06-06T08:41:41.856429+0000","last_clean":"2024-06-06T08:41:41.856429+0000","last_became_active":"2024-06-06T08:41:41.844307+0000","last_became_peered":"2024-06-06T08:41:41.844307+0000","last_unstale":"2024-06-06T08:41:41.856429+0000","last_undegraded":"2024-06-06T08:41:41.856429+0000","last_fullsized":"2024-06-06T08:41:41.856429+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:55:47.584643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.230160+0000","last_change":"2024-06-06T08:40:02.522412+0000","last_active":"2024-06-06T08:42:10.230160+0000","last_peered":"2024-06-06T08:42:10.230160+0000","last_clean":"2024-06-06T08:42:10.230160+0000","last_became_active":"2024-06-06T08:40:02.521880+0000","last_became_peered":"2024-06-06T08:40:02.521880+0000","last_unstale":"2024-06-06T08:42:10.230160+0000","last_undegraded":"2024-06-06T08:42:10.230160+0000","last_fullsized":"2024-06-06T08:42:10.230160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:31:46.611810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'17","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:08.672769+0000","last_change":"2024-06-06T08:39:57.459036+0000","last_active":"2024-06-06T08:42:08.672769+0000","last_peered":"2024-06-06T08:42:08.672769+0000","last_clean":"2024-06-06T08:42:08.672769+0000","last_became_active":"2024-06-06T08:39:57.458500+0000","last_became_peered":"2024-06-06T08:39:57.458500+0000","last_unstale":"2024-06-06T08:42:08.672769+0000","last_undegraded":"2024-06-06T08:42:08.672769+0000","last_fullsized":"2024-06-06T08:42:08.672769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:25:35.968887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.232782+0000","last_change":"2024-06-06T08:40:02.534130+0000","last_active":"2024-06-06T08:42:10.232782+0000","last_peered":"2024-06-06T08:42:10.232782+0000","last_clean":"2024-06-06T08:42:10.232782+0000","last_became_active":"2024-06-06T08:40:02.527085+0000","last_became_peered":"2024-06-06T08:40:02.527085+0000","last_unstale":"2024-06-06T08:42:10.232782+0000","last_undegraded":"2024-06-06T08:42:10.232782+0000","last_fullsized":"2024-06-06T08:42:10.232782+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:06:07.606127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.969955+0000","last_change":"2024-06-06T08:39:57.507621+0000","last_active":"2024-06-06T08:41:41.969955+0000","last_peered":"2024-06-06T08:41:41.969955+0000","last_clean":"2024-06-06T08:41:41.969955+0000","last_became_active":"2024-06-06T08:39:57.507268+0000","last_became_peered":"2024-06-06T08:39:57.507268+0000","last_unstale":"2024-06-06T08:41:41.969955+0000","last_undegraded":"2024-06-06T08:41:41.969955+0000","last_fullsized":"2024-06-06T08:41:41.969955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:15:58.191318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.235783+0000","last_change":"2024-06-06T08:40:41.923084+0000","last_active":"2024-06-06T08:42:10.235783+0000","last_peered":"2024-06-06T08:42:10.235783+0000","last_clean":"2024-06-06T08:42:10.235783+0000","last_became_active":"2024-06-06T08:40:41.922562+0000","last_became_peered":"2024-06-06T08:40:41.922562+0000","last_unstale":"2024-06-06T08:42:10.235783+0000","last_undegraded":"2024-06-06T08:42:10.235783+0000","last_fullsized":"2024-06-06T08:42:10.235783+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:12:45.467112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.841857+0000","last_change":"2024-06-06T08:39:57.663754+0000","last_active":"2024-06-06T08:41:41.841857+0000","last_peered":"2024-06-06T08:41:41.841857+0000","last_clean":"2024-06-06T08:41:41.841857+0000","last_became_active":"2024-06-06T08:39:57.663356+0000","last_became_peered":"2024-06-06T08:39:57.663356+0000","last_unstale":"2024-06-06T08:41:41.841857+0000","last_undegraded":"2024-06-06T08:41:41.841857+0000","last_fullsized":"2024-06-06T08:41:41.841857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:35:33.372951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.209244+0000","last_change":"2024-06-06T08:40:02.508300+0000","last_active":"2024-06-06T08:42:10.209244+0000","last_peered":"2024-06-06T08:42:10.209244+0000","last_clean":"2024-06-06T08:42:10.209244+0000","last_became_active":"2024-06-06T08:40:02.507880+0000","last_became_peered":"2024-06-06T08:40:02.507880+0000","last_unstale":"2024-06-06T08:42:10.209244+0000","last_undegraded":"2024-06-06T08:42:10.209244+0000","last_fullsized":"2024-06-06T08:42:10.209244+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:08:32.068060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838051+0000","last_change":"2024-06-06T08:39:57.456657+0000","last_active":"2024-06-06T08:41:41.838051+0000","last_peered":"2024-06-06T08:41:41.838051+0000","last_clean":"2024-06-06T08:41:41.838051+0000","last_became_active":"2024-06-06T08:39:57.455401+0000","last_became_peered":"2024-06-06T08:39:57.455401+0000","last_unstale":"2024-06-06T08:41:41.838051+0000","last_undegraded":"2024-06-06T08:41:41.838051+0000","last_fullsized":"2024-06-06T08:41:41.838051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:21:04.840297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.232406+0000","last_change":"2024-06-06T08:40:02.520755+0000","last_active":"2024-06-06T08:42:10.232406+0000","last_peered":"2024-06-06T08:42:10.232406+0000","last_clean":"2024-06-06T08:42:10.232406+0000","last_became_active":"2024-06-06T08:40:02.520349+0000","last_became_peered":"2024-06-06T08:40:02.520349+0000","last_unstale":"2024-06-06T08:42:10.232406+0000","last_undegraded":"2024-06-06T08:42:10.232406+0000","last_fullsized":"2024-06-06T08:42:10.232406+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:19:09.549764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.844234+0000","last_change":"2024-06-06T08:39:57.448342+0000","last_active":"2024-06-06T08:41:41.844234+0000","last_peered":"2024-06-06T08:41:41.844234+0000","last_clean":"2024-06-06T08:41:41.844234+0000","last_became_active":"2024-06-06T08:39:57.447966+0000","last_became_peered":"2024-06-06T08:39:57.447966+0000","last_unstale":"2024-06-06T08:41:41.844234+0000","last_undegraded":"2024-06-06T08:41:41.844234+0000","last_fullsized":"2024-06-06T08:41:41.844234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:49:47.211202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.236266+0000","last_change":"2024-06-06T08:40:02.527976+0000","last_active":"2024-06-06T08:42:10.236266+0000","last_peered":"2024-06-06T08:42:10.236266+0000","last_clean":"2024-06-06T08:42:10.236266+0000","last_became_active":"2024-06-06T08:40:02.526288+0000","last_became_peered":"2024-06-06T08:40:02.526288+0000","last_unstale":"2024-06-06T08:42:10.236266+0000","last_undegraded":"2024-06-06T08:42:10.236266+0000","last_fullsized":"2024-06-06T08:42:10.236266+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:21:34.363207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.838164+0000","last_change":"2024-06-06T08:39:57.450301+0000","last_active":"2024-06-06T08:41:41.838164+0000","last_peered":"2024-06-06T08:41:41.838164+0000","last_clean":"2024-06-06T08:41:41.838164+0000","last_became_active":"2024-06-06T08:39:57.449867+0000","last_became_peered":"2024-06-06T08:39:57.449867+0000","last_unstale":"2024-06-06T08:41:41.838164+0000","last_undegraded":"2024-06-06T08:41:41.838164+0000","last_fullsized":"2024-06-06T08:41:41.838164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:00:53.571075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.240728+0000","last_change":"2024-06-06T08:40:02.513543+0000","last_active":"2024-06-06T08:42:10.240728+0000","last_peered":"2024-06-06T08:42:10.240728+0000","last_clean":"2024-06-06T08:42:10.240728+0000","last_became_active":"2024-06-06T08:40:02.513175+0000","last_became_peered":"2024-06-06T08:40:02.513175+0000","last_unstale":"2024-06-06T08:42:10.240728+0000","last_undegraded":"2024-06-06T08:42:10.240728+0000","last_fullsized":"2024-06-06T08:42:10.240728+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:31:31.032249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":59,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:19.925747+0000","last_change":"2024-06-06T08:41:41.849343+0000","last_active":"2024-06-06T08:42:19.925747+0000","last_peered":"2024-06-06T08:42:19.925747+0000","last_clean":"2024-06-06T08:42:19.925747+0000","last_became_active":"2024-06-06T08:41:41.844231+0000","last_became_peered":"2024-06-06T08:41:41.844231+0000","last_unstale":"2024-06-06T08:42:19.925747+0000","last_undegraded":"2024-06-06T08:42:19.925747+0000","last_fullsized":"2024-06-06T08:42:19.925747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:29:35.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.240045+0000","last_change":"2024-06-06T08:40:02.507607+0000","last_active":"2024-06-06T08:42:10.240045+0000","last_peered":"2024-06-06T08:42:10.240045+0000","last_clean":"2024-06-06T08:42:10.240045+0000","last_became_active":"2024-06-06T08:40:02.507225+0000","last_became_peered":"2024-06-06T08:40:02.507225+0000","last_unstale":"2024-06-06T08:42:10.240045+0000","last_undegraded":"2024-06-06T08:42:10.240045+0000","last_fullsized":"2024-06-06T08:42:10.240045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:18:14.161368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:41.842767+0000","last_change":"2024-06-06T08:39:57.455145+0000","last_active":"2024-06-06T08:41:41.842767+0000","last_peered":"2024-06-06T08:41:41.842767+0000","last_clean":"2024-06-06T08:41:41.842767+0000","last_became_active":"2024-06-06T08:39:57.454802+0000","last_became_peered":"2024-06-06T08:39:57.454802+0000","last_unstale":"2024-06-06T08:41:41.842767+0000","last_undegraded":"2024-06-06T08:41:41.842767+0000","last_fullsized":"2024-06-06T08:41:41.842767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:13:37.287584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.232307+0000","last_change":"2024-06-06T08:40:02.531229+0000","last_active":"2024-06-06T08:42:10.232307+0000","last_peered":"2024-06-06T08:42:10.232307+0000","last_clean":"2024-06-06T08:42:10.232307+0000","last_became_active":"2024-06-06T08:40:02.530944+0000","last_became_peered":"2024-06-06T08:40:02.530944+0000","last_unstale":"2024-06-06T08:42:10.232307+0000","last_undegraded":"2024-06-06T08:42:10.232307+0000","last_fullsized":"2024-06-06T08:42:10.232307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:38:42.733919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:41:42.227503+0000","last_change":"2024-06-06T08:39:57.463387+0000","last_active":"2024-06-06T08:41:42.227503+0000","last_peered":"2024-06-06T08:41:42.227503+0000","last_clean":"2024-06-06T08:41:42.227503+0000","last_became_active":"2024-06-06T08:39:57.462946+0000","last_became_peered":"2024-06-06T08:39:57.462946+0000","last_unstale":"2024-06-06T08:41:42.227503+0000","last_undegraded":"2024-06-06T08:41:42.227503+0000","last_fullsized":"2024-06-06T08:41:42.227503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:39:56.425953+0000","last_clean_scrub_stamp":"2024-06-06T08:39:56.425953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:42:28.270765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.233480+0000","last_change":"2024-06-06T08:40:02.508752+0000","last_active":"2024-06-06T08:42:10.233480+0000","last_peered":"2024-06-06T08:42:10.233480+0000","last_clean":"2024-06-06T08:42:10.233480+0000","last_became_active":"2024-06-06T08:40:02.508395+0000","last_became_peered":"2024-06-06T08:40:02.508395+0000","last_unstale":"2024-06-06T08:42:10.233480+0000","last_undegraded":"2024-06-06T08:42:10.233480+0000","last_fullsized":"2024-06-06T08:42:10.233480+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:49:11.516680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.224370+0000","last_change":"2024-06-06T08:40:41.920976+0000","last_active":"2024-06-06T08:42:10.224370+0000","last_peered":"2024-06-06T08:42:10.224370+0000","last_clean":"2024-06-06T08:42:10.224370+0000","last_became_active":"2024-06-06T08:40:41.920483+0000","last_became_peered":"2024-06-06T08:40:41.920483+0000","last_unstale":"2024-06-06T08:42:10.224370+0000","last_undegraded":"2024-06-06T08:42:10.224370+0000","last_fullsized":"2024-06-06T08:42:10.224370+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:12:02.631659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.212782+0000","last_change":"2024-06-06T08:40:02.509533+0000","last_active":"2024-06-06T08:42:10.212782+0000","last_peered":"2024-06-06T08:42:10.212782+0000","last_clean":"2024-06-06T08:42:10.212782+0000","last_became_active":"2024-06-06T08:40:02.508698+0000","last_became_peered":"2024-06-06T08:40:02.508698+0000","last_unstale":"2024-06-06T08:42:10.212782+0000","last_undegraded":"2024-06-06T08:42:10.212782+0000","last_fullsized":"2024-06-06T08:42:10.212782+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:18:05.840254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.229046+0000","last_change":"2024-06-06T08:40:02.532089+0000","last_active":"2024-06-06T08:42:10.229046+0000","last_peered":"2024-06-06T08:42:10.229046+0000","last_clean":"2024-06-06T08:42:10.229046+0000","last_became_active":"2024-06-06T08:40:02.531841+0000","last_became_peered":"2024-06-06T08:40:02.531841+0000","last_unstale":"2024-06-06T08:42:10.229046+0000","last_undegraded":"2024-06-06T08:42:10.229046+0000","last_fullsized":"2024-06-06T08:42:10.229046+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:52:04.975610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.239479+0000","last_change":"2024-06-06T08:40:02.534539+0000","last_active":"2024-06-06T08:42:10.239479+0000","last_peered":"2024-06-06T08:42:10.239479+0000","last_clean":"2024-06-06T08:42:10.239479+0000","last_became_active":"2024-06-06T08:40:02.533756+0000","last_became_peered":"2024-06-06T08:40:02.533756+0000","last_unstale":"2024-06-06T08:42:10.239479+0000","last_undegraded":"2024-06-06T08:42:10.239479+0000","last_fullsized":"2024-06-06T08:42:10.239479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T15:30:19.277210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.237380+0000","last_change":"2024-06-06T08:40:02.540186+0000","last_active":"2024-06-06T08:42:10.237380+0000","last_peered":"2024-06-06T08:42:10.237380+0000","last_clean":"2024-06-06T08:42:10.237380+0000","last_became_active":"2024-06-06T08:40:02.539768+0000","last_became_peered":"2024-06-06T08:40:02.539768+0000","last_unstale":"2024-06-06T08:42:10.237380+0000","last_undegraded":"2024-06-06T08:42:10.237380+0000","last_fullsized":"2024-06-06T08:42:10.237380+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:44:41.203835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.223120+0000","last_change":"2024-06-06T08:40:02.508392+0000","last_active":"2024-06-06T08:42:10.223120+0000","last_peered":"2024-06-06T08:42:10.223120+0000","last_clean":"2024-06-06T08:42:10.223120+0000","last_became_active":"2024-06-06T08:40:02.508054+0000","last_became_peered":"2024-06-06T08:40:02.508054+0000","last_unstale":"2024-06-06T08:42:10.223120+0000","last_undegraded":"2024-06-06T08:42:10.223120+0000","last_fullsized":"2024-06-06T08:42:10.223120+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:59:16.879294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.238462+0000","last_change":"2024-06-06T08:40:02.508451+0000","last_active":"2024-06-06T08:42:10.238462+0000","last_peered":"2024-06-06T08:42:10.238462+0000","last_clean":"2024-06-06T08:42:10.238462+0000","last_became_active":"2024-06-06T08:40:02.505407+0000","last_became_peered":"2024-06-06T08:40:02.505407+0000","last_unstale":"2024-06-06T08:42:10.238462+0000","last_undegraded":"2024-06-06T08:42:10.238462+0000","last_fullsized":"2024-06-06T08:42:10.238462+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T18:55:23.080525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.231389+0000","last_change":"2024-06-06T08:40:02.534845+0000","last_active":"2024-06-06T08:42:10.231389+0000","last_peered":"2024-06-06T08:42:10.231389+0000","last_clean":"2024-06-06T08:42:10.231389+0000","last_became_active":"2024-06-06T08:40:02.534463+0000","last_became_peered":"2024-06-06T08:40:02.534463+0000","last_unstale":"2024-06-06T08:42:10.231389+0000","last_undegraded":"2024-06-06T08:42:10.231389+0000","last_fullsized":"2024-06-06T08:42:10.231389+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:25:17.693197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.234104+0000","last_change":"2024-06-06T08:40:41.843054+0000","last_active":"2024-06-06T08:42:10.234104+0000","last_peered":"2024-06-06T08:42:10.234104+0000","last_clean":"2024-06-06T08:42:10.234104+0000","last_became_active":"2024-06-06T08:40:41.842726+0000","last_became_peered":"2024-06-06T08:40:41.842726+0000","last_unstale":"2024-06-06T08:42:10.234104+0000","last_undegraded":"2024-06-06T08:42:10.234104+0000","last_fullsized":"2024-06-06T08:42:10.234104+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:10:46.018896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.231952+0000","last_change":"2024-06-06T08:40:02.529939+0000","last_active":"2024-06-06T08:42:10.231952+0000","last_peered":"2024-06-06T08:42:10.231952+0000","last_clean":"2024-06-06T08:42:10.231952+0000","last_became_active":"2024-06-06T08:40:02.529500+0000","last_became_peered":"2024-06-06T08:40:02.529500+0000","last_unstale":"2024-06-06T08:42:10.231952+0000","last_undegraded":"2024-06-06T08:42:10.231952+0000","last_fullsized":"2024-06-06T08:42:10.231952+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T17:03:35.832111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.240131+0000","last_change":"2024-06-06T08:40:02.536434+0000","last_active":"2024-06-06T08:42:10.240131+0000","last_peered":"2024-06-06T08:42:10.240131+0000","last_clean":"2024-06-06T08:42:10.240131+0000","last_became_active":"2024-06-06T08:40:02.536077+0000","last_became_peered":"2024-06-06T08:40:02.536077+0000","last_unstale":"2024-06-06T08:42:10.240131+0000","last_undegraded":"2024-06-06T08:42:10.240131+0000","last_fullsized":"2024-06-06T08:42:10.240131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:04:45.438724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.240014+0000","last_change":"2024-06-06T08:40:02.540402+0000","last_active":"2024-06-06T08:42:10.240014+0000","last_peered":"2024-06-06T08:42:10.240014+0000","last_clean":"2024-06-06T08:42:10.240014+0000","last_became_active":"2024-06-06T08:40:02.539884+0000","last_became_peered":"2024-06-06T08:40:02.539884+0000","last_unstale":"2024-06-06T08:42:10.240014+0000","last_undegraded":"2024-06-06T08:42:10.240014+0000","last_fullsized":"2024-06-06T08:42:10.240014+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T20:07:58.081026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-06-06T08:42:10.225172+0000","last_change":"2024-06-06T08:40:02.511737+0000","last_active":"2024-06-06T08:42:10.225172+0000","last_peered":"2024-06-06T08:42:10.225172+0000","last_clean":"2024-06-06T08:42:10.225172+0000","last_became_active":"2024-06-06T08:40:02.511373+0000","last_became_peered":"2024-06-06T08:40:02.511373+0000","last_unstale":"2024-06-06T08:42:10.225172+0000","last_undegraded":"2024-06-06T08:42:10.225172+0000","last_fullsized":"2024-06-06T08:42:10.225172+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T08:40:01.453877+0000","last_clean_scrub_stamp":"2024-06-06T08:40:01.453877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T16:00:25.251603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284445,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68442,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1134,"num_read_kb":683,"num_write":253,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2966,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":205326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383725,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":498662,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645363,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1167360,"data_stored":1150396,"data_compressed":47759,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808889,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":497808,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070527,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1024000,"data_stored":498074,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332164,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":1090172,"data_compressed":47759,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495691,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1019904,"data_stored":497525,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":561097,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":498864,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411428,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1085440,"data_stored":558355,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182492,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":497350,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":498539,"data_compressed":11588,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757330,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":1090522,"data_compressed":47759,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34530,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36171,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":64411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":61669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T08:42:29.116 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-06T08:42:29.116 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-06T08:42:29.116 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-06-06T08:42:29.117 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph health --format=json 2024-06-06T08:42:29.645 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:42:29.993 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:29 smithi028 ceph-mon[31564]: from='client.24835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:42:29.993 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:29 smithi028 ceph-mon[31564]: pgmap v406: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:30.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:29 smithi037 ceph-mon[36609]: from='client.24835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:42:30.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:29 smithi037 ceph-mon[36609]: pgmap v406: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:30.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:29 smithi059 ceph-mon[36684]: from='client.24835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T08:42:30.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:29 smithi059 ceph-mon[36684]: pgmap v406: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:31.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.866+0000 7f6e37e00700 1 -- 172.21.15.28:0/3006684745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e300746c0 msgr2=0x7f6e30074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:31.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.866+0000 7f6e37e00700 1 --2- 172.21.15.28:0/3006684745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e300746c0 0x7f6e30074aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400b0a0 tx=0x7f6e2400b3b0 comp rx=0 tx=0).stop 2024-06-06T08:42:31.865 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:31 smithi028 ceph-mon[31564]: pgmap v407: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:31.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.866+0000 7f6e37e00700 1 -- 172.21.15.28:0/3006684745 shutdown_connections 2024-06-06T08:42:31.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.866+0000 7f6e37e00700 1 --2- 172.21.15.28:0/3006684745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3010ee90 0x7f6e30111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:31.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.866+0000 7f6e37e00700 1 --2- 172.21.15.28:0/3006684745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e300746c0 0x7f6e30074aa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:31.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.866+0000 7f6e37e00700 1 --2- 172.21.15.28:0/3006684745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e30074fe0 0x7f6e3010e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:31.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.866+0000 7f6e37e00700 1 -- 172.21.15.28:0/3006684745 >> 172.21.15.28:0/3006684745 conn(0x7f6e300795f0 msgr2=0x7f6e30079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:31.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.866+0000 7f6e37e00700 1 -- 172.21.15.28:0/3006684745 shutdown_connections 2024-06-06T08:42:31.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.867+0000 7f6e37e00700 1 -- 172.21.15.28:0/3006684745 wait complete. 2024-06-06T08:42:31.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.868+0000 7f6e37e00700 1 Processor -- start 2024-06-06T08:42:31.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.868+0000 7f6e37e00700 1 -- start start 2024-06-06T08:42:31.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.868+0000 7f6e37e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e300746c0 0x7f6e3019ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:31.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.868+0000 7f6e37e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e30074fe0 0x7f6e3019b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:31.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.868+0000 7f6e37e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3010ee90 0x7f6e3019f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:31.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.868+0000 7f6e37e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e301149d0 con 0x7f6e300746c0 2024-06-06T08:42:31.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.868+0000 7f6e37e00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30114850 con 0x7f6e3010ee90 2024-06-06T08:42:31.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.868+0000 7f6e37e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30114b50 con 0x7f6e30074fe0 2024-06-06T08:42:31.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.869+0000 7f6e35400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e300746c0 0x7f6e3019ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:31.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.869+0000 7f6e35400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e300746c0 0x7f6e3019ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43670/0 (socket says 172.21.15.28:43670) 2024-06-06T08:42:31.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.869+0000 7f6e35400700 1 -- 172.21.15.28:0/1994074081 learned_addr learned my addr 172.21.15.28:0/1994074081 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:31.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.869+0000 7f6e34a00700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e30074fe0 0x7f6e3019b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:31.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.869+0000 7f6e35e00700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3010ee90 0x7f6e3019f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:31.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.869+0000 7f6e35400700 1 -- 172.21.15.28:0/1994074081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e30074fe0 msgr2=0x7f6e3019b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:31.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.869+0000 7f6e35400700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e30074fe0 0x7f6e3019b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:31.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.869+0000 7f6e35400700 1 -- 172.21.15.28:0/1994074081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3010ee90 msgr2=0x7f6e3019f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:31.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.869+0000 7f6e35400700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3010ee90 0x7f6e3019f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:31.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.869+0000 7f6e35400700 1 -- 172.21.15.28:0/1994074081 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3019fe90 con 0x7f6e300746c0 2024-06-06T08:42:31.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.870+0000 7f6e35400700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e300746c0 0x7f6e3019ae80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400b070 tx=0x7f6e24004cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:31.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.870+0000 7f6e2e000700 1 -- 172.21.15.28:0/1994074081 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24021070 con 0x7f6e300746c0 2024-06-06T08:42:31.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.870+0000 7f6e2e000700 1 -- 172.21.15.28:0/1994074081 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e24003c00 con 0x7f6e300746c0 2024-06-06T08:42:31.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.870+0000 7f6e2e000700 1 -- 172.21.15.28:0/1994074081 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24004880 con 0x7f6e300746c0 2024-06-06T08:42:31.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.870+0000 7f6e37e00700 1 -- 172.21.15.28:0/1994074081 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e301a0120 con 0x7f6e300746c0 2024-06-06T08:42:31.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.870+0000 7f6e37e00700 1 -- 172.21.15.28:0/1994074081 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e301a7a00 con 0x7f6e300746c0 2024-06-06T08:42:31.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.871+0000 7f6e37e00700 1 -- 172.21.15.28:0/1994074081 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e30069180 con 0x7f6e300746c0 2024-06-06T08:42:31.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.873+0000 7f6e2e000700 1 -- 172.21.15.28:0/1994074081 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6e24007980 con 0x7f6e300746c0 2024-06-06T08:42:31.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.875+0000 7f6e2e000700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6e180a2ca0 0x7f6e180a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:31.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.875+0000 7f6e2e000700 1 -- 172.21.15.28:0/1994074081 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f6e2400f020 con 0x7f6e300746c0 2024-06-06T08:42:31.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.875+0000 7f6e34a00700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6e180a2ca0 0x7f6e180a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:31.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.876+0000 7f6e34a00700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6e180a2ca0 0x7f6e180a5160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e30110bc0 tx=0x7f6e1c00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:31.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:31.880+0000 7f6e2e000700 1 -- 172.21.15.28:0/1994074081 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6e2402a020 con 0x7f6e300746c0 2024-06-06T08:42:32.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:31 smithi037 ceph-mon[36609]: pgmap v407: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:32.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:31 smithi059 ceph-mon[36684]: pgmap v407: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:32.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.159+0000 7f6e37e00700 1 -- 172.21.15.28:0/1994074081 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6e3002dca0 con 0x7f6e300746c0 2024-06-06T08:42:32.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.160+0000 7f6e2e000700 1 -- 172.21.15.28:0/1994074081 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6e2409d3e0 con 0x7f6e300746c0 2024-06-06T08:42:32.160 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:42:32.160 INFO:teuthology.orchestra.run.smithi028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-06T08:42:32.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 -- 172.21.15.28:0/1994074081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6e180a2ca0 msgr2=0x7f6e180a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6e180a2ca0 0x7f6e180a5160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e30110bc0 tx=0x7f6e1c00b3c0 comp rx=0 tx=0).stop 2024-06-06T08:42:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 -- 172.21.15.28:0/1994074081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e300746c0 msgr2=0x7f6e3019ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e300746c0 0x7f6e3019ae80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400b070 tx=0x7f6e24004cf0 comp rx=0 tx=0).stop 2024-06-06T08:42:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 -- 172.21.15.28:0/1994074081 shutdown_connections 2024-06-06T08:42:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f6e180a2ca0 0x7f6e180a5160 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3010ee90 0x7f6e3019f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e300746c0 0x7f6e3019ae80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 --2- 172.21.15.28:0/1994074081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e30074fe0 0x7f6e3019b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 -- 172.21.15.28:0/1994074081 >> 172.21.15.28:0/1994074081 conn(0x7f6e300795f0 msgr2=0x7f6e300ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 -- 172.21.15.28:0/1994074081 shutdown_connections 2024-06-06T08:42:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:32.164+0000 7f6e37e00700 1 -- 172.21.15.28:0/1994074081 wait complete. 2024-06-06T08:42:32.989 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:32 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1994074081' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-06T08:42:33.042 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-06-06T08:42:33.043 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:42:33.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:32 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1994074081' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-06T08:42:33.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:32 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1994074081' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-06T08:42:33.502 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:42:33.879 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:33 smithi028 ceph-mon[31564]: pgmap v408: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:34.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:33 smithi037 ceph-mon[36609]: pgmap v408: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:34.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:33 smithi059 ceph-mon[36684]: pgmap v408: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:35.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.814+0000 7f5698e00700 1 -- 172.21.15.28:0/526294502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f569406a170 msgr2=0x7f569406a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:35.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.814+0000 7f5698e00700 1 --2- 172.21.15.28:0/526294502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f569406a170 0x7f569406a5d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f567c0099c0 tx=0x7f567c009cd0 comp rx=0 tx=0).stop 2024-06-06T08:42:35.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.814+0000 7f5698e00700 1 -- 172.21.15.28:0/526294502 shutdown_connections 2024-06-06T08:42:35.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.814+0000 7f5698e00700 1 --2- 172.21.15.28:0/526294502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569406ab10 0x7f569410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:35.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.814+0000 7f5698e00700 1 --2- 172.21.15.28:0/526294502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56941084e0 0x7f56941088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:35.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.814+0000 7f5698e00700 1 --2- 172.21.15.28:0/526294502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f569406a170 0x7f569406a5d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:35.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.814+0000 7f5698e00700 1 -- 172.21.15.28:0/526294502 >> 172.21.15.28:0/526294502 conn(0x7f56940782c0 msgr2=0x7f56940786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:35.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.814+0000 7f5698e00700 1 -- 172.21.15.28:0/526294502 shutdown_connections 2024-06-06T08:42:35.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.814+0000 7f5698e00700 1 -- 172.21.15.28:0/526294502 wait complete. 2024-06-06T08:42:35.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.815+0000 7f5698e00700 1 Processor -- start 2024-06-06T08:42:35.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.816+0000 7f5698e00700 1 -- start start 2024-06-06T08:42:35.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.816+0000 7f5698e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f569406a170 0x7f5694101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:35.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.816+0000 7f5698e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569406ab10 0x7f56941019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:35.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.816+0000 7f5698e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56941084e0 0x7f5694101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:35.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.816+0000 7f5698e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5694112790 con 0x7f569406a170 2024-06-06T08:42:35.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.816+0000 7f5698e00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5694112610 con 0x7f56941084e0 2024-06-06T08:42:35.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.816+0000 7f5698e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5694112910 con 0x7f569406ab10 2024-06-06T08:42:35.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.816+0000 7f5691e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f569406a170 0x7f5694101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:35.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.816+0000 7f5691e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f569406a170 0x7f5694101460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43702/0 (socket says 172.21.15.28:43702) 2024-06-06T08:42:35.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.816+0000 7f5691e00700 1 -- 172.21.15.28:0/2522670633 learned_addr learned my addr 172.21.15.28:0/2522670633 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:35.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.816+0000 7f5689400700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569406ab10 0x7f56941019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:35.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.817+0000 7f5692800700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56941084e0 0x7f5694101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:35.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.817+0000 7f5691e00700 1 -- 172.21.15.28:0/2522670633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569406ab10 msgr2=0x7f56941019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:35.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.817+0000 7f5691e00700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569406ab10 0x7f56941019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:35.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.817+0000 7f5691e00700 1 -- 172.21.15.28:0/2522670633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56941084e0 msgr2=0x7f5694101ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:35.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.817+0000 7f5691e00700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56941084e0 0x7f5694101ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:35.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.817+0000 7f5691e00700 1 -- 172.21.15.28:0/2522670633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56941a71a0 con 0x7f569406a170 2024-06-06T08:42:35.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.817+0000 7f5691e00700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f569406a170 0x7f5694101460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f568400e9c0 tx=0x7f568400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:35.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.817+0000 7f568b400700 1 -- 172.21.15.28:0/2522670633 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568400cbd0 con 0x7f569406a170 2024-06-06T08:42:35.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.818+0000 7f568b400700 1 -- 172.21.15.28:0/2522670633 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f568400ee50 con 0x7f569406a170 2024-06-06T08:42:35.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.818+0000 7f5698e00700 1 -- 172.21.15.28:0/2522670633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56941a7490 con 0x7f569406a170 2024-06-06T08:42:35.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.818+0000 7f568b400700 1 -- 172.21.15.28:0/2522670633 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684005680 con 0x7f569406a170 2024-06-06T08:42:35.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.818+0000 7f5698e00700 1 -- 172.21.15.28:0/2522670633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56941a79a0 con 0x7f569406a170 2024-06-06T08:42:35.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.819+0000 7f5698e00700 1 -- 172.21.15.28:0/2522670633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5694069180 con 0x7f569406a170 2024-06-06T08:42:35.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.821+0000 7f568b400700 1 -- 172.21.15.28:0/2522670633 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5684004750 con 0x7f569406a170 2024-06-06T08:42:35.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.822+0000 7f568b400700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2ca0 0x7f56780a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:35.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.822+0000 7f568b400700 1 -- 172.21.15.28:0/2522670633 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f56840cf280 con 0x7f569406a170 2024-06-06T08:42:35.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.823+0000 7f5689400700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2ca0 0x7f56780a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:35.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.823+0000 7f5689400700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2ca0 0x7f56780a5160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5694102ea0 tx=0x7f567c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:35.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:35.827+0000 7f568b400700 1 -- 172.21.15.28:0/2522670633 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f568409c100 con 0x7f569406a170 2024-06-06T08:42:36.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:35 smithi028 ceph-mon[31564]: pgmap v409: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:36.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:35 smithi037 ceph-mon[36609]: pgmap v409: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:36.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:35 smithi059 ceph-mon[36684]: pgmap v409: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:36.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.116+0000 7f5698e00700 1 -- 172.21.15.28:0/2522670633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f569402dca0 con 0x7f569406a170 2024-06-06T08:42:36.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.118+0000 7f568b400700 1 -- 172.21.15.28:0/2522670633 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11909 (secure 0 0 0) 0x7f568409ba00 con 0x7f569406a170 2024-06-06T08:42:36.117 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:42:36.117 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T08:40:05.416261+0000","modified":"2024-06-06T08:40:29.442708+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24542,"mds_1":24503,"mds_2":24499,"mds_3":24485,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14388":{"gid":14388,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6839/735176440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":735176440},{"type":"v1","addr":"172.21.15.28:6839","nonce":735176440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14400":{"gid":14400,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6841/3192274308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":3192274308},{"type":"v1","addr":"172.21.15.28:6841","nonce":3192274308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6839/771325139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":771325139},{"type":"v1","addr":"172.21.15.59:6839","nonce":771325139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.37:6839/527311102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":527311102},{"type":"v1","addr":"172.21.15.37:6839","nonce":527311102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24499,24485,24484,24503,24542]},"id":1}]} 2024-06-06T08:42:36.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 -- 172.21.15.28:0/2522670633 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2ca0 msgr2=0x7f56780a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:36.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2ca0 0x7f56780a5160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5694102ea0 tx=0x7f567c005fb0 comp rx=0 tx=0).stop 2024-06-06T08:42:36.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 -- 172.21.15.28:0/2522670633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f569406a170 msgr2=0x7f5694101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:36.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f569406a170 0x7f5694101460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f568400e9c0 tx=0x7f568400ecd0 comp rx=0 tx=0).stop 2024-06-06T08:42:36.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 -- 172.21.15.28:0/2522670633 shutdown_connections 2024-06-06T08:42:36.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56780a2ca0 0x7f56780a5160 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:36.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56941084e0 0x7f5694101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:36.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f569406a170 0x7f5694101460 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:36.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 --2- 172.21.15.28:0/2522670633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569406ab10 0x7f56941019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:36.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 -- 172.21.15.28:0/2522670633 >> 172.21.15.28:0/2522670633 conn(0x7f56940782c0 msgr2=0x7f56940ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:36.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 -- 172.21.15.28:0/2522670633 shutdown_connections 2024-06-06T08:42:36.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:36.121+0000 7f5698e00700 1 -- 172.21.15.28:0/2522670633 wait complete. 2024-06-06T08:42:36.121 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 28 2024-06-06T08:42:36.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:36 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2522670633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:42:37.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:36 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2522670633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:42:37.084 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:42:37.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:36 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2522670633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:42:37.595 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:42:37.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:37 smithi059 ceph-mon[36684]: pgmap v410: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:37.968 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:37 smithi028 ceph-mon[31564]: pgmap v410: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:38.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:37 smithi037 ceph-mon[36609]: pgmap v410: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:39 smithi028 ceph-mon[31564]: pgmap v411: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.963+0000 7fbded600700 1 -- 172.21.15.28:0/2624523429 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbde806a170 msgr2=0x7fbde806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.963+0000 7fbded600700 1 --2- 172.21.15.28:0/2624523429 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbde806a170 0x7fbde806a5f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009990 tx=0x7fbdd0009ca0 comp rx=0 tx=0).stop 2024-06-06T08:42:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.963+0000 7fbded600700 1 -- 172.21.15.28:0/2624523429 shutdown_connections 2024-06-06T08:42:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.963+0000 7fbded600700 1 --2- 172.21.15.28:0/2624523429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde806ab30 0x7fbde810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.963+0000 7fbded600700 1 --2- 172.21.15.28:0/2624523429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde8108500 0x7fbde81088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:39.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.963+0000 7fbded600700 1 --2- 172.21.15.28:0/2624523429 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbde806a170 0x7fbde806a5f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:39.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.963+0000 7fbded600700 1 -- 172.21.15.28:0/2624523429 >> 172.21.15.28:0/2624523429 conn(0x7fbde8078340 msgr2=0x7fbde8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:39.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.963+0000 7fbded600700 1 -- 172.21.15.28:0/2624523429 shutdown_connections 2024-06-06T08:42:39.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.963+0000 7fbded600700 1 -- 172.21.15.28:0/2624523429 wait complete. 2024-06-06T08:42:39.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.964+0000 7fbded600700 1 Processor -- start 2024-06-06T08:42:39.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbded600700 1 -- start start 2024-06-06T08:42:39.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbded600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde806a170 0x7fbde819e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:39.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbded600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbde806ab30 0x7fbde819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbded600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde8108500 0x7fbde8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbded600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbde81127a0 con 0x7fbde806ab30 2024-06-06T08:42:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbded600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbde8112620 con 0x7fbde8108500 2024-06-06T08:42:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbded600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbde8112920 con 0x7fbde806a170 2024-06-06T08:42:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbdde000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbde806ab30 0x7fbde819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbde7400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde8108500 0x7fbde8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbdde000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbde806ab30 0x7fbde819ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35812/0 (socket says 172.21.15.28:35812) 2024-06-06T08:42:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbdde000700 1 -- 172.21.15.28:0/1335531231 learned_addr learned my addr 172.21.15.28:0/1335531231 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.965+0000 7fbde6a00700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde806a170 0x7fbde819e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:39.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.966+0000 7fbdde000700 1 -- 172.21.15.28:0/1335531231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde806a170 msgr2=0x7fbde819e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:39.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.966+0000 7fbdde000700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde806a170 0x7fbde819e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:39.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.966+0000 7fbdde000700 1 -- 172.21.15.28:0/1335531231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde8108500 msgr2=0x7fbde8198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:39.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.966+0000 7fbdde000700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde8108500 0x7fbde8198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:39.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.966+0000 7fbdde000700 1 -- 172.21.15.28:0/1335531231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde8199240 con 0x7fbde806ab30 2024-06-06T08:42:39.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.966+0000 7fbde7400700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde8108500 0x7fbde8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.966+0000 7fbdde000700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbde806ab30 0x7fbde819ee60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0000c00 tx=0x7fbdd000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.967+0000 7fbddfe00700 1 -- 172.21.15.28:0/1335531231 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0027070 con 0x7fbde806ab30 2024-06-06T08:42:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.967+0000 7fbddfe00700 1 -- 172.21.15.28:0/1335531231 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdd0003d70 con 0x7fbde806ab30 2024-06-06T08:42:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.967+0000 7fbded600700 1 -- 172.21.15.28:0/1335531231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde81994d0 con 0x7fbde806ab30 2024-06-06T08:42:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.967+0000 7fbddfe00700 1 -- 172.21.15.28:0/1335531231 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000f460 con 0x7fbde806ab30 2024-06-06T08:42:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.967+0000 7fbded600700 1 -- 172.21.15.28:0/1335531231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde8101390 con 0x7fbde806ab30 2024-06-06T08:42:39.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.968+0000 7fbded600700 1 -- 172.21.15.28:0/1335531231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde810a9e0 con 0x7fbde806ab30 2024-06-06T08:42:39.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.970+0000 7fbddfe00700 1 -- 172.21.15.28:0/1335531231 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbdd002a070 con 0x7fbde806ab30 2024-06-06T08:42:39.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.971+0000 7fbddfe00700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbdcc0a2c20 0x7fbdcc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:39.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.972+0000 7fbddfe00700 1 -- 172.21.15.28:0/1335531231 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fbdd00cfeb0 con 0x7fbde806ab30 2024-06-06T08:42:39.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.972+0000 7fbde6a00700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbdcc0a2c20 0x7fbdcc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:39.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.973+0000 7fbde6a00700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbdcc0a2c20 0x7fbdcc0a50e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800f540 tx=0x7fbdd800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:39.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:39.977+0000 7fbddfe00700 1 -- 172.21.15.28:0/1335531231 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbdd0013070 con 0x7fbde806ab30 2024-06-06T08:42:40.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:39 smithi037 ceph-mon[36609]: pgmap v411: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:40.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:39 smithi059 ceph-mon[36684]: pgmap v411: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:40.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.254+0000 7fbded600700 1 -- 172.21.15.28:0/1335531231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbde8199fd0 con 0x7fbde806ab30 2024-06-06T08:42:40.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.255+0000 7fbddfe00700 1 -- 172.21.15.28:0/1335531231 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11909 (secure 0 0 0) 0x7fbdd009cdc0 con 0x7fbde806ab30 2024-06-06T08:42:40.254 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:42:40.254 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T08:40:05.416261+0000","modified":"2024-06-06T08:40:29.442708+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24542,"mds_1":24503,"mds_2":24499,"mds_3":24485,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14388":{"gid":14388,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6839/735176440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":735176440},{"type":"v1","addr":"172.21.15.28:6839","nonce":735176440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14400":{"gid":14400,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6841/3192274308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":3192274308},{"type":"v1","addr":"172.21.15.28:6841","nonce":3192274308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6839/771325139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":771325139},{"type":"v1","addr":"172.21.15.59:6839","nonce":771325139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.37:6839/527311102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":527311102},{"type":"v1","addr":"172.21.15.37:6839","nonce":527311102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24499,24485,24484,24503,24542]},"id":1}]} 2024-06-06T08:42:40.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.258+0000 7fbded600700 1 -- 172.21.15.28:0/1335531231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbdcc0a2c20 msgr2=0x7fbdcc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:40.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.258+0000 7fbded600700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbdcc0a2c20 0x7fbdcc0a50e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800f540 tx=0x7fbdd800b040 comp rx=0 tx=0).stop 2024-06-06T08:42:40.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.258+0000 7fbded600700 1 -- 172.21.15.28:0/1335531231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbde806ab30 msgr2=0x7fbde819ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:40.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.258+0000 7fbded600700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbde806ab30 0x7fbde819ee60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0000c00 tx=0x7fbdd000bab0 comp rx=0 tx=0).stop 2024-06-06T08:42:40.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.258+0000 7fbded600700 1 -- 172.21.15.28:0/1335531231 shutdown_connections 2024-06-06T08:42:40.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.258+0000 7fbded600700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbdcc0a2c20 0x7fbdcc0a50e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:40.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.258+0000 7fbded600700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbde8108500 0x7fbde8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:40.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.258+0000 7fbded600700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde806a170 0x7fbde819e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:40.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.258+0000 7fbded600700 1 --2- 172.21.15.28:0/1335531231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbde806ab30 0x7fbde819ee60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:40.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.258+0000 7fbded600700 1 -- 172.21.15.28:0/1335531231 >> 172.21.15.28:0/1335531231 conn(0x7fbde8078340 msgr2=0x7fbde81000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:40.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.259+0000 7fbded600700 1 -- 172.21.15.28:0/1335531231 shutdown_connections 2024-06-06T08:42:40.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:40.259+0000 7fbded600700 1 -- 172.21.15.28:0/1335531231 wait complete. 2024-06-06T08:42:40.259 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 28 2024-06-06T08:42:41.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:40 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1335531231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:42:41.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:40 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1335531231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:42:41.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:40 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1335531231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:42:41.144 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T08:42:41.621 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:42:41.954 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:41 smithi028 ceph-mon[31564]: pgmap v412: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:42.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:41 smithi037 ceph-mon[36609]: pgmap v412: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:42.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:41 smithi059 ceph-mon[36684]: pgmap v412: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:43.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.883+0000 7f8014600700 1 -- 172.21.15.28:0/2516692998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c1073e0 msgr2=0x7f800c1077c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:43.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.883+0000 7f8014600700 1 --2- 172.21.15.28:0/2516692998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c1073e0 0x7f800c1077c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8000009990 tx=0x7f8000009ca0 comp rx=0 tx=0).stop 2024-06-06T08:42:43.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.883+0000 7f8014600700 1 -- 172.21.15.28:0/2516692998 shutdown_connections 2024-06-06T08:42:43.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.883+0000 7f8014600700 1 --2- 172.21.15.28:0/2516692998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f800c06b6f0 0x7f800c104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:43.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.883+0000 7f8014600700 1 --2- 172.21.15.28:0/2516692998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c1073e0 0x7f800c1077c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:43.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.883+0000 7f8014600700 1 --2- 172.21.15.28:0/2516692998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800c06ab60 0x7f800c06afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:43.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.883+0000 7f8014600700 1 -- 172.21.15.28:0/2516692998 >> 172.21.15.28:0/2516692998 conn(0x7f800c078340 msgr2=0x7f800c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:43.883 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:43 smithi028 ceph-mon[31564]: pgmap v413: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:43.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.883+0000 7f8014600700 1 -- 172.21.15.28:0/2516692998 shutdown_connections 2024-06-06T08:42:43.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.883+0000 7f8014600700 1 -- 172.21.15.28:0/2516692998 wait complete. 2024-06-06T08:42:43.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.884+0000 7f8014600700 1 Processor -- start 2024-06-06T08:42:43.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8014600700 1 -- start start 2024-06-06T08:42:43.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8014600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f800c06ab60 0x7f800c19f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:43.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8014600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800c06b6f0 0x7f800c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:43.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8014600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c1073e0 0x7f800c1a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:43.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8014600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f800c118e10 con 0x7f800c06ab60 2024-06-06T08:42:43.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8014600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f800c118c90 con 0x7f800c1073e0 2024-06-06T08:42:43.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8014600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f800c118f90 con 0x7f800c06b6f0 2024-06-06T08:42:43.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8011c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f800c06ab60 0x7f800c19f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:43.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8011c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f800c06ab60 0x7f800c19f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35836/0 (socket says 172.21.15.28:35836) 2024-06-06T08:42:43.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8011c00700 1 -- 172.21.15.28:0/1138357384 learned_addr learned my addr 172.21.15.28:0/1138357384 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:43.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8012600700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c1073e0 0x7f800c1a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:43.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.885+0000 7f8011200700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800c06b6f0 0x7f800c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:43.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.886+0000 7f8011c00700 1 -- 172.21.15.28:0/1138357384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800c06b6f0 msgr2=0x7f800c19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:43.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.886+0000 7f8011c00700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800c06b6f0 0x7f800c19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:43.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.886+0000 7f8011c00700 1 -- 172.21.15.28:0/1138357384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c1073e0 msgr2=0x7f800c1a3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:43.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.886+0000 7f8011c00700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c1073e0 0x7f800c1a3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:43.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.886+0000 7f8011c00700 1 -- 172.21.15.28:0/1138357384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800c1a4280 con 0x7f800c06ab60 2024-06-06T08:42:43.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.886+0000 7f8011200700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800c06b6f0 0x7f800c19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:42:43.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.886+0000 7f8012600700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c1073e0 0x7f800c1a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:43.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.886+0000 7f8011c00700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f800c06ab60 0x7f800c19f2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8000000c00 tx=0x7f800000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:43.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.886+0000 7f800a000700 1 -- 172.21.15.28:0/1138357384 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000027070 con 0x7f800c06ab60 2024-06-06T08:42:43.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.887+0000 7f800a000700 1 -- 172.21.15.28:0/1138357384 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8000003d70 con 0x7f800c06ab60 2024-06-06T08:42:43.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.887+0000 7f8014600700 1 -- 172.21.15.28:0/1138357384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800c1a4510 con 0x7f800c06ab60 2024-06-06T08:42:43.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.887+0000 7f800a000700 1 -- 172.21.15.28:0/1138357384 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800000f460 con 0x7f800c06ab60 2024-06-06T08:42:43.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.887+0000 7f8014600700 1 -- 172.21.15.28:0/1138357384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800c1abdf0 con 0x7f800c06ab60 2024-06-06T08:42:43.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.888+0000 7f8014600700 1 -- 172.21.15.28:0/1138357384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f800c1019d0 con 0x7f800c06ab60 2024-06-06T08:42:43.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.890+0000 7f800a000700 1 -- 172.21.15.28:0/1138357384 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f800002a070 con 0x7f800c06ab60 2024-06-06T08:42:43.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.891+0000 7f800a000700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7ff40a2c20 0x7f7ff40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:43.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.891+0000 7f800a000700 1 -- 172.21.15.28:0/1138357384 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f80000cfe20 con 0x7f800c06ab60 2024-06-06T08:42:43.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.892+0000 7f8011200700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7ff40a2c20 0x7f7ff40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:43.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.892+0000 7f8011200700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7ff40a2c20 0x7f7ff40a50e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f800c107a50 tx=0x7f7ff8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:43.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:43.896+0000 7f800a000700 1 -- 172.21.15.28:0/1138357384 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8000013070 con 0x7f800c06ab60 2024-06-06T08:42:44.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:43 smithi037 ceph-mon[36609]: pgmap v413: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:44.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:43 smithi059 ceph-mon[36684]: pgmap v413: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:44.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.131+0000 7f8014600700 1 -- 172.21.15.28:0/1138357384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f800c1abfc0 con 0x7f800c06ab60 2024-06-06T08:42:44.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.135+0000 7f800a000700 1 -- 172.21.15.28:0/1138357384 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+22770 (secure 0 0 0) 0x7f800009cd30 con 0x7f800c06ab60 2024-06-06T08:42:44.135 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:42:44.135 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":92,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","created":"2024-06-06T08:30:30.991501+0000","modified":"2024-06-06T08:41:41.833381+0000","last_up_change":"2024-06-06T08:38:45.850887+0000","last_in_change":"2024-06-06T08:38:26.532528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T08:34:26.800168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T08:39:56.375661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T08:40:01.096994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7edaffea-7613-4d20-b9b8-108a17af8f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6803","nonce":2001709636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6805","nonce":2001709636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6809","nonce":2001709636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6807","nonce":2001709636}]},"public_addr":"172.21.15.28:6803/2001709636","cluster_addr":"172.21.15.28:6805/2001709636","heartbeat_back_addr":"172.21.15.28:6809/2001709636","heartbeat_front_addr":"172.21.15.28:6807/2001709636","state":["exists","up"]},{"osd":1,"uuid":"17eb7536-c2a4-4f8b-bec4-b1abb5125836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6801","nonce":593429648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6803","nonce":593429648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6807","nonce":593429648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6805","nonce":593429648}]},"public_addr":"172.21.15.37:6801/593429648","cluster_addr":"172.21.15.37:6803/593429648","heartbeat_back_addr":"172.21.15.37:6807/593429648","heartbeat_front_addr":"172.21.15.37:6805/593429648","state":["exists","up"]},{"osd":2,"uuid":"3ea64fd8-13f4-4d53-933b-07055ec72701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6801","nonce":88678886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6803","nonce":88678886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6807","nonce":88678886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6805","nonce":88678886}]},"public_addr":"172.21.15.59:6801/88678886","cluster_addr":"172.21.15.59:6803/88678886","heartbeat_back_addr":"172.21.15.59:6807/88678886","heartbeat_front_addr":"172.21.15.59:6805/88678886","state":["exists","up"]},{"osd":3,"uuid":"8be9cdb5-12a9-438e-b8cd-ce65988b0ac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6811","nonce":484290430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6813","nonce":484290430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6817","nonce":484290430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6815","nonce":484290430}]},"public_addr":"172.21.15.28:6811/484290430","cluster_addr":"172.21.15.28:6813/484290430","heartbeat_back_addr":"172.21.15.28:6817/484290430","heartbeat_front_addr":"172.21.15.28:6815/484290430","state":["exists","up"]},{"osd":4,"uuid":"ddea397d-d7b1-46f3-9a13-dd318cade055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6809","nonce":3596500266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6811","nonce":3596500266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6815","nonce":3596500266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6813","nonce":3596500266}]},"public_addr":"172.21.15.37:6809/3596500266","cluster_addr":"172.21.15.37:6811/3596500266","heartbeat_back_addr":"172.21.15.37:6815/3596500266","heartbeat_front_addr":"172.21.15.37:6813/3596500266","state":["exists","up"]},{"osd":5,"uuid":"ee19857b-b047-4d15-8b17-257b6e4966a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6809","nonce":3037648282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6811","nonce":3037648282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6815","nonce":3037648282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6813","nonce":3037648282}]},"public_addr":"172.21.15.59:6809/3037648282","cluster_addr":"172.21.15.59:6811/3037648282","heartbeat_back_addr":"172.21.15.59:6815/3037648282","heartbeat_front_addr":"172.21.15.59:6813/3037648282","state":["exists","up"]},{"osd":6,"uuid":"1d57d0ba-8e37-4ac2-87e8-40b20b24fc53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6819","nonce":3794924886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6821","nonce":3794924886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6825","nonce":3794924886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6823","nonce":3794924886}]},"public_addr":"172.21.15.28:6819/3794924886","cluster_addr":"172.21.15.28:6821/3794924886","heartbeat_back_addr":"172.21.15.28:6825/3794924886","heartbeat_front_addr":"172.21.15.28:6823/3794924886","state":["exists","up"]},{"osd":7,"uuid":"43f3c2c8-752d-4a70-99dd-2c14aeefa137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6817","nonce":724042860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6819","nonce":724042860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6823","nonce":724042860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6821","nonce":724042860}]},"public_addr":"172.21.15.37:6817/724042860","cluster_addr":"172.21.15.37:6819/724042860","heartbeat_back_addr":"172.21.15.37:6823/724042860","heartbeat_front_addr":"172.21.15.37:6821/724042860","state":["exists","up"]},{"osd":8,"uuid":"3ffc07d7-ca79-419d-88a4-2b53d07ffae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6817","nonce":1240363223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6819","nonce":1240363223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6823","nonce":1240363223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6821","nonce":1240363223}]},"public_addr":"172.21.15.59:6817/1240363223","cluster_addr":"172.21.15.59:6819/1240363223","heartbeat_back_addr":"172.21.15.59:6823/1240363223","heartbeat_front_addr":"172.21.15.59:6821/1240363223","state":["exists","up"]},{"osd":9,"uuid":"4e014fc7-1ca3-4d6c-acdd-95ca59541310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6827","nonce":2555848355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6829","nonce":2555848355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6833","nonce":2555848355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6831","nonce":2555848355}]},"public_addr":"172.21.15.28:6827/2555848355","cluster_addr":"172.21.15.28:6829/2555848355","heartbeat_back_addr":"172.21.15.28:6833/2555848355","heartbeat_front_addr":"172.21.15.28:6831/2555848355","state":["exists","up"]},{"osd":10,"uuid":"fc418661-5e89-4241-b14b-241a2be432f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6825","nonce":176857372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6827","nonce":176857372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6831","nonce":176857372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6829","nonce":176857372}]},"public_addr":"172.21.15.37:6825/176857372","cluster_addr":"172.21.15.37:6827/176857372","heartbeat_back_addr":"172.21.15.37:6831/176857372","heartbeat_front_addr":"172.21.15.37:6829/176857372","state":["exists","up"]},{"osd":11,"uuid":"e54d81ee-1461-4229-a1c0-c6e750dd66ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6825","nonce":2675673798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6827","nonce":2675673798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6831","nonce":2675673798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6829","nonce":2675673798}]},"public_addr":"172.21.15.59:6825/2675673798","cluster_addr":"172.21.15.59:6827/2675673798","heartbeat_back_addr":"172.21.15.59:6831/2675673798","heartbeat_front_addr":"172.21.15.59:6829/2675673798","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:33.904270+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:58.988528+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:22.997033+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:57.171455+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:23.594371+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:48.928423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:22.957203+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:50.599655+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:16.166981+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:50.755673+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:18.677280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:44.432598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":5,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1f","mappings":[{"from":1,"to":2}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/4230567915":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/2860387445":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/886961600":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/3217551014":"2024-06-07T08:31:40.064884+0000","172.21.15.28:0/1629731223":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/219831273":"2024-06-07T08:31:04.770627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T08:42:44.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 -- 172.21.15.28:0/1138357384 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7ff40a2c20 msgr2=0x7f7ff40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:44.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7ff40a2c20 0x7f7ff40a50e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f800c107a50 tx=0x7f7ff8009260 comp rx=0 tx=0).stop 2024-06-06T08:42:44.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 -- 172.21.15.28:0/1138357384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f800c06ab60 msgr2=0x7f800c19f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:44.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f800c06ab60 0x7f800c19f2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8000000c00 tx=0x7f800000bab0 comp rx=0 tx=0).stop 2024-06-06T08:42:44.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 -- 172.21.15.28:0/1138357384 shutdown_connections 2024-06-06T08:42:44.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f7ff40a2c20 0x7f7ff40a50e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:44.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c1073e0 0x7f800c1a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:44.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f800c06ab60 0x7f800c19f2c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:44.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 --2- 172.21.15.28:0/1138357384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800c06b6f0 0x7f800c19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 -- 172.21.15.28:0/1138357384 >> 172.21.15.28:0/1138357384 conn(0x7f800c078340 msgr2=0x7f800c100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 -- 172.21.15.28:0/1138357384 shutdown_connections 2024-06-06T08:42:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:44.139+0000 7f8014600700 1 -- 172.21.15.28:0/1138357384 wait complete. 2024-06-06T08:42:44.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:44 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1138357384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:42:45.039 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:42:45.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:44 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1138357384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:42:45.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:44 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1138357384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:42:45.505 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:42:45.982 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:45 smithi028 ceph-mon[31564]: pgmap v414: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:46.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:45 smithi037 ceph-mon[36609]: pgmap v414: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:46.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:45 smithi059 ceph-mon[36684]: pgmap v414: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:47.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.694+0000 7f9a50000700 1 -- 172.21.15.28:0/3836490801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a4806ab30 msgr2=0x7f9a4810f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:47.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.694+0000 7f9a50000700 1 --2- 172.21.15.28:0/3836490801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a4806ab30 0x7f9a4810f320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000b0a0 tx=0x7f9a4000b3b0 comp rx=0 tx=0).stop 2024-06-06T08:42:47.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.694+0000 7f9a50000700 1 -- 172.21.15.28:0/3836490801 shutdown_connections 2024-06-06T08:42:47.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.694+0000 7f9a50000700 1 --2- 172.21.15.28:0/3836490801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a4806ab30 0x7f9a4810f320 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:47.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.694+0000 7f9a50000700 1 --2- 172.21.15.28:0/3836490801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a48108500 0x7f9a481088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:47.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.694+0000 7f9a50000700 1 --2- 172.21.15.28:0/3836490801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a4806a170 0x7f9a4806a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:47.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.694+0000 7f9a50000700 1 -- 172.21.15.28:0/3836490801 >> 172.21.15.28:0/3836490801 conn(0x7f9a48078340 msgr2=0x7f9a48078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:47.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.694+0000 7f9a50000700 1 -- 172.21.15.28:0/3836490801 shutdown_connections 2024-06-06T08:42:47.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.694+0000 7f9a50000700 1 -- 172.21.15.28:0/3836490801 wait complete. 2024-06-06T08:42:47.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.695+0000 7f9a50000700 1 Processor -- start 2024-06-06T08:42:47.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.695+0000 7f9a50000700 1 -- start start 2024-06-06T08:42:47.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a50000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a4806a170 0x7f9a4819ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:47.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a50000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a4806ab30 0x7f9a4819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:47.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a50000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a48108500 0x7f9a4819f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:47.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a50000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48112760 con 0x7f9a4806a170 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a50000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a481125e0 con 0x7f9a48108500 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a50000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9a481128e0 con 0x7f9a4806ab30 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a4e000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a48108500 0x7f9a4819f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a4d600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a4806a170 0x7f9a4819ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a4cc00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a4806ab30 0x7f9a4819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a4e000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a48108500 0x7f9a4819f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:44396/0 (socket says 172.21.15.28:44396) 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a4e000700 1 -- 172.21.15.28:0/3266473248 learned_addr learned my addr 172.21.15.28:0/3266473248 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a4e000700 1 -- 172.21.15.28:0/3266473248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a4806ab30 msgr2=0x7f9a4819b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a4e000700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a4806ab30 0x7f9a4819b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a4e000700 1 -- 172.21.15.28:0/3266473248 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a4806a170 msgr2=0x7f9a4819ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a4e000700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a4806a170 0x7f9a4819ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.696+0000 7f9a4e000700 1 -- 172.21.15.28:0/3266473248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4819fe30 con 0x7f9a48108500 2024-06-06T08:42:47.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.697+0000 7f9a4d600700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a4806a170 0x7f9a4819ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:47.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.697+0000 7f9a4e000700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a48108500 0x7f9a4819f6f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000b780 tx=0x7f9a40004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:47.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.697+0000 7f9a46000700 1 -- 172.21.15.28:0/3266473248 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40021070 con 0x7f9a48108500 2024-06-06T08:42:47.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.697+0000 7f9a46000700 1 -- 172.21.15.28:0/3266473248 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a40007b80 con 0x7f9a48108500 2024-06-06T08:42:47.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.697+0000 7f9a46000700 1 -- 172.21.15.28:0/3266473248 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a400052a0 con 0x7f9a48108500 2024-06-06T08:42:47.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.697+0000 7f9a50000700 1 -- 172.21.15.28:0/3266473248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a481a00c0 con 0x7f9a48108500 2024-06-06T08:42:47.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.697+0000 7f9a50000700 1 -- 172.21.15.28:0/3266473248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a481a79a0 con 0x7f9a48108500 2024-06-06T08:42:47.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.698+0000 7f9a50000700 1 -- 172.21.15.28:0/3266473248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a48069180 con 0x7f9a48108500 2024-06-06T08:42:47.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.700+0000 7f9a46000700 1 -- 172.21.15.28:0/3266473248 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9a40024070 con 0x7f9a48108500 2024-06-06T08:42:47.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.702+0000 7f9a46000700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a300a2ca0 0x7f9a300a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:47.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.702+0000 7f9a46000700 1 -- 172.21.15.28:0/3266473248 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f9a4000f020 con 0x7f9a48108500 2024-06-06T08:42:47.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.702+0000 7f9a4d600700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a300a2ca0 0x7f9a300a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:47.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.703+0000 7f9a4d600700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a300a2ca0 0x7f9a300a5160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009fd0 tx=0x7f9a3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:47.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.707+0000 7f9a46000700 1 -- 172.21.15.28:0/3266473248 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9a4002b020 con 0x7f9a48108500 2024-06-06T08:42:47.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:47 smithi028 ceph-mon[31564]: pgmap v415: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.985+0000 7f9a50000700 1 -- 172.21.15.28:0/3266473248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a481a7b70 con 0x7f9a48108500 2024-06-06T08:42:47.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.986+0000 7f9a46000700 1 -- 172.21.15.28:0/3266473248 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11909 (secure 0 0 0) 0x7f9a40007d30 con 0x7f9a48108500 2024-06-06T08:42:47.985 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:42:47.985 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T08:40:05.416261+0000","modified":"2024-06-06T08:40:29.442708+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24542,"mds_1":24503,"mds_2":24499,"mds_3":24485,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14388":{"gid":14388,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6839/735176440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":735176440},{"type":"v1","addr":"172.21.15.28:6839","nonce":735176440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14400":{"gid":14400,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6841/3192274308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":3192274308},{"type":"v1","addr":"172.21.15.28:6841","nonce":3192274308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6839/771325139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":771325139},{"type":"v1","addr":"172.21.15.59:6839","nonce":771325139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.37:6839/527311102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":527311102},{"type":"v1","addr":"172.21.15.37:6839","nonce":527311102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24499,24485,24484,24503,24542]},"id":1}]} 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 -- 172.21.15.28:0/3266473248 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a300a2ca0 msgr2=0x7f9a300a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a300a2ca0 0x7f9a300a5160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009fd0 tx=0x7f9a3c009260 comp rx=0 tx=0).stop 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 -- 172.21.15.28:0/3266473248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a48108500 msgr2=0x7f9a4819f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a48108500 0x7f9a4819f6f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000b780 tx=0x7f9a40004d00 comp rx=0 tx=0).stop 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 -- 172.21.15.28:0/3266473248 shutdown_connections 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a300a2ca0 0x7f9a300a5160 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a48108500 0x7f9a4819f6f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a4806a170 0x7f9a4819ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 --2- 172.21.15.28:0/3266473248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a4806ab30 0x7f9a4819b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 -- 172.21.15.28:0/3266473248 >> 172.21.15.28:0/3266473248 conn(0x7f9a48078340 msgr2=0x7f9a480ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 -- 172.21.15.28:0/3266473248 shutdown_connections 2024-06-06T08:42:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:47.989+0000 7f9a50000700 1 -- 172.21.15.28:0/3266473248 wait complete. 2024-06-06T08:42:47.989 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 28 2024-06-06T08:42:48.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:47 smithi037 ceph-mon[36609]: pgmap v415: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:48.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:47 smithi059 ceph-mon[36684]: pgmap v415: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:48.935 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-06T08:40:05.416261+0000', 'modified': '2024-06-06T08:40:29.442708+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24542, 'mds_1': 24503, 'mds_2': 24499, 'mds_3': 24485, 'mds_4': 24484}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14388': {'gid': 14388, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.28:6839/735176440', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6838', 'nonce': 735176440}, {'type': 'v1', 'addr': '172.21.15.28:6839', 'nonce': 735176440}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14400': {'gid': 14400, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.28:6841/3192274308', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6840', 'nonce': 3192274308}, {'type': 'v1', 'addr': '172.21.15.28:6841', 'nonce': 3192274308}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24436': {'gid': 24436, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6833/3120575580', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3120575580}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3120575580}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24455': {'gid': 24455, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6833/1955606328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 1955606328}, {'type': 'v1', 'addr': '172.21.15.37:6833', 'nonce': 1955606328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6835/2983089313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 2983089313}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2983089313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.59:6837/2388488967', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6836', 'nonce': 2388488967}, {'type': 'v1', 'addr': '172.21.15.59:6837', 'nonce': 2388488967}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.37:6835/2566253946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 2566253946}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 2566253946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.59:6839/771325139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6838', 'nonce': 771325139}, {'type': 'v1', 'addr': '172.21.15.59:6839', 'nonce': 771325139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.37:6837/1443905946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6836', 'nonce': 1443905946}, {'type': 'v1', 'addr': '172.21.15.37:6837', 'nonce': 1443905946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24542': {'gid': 24542, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.37:6839/527311102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 527311102}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 527311102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24542, 'qdb_cluster': [24499, 24485, 24484, 24503, 24542]} 2024-06-06T08:42:48.935 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-06-06T08:42:48.936 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell mds.c status 2024-06-06T08:42:49.018 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:48 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/3266473248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:42:49.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:48 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/3266473248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:42:49.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:48 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/3266473248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:42:49.410 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:42:49.925 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:49 smithi028 ceph-mon[31564]: pgmap v416: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:50.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:49 smithi037 ceph-mon[36609]: pgmap v416: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:50.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:49 smithi059 ceph-mon[36684]: pgmap v416: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:42:51.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.698+0000 7fbb80c00700 1 -- 172.21.15.28:0/4003379473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c10a670 msgr2=0x7fbb7c10aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:51.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.698+0000 7fbb80c00700 1 --2- 172.21.15.28:0/4003379473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c10a670 0x7fbb7c10aa50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0099c0 tx=0x7fbb6c009cd0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.699+0000 7fbb80c00700 1 -- 172.21.15.28:0/4003379473 shutdown_connections 2024-06-06T08:42:51.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.699+0000 7fbb80c00700 1 --2- 172.21.15.28:0/4003379473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c104f80 0x7fbb7c111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.699+0000 7fbb80c00700 1 --2- 172.21.15.28:0/4003379473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c10a670 0x7fbb7c10aa50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.699+0000 7fbb80c00700 1 --2- 172.21.15.28:0/4003379473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb7c1045c0 0x7fbb7c104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.699+0000 7fbb80c00700 1 -- 172.21.15.28:0/4003379473 >> 172.21.15.28:0/4003379473 conn(0x7fbb7c100070 msgr2=0x7fbb7c102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:51.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.699+0000 7fbb80c00700 1 -- 172.21.15.28:0/4003379473 shutdown_connections 2024-06-06T08:42:51.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.699+0000 7fbb80c00700 1 -- 172.21.15.28:0/4003379473 wait complete. 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.700+0000 7fbb80c00700 1 Processor -- start 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.700+0000 7fbb80c00700 1 -- start start 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.700+0000 7fbb80c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c1045c0 0x7fbb7c19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.700+0000 7fbb80c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c104f80 0x7fbb7c19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.700+0000 7fbb80c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb7c10a670 0x7fbb7c19f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb80c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c114930 con 0x7fbb7c10a670 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb80c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c1147b0 con 0x7fbb7c104f80 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb80c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c114ab0 con 0x7fbb7c1045c0 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb7b400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c1045c0 0x7fbb7c19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb7b400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c1045c0 0x7fbb7c19ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:38010/0 (socket says 172.21.15.28:38010) 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb7b400700 1 -- 172.21.15.28:0/496213673 learned_addr learned my addr 172.21.15.28:0/496213673 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb7be00700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb7c10a670 0x7fbb7c19f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb73e00700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c104f80 0x7fbb7c19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb7b400700 1 -- 172.21.15.28:0/496213673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c104f80 msgr2=0x7fbb7c19b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:51.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb7b400700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c104f80 0x7fbb7c19b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb7b400700 1 -- 172.21.15.28:0/496213673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb7c10a670 msgr2=0x7fbb7c19f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:51.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb7b400700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb7c10a670 0x7fbb7c19f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.701+0000 7fbb7b400700 1 -- 172.21.15.28:0/496213673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7c19fd30 con 0x7fbb7c1045c0 2024-06-06T08:42:51.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.702+0000 7fbb7b400700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c1045c0 0x7fbb7c19ad20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c005910 tx=0x7fbb6c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:51.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.702+0000 7fbb78c00700 1 -- 172.21.15.28:0/496213673 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c027070 con 0x7fbb7c1045c0 2024-06-06T08:42:51.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.702+0000 7fbb78c00700 1 -- 172.21.15.28:0/496213673 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb6c003680 con 0x7fbb7c1045c0 2024-06-06T08:42:51.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.702+0000 7fbb78c00700 1 -- 172.21.15.28:0/496213673 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0173f0 con 0x7fbb7c1045c0 2024-06-06T08:42:51.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.702+0000 7fbb80c00700 1 -- 172.21.15.28:0/496213673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7c19ffc0 con 0x7fbb7c1045c0 2024-06-06T08:42:51.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.702+0000 7fbb80c00700 1 -- 172.21.15.28:0/496213673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7c1a78a0 con 0x7fbb7c1045c0 2024-06-06T08:42:51.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.705+0000 7fbb78c00700 1 -- 172.21.15.28:0/496213673 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbb6c022590 con 0x7fbb7c1045c0 2024-06-06T08:42:51.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.706+0000 7fbb78c00700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbb600a2ca0 0x7fbb600a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.707+0000 7fbb78c00700 1 -- 172.21.15.28:0/496213673 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fbb6c0cfae0 con 0x7fbb7c1045c0 2024-06-06T08:42:51.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.707+0000 7fbb73e00700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbb600a2ca0 0x7fbb600a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.707+0000 7fbb8cb3bb80 1 Processor -- start 2024-06-06T08:42:51.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.707+0000 7fbb8cb3bb80 1 -- start start 2024-06-06T08:42:51.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb73e00700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbb600a2ca0 0x7fbb600a5160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c109be0 tx=0x7fbb64009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:51.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ebf33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebf3910 0x55a39ebf3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebfc520 0x55a39ebfe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55a39eb009c0 con 0x55a39eb6ddf0 2024-06-06T08:42:51.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a39eb43ab0 con 0x55a39ebf3910 2024-06-06T08:42:51.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a39eafe8a0 con 0x55a39ebfc520 2024-06-06T08:42:51.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb7b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ebf33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb7b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ebf33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59766/0 (socket says 172.21.15.28:59766) 2024-06-06T08:42:51.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb7b400700 1 -- 172.21.15.28:0/1413039431 learned_addr learned my addr 172.21.15.28:0/1413039431 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:51.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb7be00700 1 --2- 172.21.15.28:0/1413039431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebfc520 0x55a39ebfe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb73e00700 1 --2- 172.21.15.28:0/1413039431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebf3910 0x55a39ebf3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb7b400700 1 -- 172.21.15.28:0/1413039431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebfc520 msgr2=0x55a39ebfe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:51.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb7b400700 1 --2- 172.21.15.28:0/1413039431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebfc520 0x55a39ebfe910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.708+0000 7fbb7b400700 1 -- 172.21.15.28:0/1413039431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebf3910 msgr2=0x55a39ebf3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:51.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.709+0000 7fbb7b400700 1 --2- 172.21.15.28:0/1413039431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebf3910 0x55a39ebf3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.709+0000 7fbb7b400700 1 -- 172.21.15.28:0/1413039431 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a39eaebf40 con 0x55a39eb6ddf0 2024-06-06T08:42:51.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.709+0000 7fbb73e00700 1 --2- 172.21.15.28:0/1413039431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebf3910 0x55a39ebf3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T08:42:51.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.709+0000 7fbb7b400700 1 --2- 172.21.15.28:0/1413039431 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ebf33d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c098750 tx=0x7fbb6c022930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c3880ca7267b9e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:51.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.709+0000 7fbb70c00700 1 -- 172.21.15.28:0/1413039431 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c096e60 con 0x55a39eb6ddf0 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.709+0000 7fbb70c00700 1 -- 172.21.15.28:0/1413039431 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb6c09c2f0 con 0x55a39eb6ddf0 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.709+0000 7fbb70c00700 1 -- 172.21.15.28:0/1413039431 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0a4ca0 con 0x55a39eb6ddf0 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.710+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/1413039431 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 msgr2=0x55a39ebf33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.710+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/1413039431 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ebf33d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c098750 tx=0x7fbb6c022930 comp rx=0 tx=0).stop 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.710+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/1413039431 shutdown_connections 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.710+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/1413039431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebfc520 0x55a39ebfe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.710+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/1413039431 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ebf33d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.710+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/1413039431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebf3910 0x55a39ebf3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.710+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/1413039431 >> 172.21.15.28:0/1413039431 conn(0x55a39eb1e120 msgr2=0x55a39ebed7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.710+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/1413039431 shutdown_connections 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.710+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/1413039431 wait complete. 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.711+0000 7fbb8cb3bb80 1 -- start start 2024-06-06T08:42:51.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.711+0000 7fbb8cb3bb80 1 Processor -- start 2024-06-06T08:42:51.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.711+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39eb6ddf0 0x55a39ebfbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39ebfc520 0x55a39ebf9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55a39eadff10 con 0x55a39ebfc520 2024-06-06T08:42:51.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a39eb3fa70 con 0x55a39eb6ddf0 2024-06-06T08:42:51.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a39ebfef40 con 0x55a39ebf3910 2024-06-06T08:42:51.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb8cb3bb80 10 client.0 _ll_register_callbacks cb 0x55a39eadd6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:42:51.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb7be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39ebfc520 0x55a39ebf9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb73e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb7be00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39ebfc520 0x55a39ebf9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59780/0 (socket says 172.21.15.28:59780) 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb7be00700 1 -- 172.21.15.28:0/527860434 learned_addr learned my addr 172.21.15.28:0/527860434 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb7b400700 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39eb6ddf0 0x55a39ebfbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb73e00700 1 -- 172.21.15.28:0/527860434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39eb6ddf0 msgr2=0x55a39ebfbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb73e00700 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39eb6ddf0 0x55a39ebfbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb73e00700 1 -- 172.21.15.28:0/527860434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39ebfc520 msgr2=0x55a39ebf9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb73e00700 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39ebfc520 0x55a39ebf9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb73e00700 1 -- 172.21.15.28:0/527860434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a39ea92880 con 0x55a39ebf3910 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.712+0000 7fbb7b400700 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39eb6ddf0 0x55a39ebfbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.713+0000 7fbb73e00700 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf9000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbb640117d0 tx=0x7fbb640047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9aa9cf659a74493 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.713+0000 7fbb69600700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-06-06T08:42:51.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.713+0000 7fbb69600700 1 -- 172.21.15.28:0/527860434 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6401de70 con 0x55a39ebf3910 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.713+0000 7fbb69600700 1 -- 172.21.15.28:0/527860434 <== mon.1 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fbb64004020 con 0x55a39ebf3910 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.713+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/527860434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb6c09c2f0 con 0x55a39ebf3910 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.713+0000 7fbb69600700 1 -- 172.21.15.28:0/527860434 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb64004220 con 0x55a39ebf3910 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.713+0000 7fbb8cb3bb80 10 client.24877 fetch_fsmap learned FSMap version 28 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.713+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/527860434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a39ec09620 con 0x55a39ebf3910 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.714+0000 7fbb69600700 1 -- 172.21.15.28:0/527860434 <== mon.1 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb6c09c2f0 con 0x55a39ebf3910 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.714+0000 7fbb69600700 1 -- 172.21.15.28:0/527860434 <== mon.1 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbb6401e7f0 con 0x55a39ebf3910 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.714+0000 7fbb8cb3bb80 10 client.24877 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.714+0000 7fbb8cb3bb80 10 client.24877 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.714+0000 7fbb8cb3bb80 20 client.24877 populate_metadata read hostname 'smithi028' 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.714+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x55a39ec0bc40 0x55a39ec0d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.714+0000 7fbb8cb3bb80 4 client.24877 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T08:42:51.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.714+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/527860434 --> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a39eb50fb0 con 0x55a39ec0bc40 2024-06-06T08:42:51.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.715+0000 7fbb7b400700 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x55a39ec0bc40 0x55a39ec0d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.715+0000 7fbb7b400700 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x55a39ec0bc40 0x55a39ec0d0b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7fb796efdd503ca0 server_cookie=89619c9ca95db34 in_seq=0 out_seq=0 2024-06-06T08:42:51.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.715+0000 7fbb69600700 10 client.24877 ms_handle_connect on v2:172.21.15.59:6836/2388488967 2024-06-06T08:42:51.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb69600700 1 -- 172.21.15.28:0/527860434 <== mds.4 v2:172.21.15.59:6836/2388488967 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a39eb50fb0 con 0x55a39ec0bc40 2024-06-06T08:42:51.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb69600700 10 client.24877 handle_command_reply: tid=0 2024-06-06T08:42:51.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb8cb3bb80 1 client.24877 shutdown 2024-06-06T08:42:51.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/527860434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 msgr2=0x55a39ebf9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:51.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf9000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbb640117d0 tx=0x7fbb640047c0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/527860434 shutdown_connections 2024-06-06T08:42:51.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x55a39ec0bc40 0x55a39ec0d0b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39ebfc520 0x55a39ebf9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39eb6ddf0 0x55a39ebfbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/527860434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf9000 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/527860434 >> 172.21.15.28:0/527860434 conn(0x55a39eb1e120 msgr2=0x55a39ebed3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:51.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.716+0000 7fbb69600700 0 client.24877 ms_handle_reset on v2:172.21.15.59:6836/2388488967 2024-06-06T08:42:51.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.717+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/527860434 shutdown_connections 2024-06-06T08:42:51.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.717+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/527860434 wait complete. 2024-06-06T08:42:51.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.717+0000 7fbb8cb3bb80 20 client.24877 trim_cache size 0 max 16384 2024-06-06T08:42:51.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.740+0000 7fbb8cb3bb80 1 Processor -- start 2024-06-06T08:42:51.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.740+0000 7fbb8cb3bb80 1 -- start start 2024-06-06T08:42:51.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ebebe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebfc520 0x55a39ebf62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55a39ec0b3f0 con 0x55a39eb6ddf0 2024-06-06T08:42:51.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a39ec0bac0 con 0x55a39ebfc520 2024-06-06T08:42:51.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a39ec0c190 con 0x55a39ebf3910 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb7b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ebebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb73e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb7b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ebebe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59792/0 (socket says 172.21.15.28:59792) 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb7b400700 1 -- 172.21.15.28:0/3215926546 learned_addr learned my addr 172.21.15.28:0/3215926546 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb7be00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebfc520 0x55a39ebf62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb73e00700 1 -- 172.21.15.28:0/3215926546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebfc520 msgr2=0x55a39ebf62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb73e00700 1 --2- 172.21.15.28:0/3215926546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebfc520 0x55a39ebf62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb73e00700 1 -- 172.21.15.28:0/3215926546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 msgr2=0x55a39ebebe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb73e00700 1 --2- 172.21.15.28:0/3215926546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ebebe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb73e00700 1 -- 172.21.15.28:0/3215926546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a39ebee9d0 con 0x55a39ebf3910 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.741+0000 7fbb7be00700 1 --2- 172.21.15.28:0/3215926546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebfc520 0x55a39ebf62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:51.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.742+0000 7fbb73e00700 1 --2- 172.21.15.28:0/3215926546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf9590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbb6401ec90 tx=0x7fbb64009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ad95cfa5d6a6349 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:51.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.742+0000 7fbb6be00700 1 -- 172.21.15.28:0/3215926546 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb640043c0 con 0x55a39ebf3910 2024-06-06T08:42:51.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.742+0000 7fbb6be00700 1 -- 172.21.15.28:0/3215926546 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb64004560 con 0x55a39ebf3910 2024-06-06T08:42:51.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.742+0000 7fbb6be00700 1 -- 172.21.15.28:0/3215926546 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64030cf0 con 0x55a39ebf3910 2024-06-06T08:42:51.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.743+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3215926546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 msgr2=0x55a39ebf9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:51.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.743+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/3215926546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf9590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbb6401ec90 tx=0x7fbb64009040 comp rx=0 tx=0).stop 2024-06-06T08:42:51.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.743+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3215926546 shutdown_connections 2024-06-06T08:42:51.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.743+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/3215926546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebfc520 0x55a39ebf62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.743+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/3215926546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ebebe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.743+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/3215926546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf9590 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.743+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3215926546 >> 172.21.15.28:0/3215926546 conn(0x55a39eb1e120 msgr2=0x55a39ebf7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:51.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.743+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3215926546 shutdown_connections 2024-06-06T08:42:51.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.743+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3215926546 wait complete. 2024-06-06T08:42:51.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.743+0000 7fbb8cb3bb80 1 -- start start 2024-06-06T08:42:51.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb8cb3bb80 1 Processor -- start 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ec16a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb8cb3bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebfc520 0x55a39ebf6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55a39ec0cf30 con 0x55a39eb6ddf0 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a39ec0c860 con 0x55a39ebfc520 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb8cb3bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a39ec0d600 con 0x55a39ebf3910 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb8cb3bb80 10 client.0 _ll_register_callbacks cb 0x55a39eadd6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb7b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ec16a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb73e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb7b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ec16a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59796/0 (socket says 172.21.15.28:59796) 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.744+0000 7fbb73e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:38058/0 (socket says 172.21.15.28:38058) 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.745+0000 7fbb7b400700 1 -- 172.21.15.28:0/3605784785 learned_addr learned my addr 172.21.15.28:0/3605784785 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.745+0000 7fbb7be00700 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebfc520 0x55a39ebf6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.745+0000 7fbb73e00700 1 -- 172.21.15.28:0/3605784785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebfc520 msgr2=0x55a39ebf6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:51.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.745+0000 7fbb73e00700 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebfc520 0x55a39ebf6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.745+0000 7fbb73e00700 1 -- 172.21.15.28:0/3605784785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 msgr2=0x55a39ec16a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:51.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.745+0000 7fbb73e00700 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ec16a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.745+0000 7fbb73e00700 1 -- 172.21.15.28:0/3605784785 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a39ebf6610 con 0x55a39ebf3910 2024-06-06T08:42:51.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.745+0000 7fbb7b400700 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ec16a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:51.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.745+0000 7fbb73e00700 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf5b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55a39ebf7770 tx=0x7fbb64005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef4e38b3b3a405fd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:51.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.745+0000 7fbb69600700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-06-06T08:42:51.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.745+0000 7fbb69600700 1 -- 172.21.15.28:0/3605784785 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6401ea20 con 0x55a39ebf3910 2024-06-06T08:42:51.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.746+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3605784785 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb64004560 con 0x55a39ebf3910 2024-06-06T08:42:51.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.746+0000 7fbb69600700 1 -- 172.21.15.28:0/3605784785 <== mon.1 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fbb64005480 con 0x55a39ebf3910 2024-06-06T08:42:51.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.746+0000 7fbb69600700 1 -- 172.21.15.28:0/3605784785 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb64004710 con 0x55a39ebf3910 2024-06-06T08:42:51.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.746+0000 7fbb8cb3bb80 10 client.24883 fetch_fsmap learned FSMap version 28 2024-06-06T08:42:51.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.746+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3605784785 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a39ec152a0 con 0x55a39ebf3910 2024-06-06T08:42:51.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.746+0000 7fbb69600700 1 -- 172.21.15.28:0/3605784785 <== mon.1 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb64004560 con 0x55a39ebf3910 2024-06-06T08:42:51.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.746+0000 7fbb69600700 1 -- 172.21.15.28:0/3605784785 <== mon.1 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbb640309b0 con 0x55a39ebf3910 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.746+0000 7fbb8cb3bb80 10 client.24883 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.746+0000 7fbb8cb3bb80 10 client.24883 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.746+0000 7fbb8cb3bb80 20 client.24883 populate_metadata read hostname 'smithi028' 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.746+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x55a39ec7b9d0 0x55a39ec7a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.747+0000 7fbb8cb3bb80 4 client.24883 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.747+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3605784785 --> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] -- command(tid 0: {"prefix": "status"}) -- 0x55a39eb4b530 con 0x55a39ec7b9d0 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.747+0000 7fbb7b400700 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x55a39ec7b9d0 0x55a39ec7a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb7b400700 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x55a39ec7b9d0 0x55a39ec7a6e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=11dcd33ca9ed58f6 server_cookie=167279c21165d0c1 in_seq=0 out_seq=0 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb69600700 10 client.24883 ms_handle_connect on v2:172.21.15.59:6836/2388488967 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb69600700 1 -- 172.21.15.28:0/3605784785 <== mds.4 v2:172.21.15.59:6836/2388488967 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a39eb4b530 con 0x55a39ec7b9d0 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb69600700 10 client.24883 handle_command_reply: tid=0 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb8cb3bb80 1 client.24883 shutdown 2024-06-06T08:42:51.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3605784785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 msgr2=0x55a39ebf5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:51.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf5b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55a39ebf7770 tx=0x7fbb64005a00 comp rx=0 tx=0).stop 2024-06-06T08:42:51.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3605784785 shutdown_connections 2024-06-06T08:42:51.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x55a39ec7b9d0 0x55a39ec7a6e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a39ebfc520 0x55a39ebf6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a39eb6ddf0 0x55a39ec16a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb8cb3bb80 1 --2- 172.21.15.28:0/3605784785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a39ebf3910 0x55a39ebf5b10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb69600700 0 client.24883 ms_handle_reset on v2:172.21.15.59:6836/2388488967 2024-06-06T08:42:51.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3605784785 >> 172.21.15.28:0/3605784785 conn(0x55a39eb1e120 msgr2=0x55a39ebfa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:51.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.748+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3605784785 shutdown_connections 2024-06-06T08:42:51.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb8cb3bb80 1 -- 172.21.15.28:0/3605784785 wait complete. 2024-06-06T08:42:51.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb8cb3bb80 20 client.24883 trim_cache size 0 max 16384 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 4, 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24484, 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 147.09765625200001, 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 28, 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 92, 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 88, 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 208.53213109800001 2024-06-06T08:42:51.751 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:42:51.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb80c00700 1 -- 172.21.15.28:0/496213673 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbb600a2ca0 msgr2=0x7fbb600a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:51.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb80c00700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbb600a2ca0 0x7fbb600a5160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c109be0 tx=0x7fbb64009260 comp rx=0 tx=0).stop 2024-06-06T08:42:51.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb80c00700 1 -- 172.21.15.28:0/496213673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c1045c0 msgr2=0x7fbb7c19ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:51.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb80c00700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c1045c0 0x7fbb7c19ad20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c005910 tx=0x7fbb6c00f690 comp rx=0 tx=0).stop 2024-06-06T08:42:51.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb80c00700 1 -- 172.21.15.28:0/496213673 shutdown_connections 2024-06-06T08:42:51.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb80c00700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbb600a2ca0 0x7fbb600a5160 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb80c00700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb7c10a670 0x7fbb7c19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb80c00700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c1045c0 0x7fbb7c19ad20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb80c00700 1 --2- 172.21.15.28:0/496213673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb7c104f80 0x7fbb7c19b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:51.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.749+0000 7fbb80c00700 1 -- 172.21.15.28:0/496213673 >> 172.21.15.28:0/496213673 conn(0x7fbb7c100070 msgr2=0x7fbb7c101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:51.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.750+0000 7fbb80c00700 1 -- 172.21.15.28:0/496213673 shutdown_connections 2024-06-06T08:42:51.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:51.750+0000 7fbb80c00700 1 -- 172.21.15.28:0/496213673 wait complete. 2024-06-06T08:42:51.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:51 smithi028 ceph-mon[31564]: pgmap v417: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:52.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:51 smithi037 ceph-mon[36609]: pgmap v417: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:52.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:51 smithi059 ceph-mon[36684]: pgmap v417: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:42:52.841 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell mds.e status 2024-06-06T08:42:53.304 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:42:53.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:53 smithi028 ceph-mon[31564]: pgmap v418: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:54.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:53 smithi037 ceph-mon[36609]: pgmap v418: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:54.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:53 smithi059 ceph-mon[36684]: pgmap v418: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:55.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.528+0000 7ffa26800700 1 -- 172.21.15.28:0/2474876489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2010eac0 msgr2=0x7ffa2010eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:55.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.528+0000 7ffa26800700 1 --2- 172.21.15.28:0/2474876489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2010eac0 0x7ffa2010eea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffa100098f0 tx=0x7ffa10009c00 comp rx=0 tx=0).stop 2024-06-06T08:42:55.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.528+0000 7ffa26800700 1 -- 172.21.15.28:0/2474876489 shutdown_connections 2024-06-06T08:42:55.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.528+0000 7ffa26800700 1 --2- 172.21.15.28:0/2474876489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa20109480 0x7ffa20115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.528+0000 7ffa26800700 1 --2- 172.21.15.28:0/2474876489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa2010eac0 0x7ffa2010eea0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.528+0000 7ffa26800700 1 --2- 172.21.15.28:0/2474876489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa20108ac0 0x7ffa20108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.528+0000 7ffa26800700 1 -- 172.21.15.28:0/2474876489 >> 172.21.15.28:0/2474876489 conn(0x7ffa20075c60 msgr2=0x7ffa201072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:55.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.528+0000 7ffa26800700 1 -- 172.21.15.28:0/2474876489 shutdown_connections 2024-06-06T08:42:55.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.528+0000 7ffa26800700 1 -- 172.21.15.28:0/2474876489 wait complete. 2024-06-06T08:42:55.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.529+0000 7ffa26800700 1 Processor -- start 2024-06-06T08:42:55.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.529+0000 7ffa26800700 1 -- start start 2024-06-06T08:42:55.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.530+0000 7ffa26800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa20108ac0 0x7ffa2019f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.530+0000 7ffa26800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa20109480 0x7ffa2019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.530+0000 7ffa26800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa2010eac0 0x7ffa201a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.530+0000 7ffa26800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffa20118e40 con 0x7ffa20108ac0 2024-06-06T08:42:55.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.530+0000 7ffa26800700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa20118cc0 con 0x7ffa2010eac0 2024-06-06T08:42:55.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.530+0000 7ffa26800700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa20118fc0 con 0x7ffa20109480 2024-06-06T08:42:55.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.530+0000 7ffa1f400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa20108ac0 0x7ffa2019f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.530+0000 7ffa1f400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa20108ac0 0x7ffa2019f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59808/0 (socket says 172.21.15.28:59808) 2024-06-06T08:42:55.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.530+0000 7ffa1f400700 1 -- 172.21.15.28:0/660790145 learned_addr learned my addr 172.21.15.28:0/660790145 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:55.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.530+0000 7ffa16a00700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa20109480 0x7ffa2019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.531+0000 7ffa16a00700 1 -- 172.21.15.28:0/660790145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa2010eac0 msgr2=0x7ffa201a3b80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T08:42:55.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.531+0000 7ffa16a00700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa2010eac0 0x7ffa201a3b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.531+0000 7ffa16a00700 1 -- 172.21.15.28:0/660790145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa20108ac0 msgr2=0x7ffa2019f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:55.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.531+0000 7ffa16a00700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa20108ac0 0x7ffa2019f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.531+0000 7ffa16a00700 1 -- 172.21.15.28:0/660790145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa201a42c0 con 0x7ffa20109480 2024-06-06T08:42:55.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.531+0000 7ffa1f400700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa20108ac0 0x7ffa2019f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:55.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.531+0000 7ffa16a00700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa20109480 0x7ffa2019f7f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800ef10 tx=0x7ffa0800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:55.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.532+0000 7ffa1cc00700 1 -- 172.21.15.28:0/660790145 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800ca70 con 0x7ffa20109480 2024-06-06T08:42:55.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.532+0000 7ffa1cc00700 1 -- 172.21.15.28:0/660790145 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa08019070 con 0x7ffa20109480 2024-06-06T08:42:55.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.532+0000 7ffa1cc00700 1 -- 172.21.15.28:0/660790145 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa080146e0 con 0x7ffa20109480 2024-06-06T08:42:55.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.532+0000 7ffa26800700 1 -- 172.21.15.28:0/660790145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa201a4550 con 0x7ffa20109480 2024-06-06T08:42:55.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.532+0000 7ffa26800700 1 -- 172.21.15.28:0/660790145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa201abe30 con 0x7ffa20109480 2024-06-06T08:42:55.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.535+0000 7ffa1cc00700 1 -- 172.21.15.28:0/660790145 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ffa08012050 con 0x7ffa20109480 2024-06-06T08:42:55.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.536+0000 7ffa310fbb80 1 Processor -- start 2024-06-06T08:42:55.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.536+0000 7ffa1cc00700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffa040a2ca0 0x7ffa040a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.537+0000 7ffa1cc00700 1 -- 172.21.15.28:0/660790145 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7ffa080cf150 con 0x7ffa20109480 2024-06-06T08:42:55.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.537+0000 7ffa310fbb80 1 -- start start 2024-06-06T08:42:55.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.537+0000 7ffa1f400700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffa040a2ca0 0x7ffa040a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.537+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494bef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.537+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.537+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494b9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.537+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5620493c79c0 con 0x5620494b91f0 2024-06-06T08:42:55.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.537+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56204940aab0 con 0x5620494bf460 2024-06-06T08:42:55.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.537+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5620493c58a0 con 0x5620494beb40 2024-06-06T08:42:55.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.537+0000 7ffa1fe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494b9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.538+0000 7ffa16a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.538+0000 7ffa16a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494b8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:44480/0 (socket says 172.21.15.28:44480) 2024-06-06T08:42:55.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.538+0000 7ffa16a00700 1 -- 172.21.15.28:0/645457051 learned_addr learned my addr 172.21.15.28:0/645457051 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:55.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.538+0000 7ffa1f400700 1 --2- 172.21.15.28:0/645457051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494bef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.538+0000 7ffa16a00700 1 -- 172.21.15.28:0/645457051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 msgr2=0x5620494bef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.538+0000 7ffa16a00700 1 --2- 172.21.15.28:0/645457051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494bef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.538+0000 7ffa16a00700 1 -- 172.21.15.28:0/645457051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 msgr2=0x5620494b9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.538+0000 7ffa16a00700 1 --2- 172.21.15.28:0/645457051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494b9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.538+0000 7ffa16a00700 1 -- 172.21.15.28:0/645457051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620493b2f40 con 0x5620494bf460 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.538+0000 7ffa1f400700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffa040a2ca0 0x7ffa040a5160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000c010 tx=0x7ffa10005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.538+0000 7ffa16a00700 1 --2- 172.21.15.28:0/645457051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494b8cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa08097d30 tx=0x7ffa0809b750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e083064c721c6e65 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.539+0000 7ffa14c00700 1 -- 172.21.15.28:0/645457051 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08084e60 con 0x5620494bf460 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.539+0000 7ffa14c00700 1 -- 172.21.15.28:0/645457051 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa0809bfd0 con 0x5620494bf460 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.539+0000 7ffa14c00700 1 -- 172.21.15.28:0/645457051 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa080a40b0 con 0x5620494bf460 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.539+0000 7ffa310fbb80 1 -- 172.21.15.28:0/645457051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 msgr2=0x5620494b8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.539+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/645457051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494b8cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa08097d30 tx=0x7ffa0809b750 comp rx=0 tx=0).stop 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.539+0000 7ffa310fbb80 1 -- 172.21.15.28:0/645457051 shutdown_connections 2024-06-06T08:42:55.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.540+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/645457051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494b9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.540+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/645457051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494bef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.540+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/645457051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494b8cb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.540+0000 7ffa310fbb80 1 -- 172.21.15.28:0/645457051 >> 172.21.15.28:0/645457051 conn(0x5620493e5120 msgr2=0x5620494b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:55.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.540+0000 7ffa310fbb80 1 -- 172.21.15.28:0/645457051 shutdown_connections 2024-06-06T08:42:55.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.540+0000 7ffa310fbb80 1 -- 172.21.15.28:0/645457051 wait complete. 2024-06-06T08:42:55.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.540+0000 7ffa310fbb80 1 -- start start 2024-06-06T08:42:55.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.541+0000 7ffa310fbb80 1 Processor -- start 2024-06-06T08:42:55.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.541+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494c5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.541+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494c2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.541+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.541+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5620493a6f10 con 0x5620494b91f0 2024-06-06T08:42:55.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.541+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562049406a70 con 0x5620494bf460 2024-06-06T08:42:55.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.541+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5620494c5d80 con 0x5620494beb40 2024-06-06T08:42:55.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.541+0000 7ffa310fbb80 10 client.0 _ll_register_callbacks cb 0x5620493a0330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:42:55.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.541+0000 7ffa16a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa1fe00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa16a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494c2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:38094/0 (socket says 172.21.15.28:38094) 2024-06-06T08:42:55.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa16a00700 1 -- 172.21.15.28:0/1395501792 learned_addr learned my addr 172.21.15.28:0/1395501792 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:55.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa1f400700 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa1fe00700 1 -- 172.21.15.28:0/1395501792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 msgr2=0x5620494c2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:55.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa1fe00700 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494c2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa1fe00700 1 -- 172.21.15.28:0/1395501792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 msgr2=0x5620494c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:55.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa1fe00700 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa1fe00700 1 -- 172.21.15.28:0/1395501792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562049359880 con 0x5620494bf460 2024-06-06T08:42:55.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa16a00700 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494c2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:55.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa1fe00700 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494c2a60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffa180116c0 tx=0x7ffa180119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79b27f2804abfea3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:55.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.542+0000 7ffa0d600700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-06-06T08:42:55.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.543+0000 7ffa0d600700 1 -- 172.21.15.28:0/1395501792 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18004440 con 0x5620494bf460 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.543+0000 7ffa0d600700 1 -- 172.21.15.28:0/1395501792 <== mon.2 v2:172.21.15.37:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7ffa18004830 con 0x5620494bf460 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.543+0000 7ffa310fbb80 1 -- 172.21.15.28:0/1395501792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa0809bfd0 con 0x5620494bf460 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.543+0000 7ffa0d600700 1 -- 172.21.15.28:0/1395501792 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa18004a30 con 0x5620494bf460 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.543+0000 7ffa310fbb80 10 client.24902 fetch_fsmap learned FSMap version 28 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.543+0000 7ffa310fbb80 1 -- 172.21.15.28:0/1395501792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620494d05c0 con 0x5620494bf460 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.543+0000 7ffa0d600700 1 -- 172.21.15.28:0/1395501792 <== mon.2 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa0809bfd0 con 0x5620494bf460 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.543+0000 7ffa0d600700 1 -- 172.21.15.28:0/1395501792 <== mon.2 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7ffa18018070 con 0x5620494bf460 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.544+0000 7ffa310fbb80 10 client.24902 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.544+0000 7ffa310fbb80 10 client.24902 resolve_mds: resolved name 'e' to daemon mds.e 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.544+0000 7ffa310fbb80 20 client.24902 populate_metadata read hostname 'smithi028' 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.544+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x5620494d2bd0 0x5620494d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.544+0000 7ffa310fbb80 4 client.24902 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T08:42:55.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.544+0000 7ffa310fbb80 1 -- 172.21.15.28:0/1395501792 --> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562049417fb0 con 0x5620494d2bd0 2024-06-06T08:42:55.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.544+0000 7ffa1f400700 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x5620494d2bd0 0x5620494d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.545+0000 7ffa1f400700 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x5620494d2bd0 0x5620494d4040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e297e7353b6055 server_cookie=aaef80f2f83a5bc5 in_seq=0 out_seq=0 2024-06-06T08:42:55.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.545+0000 7ffa0d600700 10 client.24902 ms_handle_connect on v2:172.21.15.37:6834/2566253946 2024-06-06T08:42:55.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa0d600700 1 -- 172.21.15.28:0/1395501792 <== mds.3 v2:172.21.15.37:6834/2566253946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562049417fb0 con 0x5620494d2bd0 2024-06-06T08:42:55.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa0d600700 10 client.24902 handle_command_reply: tid=0 2024-06-06T08:42:55.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa310fbb80 1 client.24902 shutdown 2024-06-06T08:42:55.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa310fbb80 1 -- 172.21.15.28:0/1395501792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 msgr2=0x5620494c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:55.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494c2a60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffa180116c0 tx=0x7ffa180119d0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa310fbb80 1 -- 172.21.15.28:0/1395501792 shutdown_connections 2024-06-06T08:42:55.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x5620494d2bd0 0x5620494d4040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494c2a60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/1395501792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494c2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa310fbb80 1 -- 172.21.15.28:0/1395501792 >> 172.21.15.28:0/1395501792 conn(0x5620493e5120 msgr2=0x5620494ad740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:55.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa0d600700 0 client.24902 ms_handle_reset on v2:172.21.15.37:6834/2566253946 2024-06-06T08:42:55.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.546+0000 7ffa310fbb80 1 -- 172.21.15.28:0/1395501792 shutdown_connections 2024-06-06T08:42:55.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.547+0000 7ffa310fbb80 1 -- 172.21.15.28:0/1395501792 wait complete. 2024-06-06T08:42:55.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.547+0000 7ffa310fbb80 20 client.24902 trim_cache size 0 max 16384 2024-06-06T08:42:55.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.571+0000 7ffa310fbb80 1 Processor -- start 2024-06-06T08:42:55.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.571+0000 7ffa310fbb80 1 -- start start 2024-06-06T08:42:55.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.571+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.571+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494b4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.571+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.571+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5620494d2380 con 0x5620494b91f0 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.571+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5620494d2a50 con 0x5620494bf460 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.571+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5620494d3120 con 0x5620494beb40 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa16a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa16a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494b4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:38100/0 (socket says 172.21.15.28:38100) 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa16a00700 1 -- 172.21.15.28:0/3032893132 learned_addr learned my addr 172.21.15.28:0/3032893132 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa1fe00700 1 --2- 172.21.15.28:0/3032893132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa1f400700 1 --2- 172.21.15.28:0/3032893132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa16a00700 1 -- 172.21.15.28:0/3032893132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 msgr2=0x5620494ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa16a00700 1 --2- 172.21.15.28:0/3032893132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa16a00700 1 -- 172.21.15.28:0/3032893132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 msgr2=0x5620494b8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa16a00700 1 --2- 172.21.15.28:0/3032893132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494b8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa16a00700 1 -- 172.21.15.28:0/3032893132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620494c5d80 con 0x5620494beb40 2024-06-06T08:42:55.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa16a00700 1 --2- 172.21.15.28:0/3032893132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494b4150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa080982a0 tx=0x7ffa08097b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5426eef83f8b9a40 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.572+0000 7ffa0fe00700 1 -- 172.21.15.28:0/3032893132 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0809bfd0 con 0x5620494beb40 2024-06-06T08:42:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.573+0000 7ffa0fe00700 1 -- 172.21.15.28:0/3032893132 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa0809b8d0 con 0x5620494beb40 2024-06-06T08:42:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.573+0000 7ffa0fe00700 1 -- 172.21.15.28:0/3032893132 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08099bd0 con 0x5620494beb40 2024-06-06T08:42:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.573+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3032893132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 msgr2=0x5620494b4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.573+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/3032893132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494b4150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa080982a0 tx=0x7ffa08097b70 comp rx=0 tx=0).stop 2024-06-06T08:42:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.573+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3032893132 shutdown_connections 2024-06-06T08:42:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.573+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/3032893132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.573+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/3032893132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494b91f0 0x5620494b8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.573+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/3032893132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494beb40 0x5620494b4150 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.573+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3032893132 >> 172.21.15.28:0/3032893132 conn(0x5620493e5120 msgr2=0x5620494b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.573+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3032893132 shutdown_connections 2024-06-06T08:42:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.574+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3032893132 wait complete. 2024-06-06T08:42:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.574+0000 7ffa310fbb80 1 -- start start 2024-06-06T08:42:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.574+0000 7ffa310fbb80 1 Processor -- start 2024-06-06T08:42:55.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494b91f0 0x5620494ddbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494beb40 0x5620494c4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa310fbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5620494d3ec0 con 0x5620494beb40 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5620494d37f0 con 0x5620494bf460 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa310fbb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5620494d4590 con 0x5620494b91f0 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa310fbb80 10 client.0 _ll_register_callbacks cb 0x5620493a0330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa1f400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494b91f0 0x5620494ddbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa1fe00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa1fe00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:44520/0 (socket says 172.21.15.28:44520) 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa1f400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494b91f0 0x5620494ddbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:38112/0 (socket says 172.21.15.28:38112) 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa1fe00700 1 -- 172.21.15.28:0/3600799209 learned_addr learned my addr 172.21.15.28:0/3600799209 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.575+0000 7ffa16a00700 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494beb40 0x5620494c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.576+0000 7ffa1fe00700 1 -- 172.21.15.28:0/3600799209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494b91f0 msgr2=0x5620494ddbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.576+0000 7ffa1fe00700 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494b91f0 0x5620494ddbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.576+0000 7ffa1fe00700 1 -- 172.21.15.28:0/3600799209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494beb40 msgr2=0x5620494c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:55.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.576+0000 7ffa1fe00700 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494beb40 0x5620494c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.576+0000 7ffa1fe00700 1 -- 172.21.15.28:0/3600799209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620494c50d0 con 0x5620494bf460 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.576+0000 7ffa1fe00700 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494c4890 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa180116c0 tx=0x7ffa18024d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae12b8d7e602b62f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.576+0000 7ffa0d600700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.576+0000 7ffa0d600700 1 -- 172.21.15.28:0/3600799209 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18032060 con 0x5620494bf460 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.576+0000 7ffa0d600700 1 -- 172.21.15.28:0/3600799209 <== mon.2 v2:172.21.15.37:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7ffa18004440 con 0x5620494bf460 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.576+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3600799209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa0809b8d0 con 0x5620494bf460 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.577+0000 7ffa0d600700 1 -- 172.21.15.28:0/3600799209 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa18029040 con 0x5620494bf460 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.577+0000 7ffa310fbb80 10 client.24908 fetch_fsmap learned FSMap version 28 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.577+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3600799209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56204953e4c0 con 0x5620494bf460 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.577+0000 7ffa0d600700 1 -- 172.21.15.28:0/3600799209 <== mon.2 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa0809b8d0 con 0x5620494bf460 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.577+0000 7ffa0d600700 1 -- 172.21.15.28:0/3600799209 <== mon.2 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7ffa18018040 con 0x5620494bf460 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.577+0000 7ffa310fbb80 10 client.24908 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:42:55.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.577+0000 7ffa310fbb80 10 client.24908 resolve_mds: resolved name 'e' to daemon mds.e 2024-06-06T08:42:55.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.577+0000 7ffa310fbb80 20 client.24908 populate_metadata read hostname 'smithi028' 2024-06-06T08:42:55.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.577+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x562049543030 0x562049541d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:55.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.577+0000 7ffa310fbb80 4 client.24908 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T08:42:55.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.577+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3600799209 --> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] -- command(tid 0: {"prefix": "status"}) -- 0x562049412530 con 0x562049543030 2024-06-06T08:42:55.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.578+0000 7ffa1f400700 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x562049543030 0x562049541d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:55.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.578+0000 7ffa1f400700 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x562049543030 0x562049541d40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7fd92eb217aea27c server_cookie=21642f566b2f5668 in_seq=0 out_seq=0 2024-06-06T08:42:55.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.578+0000 7ffa0d600700 10 client.24908 ms_handle_connect on v2:172.21.15.37:6834/2566253946 2024-06-06T08:42:55.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.578+0000 7ffa0d600700 1 -- 172.21.15.28:0/3600799209 <== mds.3 v2:172.21.15.37:6834/2566253946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562049412530 con 0x562049543030 2024-06-06T08:42:55.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.578+0000 7ffa0d600700 10 client.24908 handle_command_reply: tid=0 2024-06-06T08:42:55.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.578+0000 7ffa310fbb80 1 client.24908 shutdown 2024-06-06T08:42:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.578+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3600799209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 msgr2=0x5620494c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.578+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494c4890 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa180116c0 tx=0x7ffa18024d20 comp rx=0 tx=0).stop 2024-06-06T08:42:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.579+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3600799209 shutdown_connections 2024-06-06T08:42:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.579+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x562049543030 0x562049541d40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.579+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620494bf460 0x5620494c4890 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.579+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620494b91f0 0x5620494ddbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.579+0000 7ffa310fbb80 1 --2- 172.21.15.28:0/3600799209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5620494beb40 0x5620494c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.579+0000 7ffa0d600700 0 client.24908 ms_handle_reset on v2:172.21.15.37:6834/2566253946 2024-06-06T08:42:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.579+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3600799209 >> 172.21.15.28:0/3600799209 conn(0x5620493e5120 msgr2=0x5620494c2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.579+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3600799209 shutdown_connections 2024-06-06T08:42:55.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.579+0000 7ffa310fbb80 1 -- 172.21.15.28:0/3600799209 wait complete. 2024-06-06T08:42:55.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.579+0000 7ffa310fbb80 20 client.24908 trim_cache size 0 max 16384 2024-06-06T08:42:55.583 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:42:55.583 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:42:55.583 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 3, 2024-06-06T08:42:55.583 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24485, 2024-06-06T08:42:55.583 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-06-06T08:42:55.583 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-06-06T08:42:55.583 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-06-06T08:42:55.583 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 151.94404778200001, 2024-06-06T08:42:55.584 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 28, 2024-06-06T08:42:55.584 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 92, 2024-06-06T08:42:55.584 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 88, 2024-06-06T08:42:55.584 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 218.23778525700001 2024-06-06T08:42:55.584 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:42:55.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 -- 172.21.15.28:0/660790145 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffa040a2ca0 msgr2=0x7ffa040a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:55.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffa040a2ca0 0x7ffa040a5160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000c010 tx=0x7ffa10005dc0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 -- 172.21.15.28:0/660790145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa20109480 msgr2=0x7ffa2019f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa20109480 0x7ffa2019f7f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800ef10 tx=0x7ffa0800c3a0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 -- 172.21.15.28:0/660790145 shutdown_connections 2024-06-06T08:42:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ffa040a2ca0 0x7ffa040a5160 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa2010eac0 0x7ffa201a3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa20108ac0 0x7ffa2019f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 --2- 172.21.15.28:0/660790145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa20109480 0x7ffa2019f7f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 -- 172.21.15.28:0/660790145 >> 172.21.15.28:0/660790145 conn(0x7ffa20075c60 msgr2=0x7ffa20076220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 -- 172.21.15.28:0/660790145 shutdown_connections 2024-06-06T08:42:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:55.580+0000 7ffa26800700 1 -- 172.21.15.28:0/660790145 wait complete. 2024-06-06T08:42:55.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:55 smithi028 ceph-mon[31564]: pgmap v419: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:56.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:55 smithi037 ceph-mon[36609]: pgmap v419: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:56.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:55 smithi059 ceph-mon[36684]: pgmap v419: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:42:56.473 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-06T08:42:56.963 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:42:57.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:57 smithi028 ceph-mon[31564]: pgmap v420: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:42:58.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:57 smithi037 ceph-mon[36609]: pgmap v420: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:42:58.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:57 smithi059 ceph-mon[36684]: pgmap v420: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:42:59.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.230+0000 7f05f2e00700 1 -- 172.21.15.28:0/2106420773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05ec1046b0 msgr2=0x7f05ec104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:59.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.230+0000 7f05f2e00700 1 --2- 172.21.15.28:0/2106420773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05ec1046b0 0x7f05ec104b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f05d80098f0 tx=0x7f05d8009c00 comp rx=0 tx=0).stop 2024-06-06T08:42:59.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.230+0000 7f05f2e00700 1 -- 172.21.15.28:0/2106420773 shutdown_connections 2024-06-06T08:42:59.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.230+0000 7f05f2e00700 1 --2- 172.21.15.28:0/2106420773 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05ec105070 0x7f05ec111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.230+0000 7f05f2e00700 1 --2- 172.21.15.28:0/2106420773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05ec10a6b0 0x7f05ec10aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.230+0000 7f05f2e00700 1 --2- 172.21.15.28:0/2106420773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05ec1046b0 0x7f05ec104b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.230+0000 7f05f2e00700 1 -- 172.21.15.28:0/2106420773 >> 172.21.15.28:0/2106420773 conn(0x7f05ec1001a0 msgr2=0x7f05ec1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:59.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.230+0000 7f05f2e00700 1 -- 172.21.15.28:0/2106420773 shutdown_connections 2024-06-06T08:42:59.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.230+0000 7f05f2e00700 1 -- 172.21.15.28:0/2106420773 wait complete. 2024-06-06T08:42:59.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.231+0000 7f05f2e00700 1 Processor -- start 2024-06-06T08:42:59.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.231+0000 7f05f2e00700 1 -- start start 2024-06-06T08:42:59.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.231+0000 7f05f2e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05ec1046b0 0x7f05ec19af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.231+0000 7f05f2e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05ec105070 0x7f05ec19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.231+0000 7f05f2e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05ec10a6b0 0x7f05ec19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.231+0000 7f05f2e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec114a90 con 0x7f05ec1046b0 2024-06-06T08:42:59.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.231+0000 7f05f2e00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec114910 con 0x7f05ec105070 2024-06-06T08:42:59.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.231+0000 7f05f2e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec114c10 con 0x7f05ec10a6b0 2024-06-06T08:42:59.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.232+0000 7f05ebe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05ec1046b0 0x7f05ec19af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.232+0000 7f05ebe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05ec1046b0 0x7f05ec19af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47512/0 (socket says 172.21.15.28:47512) 2024-06-06T08:42:59.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.232+0000 7f05ebe00700 1 -- 172.21.15.28:0/2802300216 learned_addr learned my addr 172.21.15.28:0/2802300216 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:59.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.232+0000 7f05eb400700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05ec105070 0x7f05ec19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.232+0000 7f05f0e00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05ec10a6b0 0x7f05ec19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.232+0000 7f05ebe00700 1 -- 172.21.15.28:0/2802300216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05ec10a6b0 msgr2=0x7f05ec19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:59.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.232+0000 7f05ebe00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05ec10a6b0 0x7f05ec19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.232+0000 7f05ebe00700 1 -- 172.21.15.28:0/2802300216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05ec105070 msgr2=0x7f05ec19b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:59.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.232+0000 7f05ebe00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05ec105070 0x7f05ec19b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.232+0000 7f05ebe00700 1 -- 172.21.15.28:0/2802300216 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ec19ff40 con 0x7f05ec1046b0 2024-06-06T08:42:59.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.232+0000 7f05eb400700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05ec105070 0x7f05ec19b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:59.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.233+0000 7f05ebe00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05ec1046b0 0x7f05ec19af80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00e9c0 tx=0x7f05dc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:59.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.233+0000 7f05e8c00700 1 -- 172.21.15.28:0/2802300216 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc00cbd0 con 0x7f05ec1046b0 2024-06-06T08:42:59.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.233+0000 7f05f2e00700 1 -- 172.21.15.28:0/2802300216 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ec1a0230 con 0x7f05ec1046b0 2024-06-06T08:42:59.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.233+0000 7f05e8c00700 1 -- 172.21.15.28:0/2802300216 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05dc00ee60 con 0x7f05ec1046b0 2024-06-06T08:42:59.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.233+0000 7f05e8c00700 1 -- 172.21.15.28:0/2802300216 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc005630 con 0x7f05ec1046b0 2024-06-06T08:42:59.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.233+0000 7f05f2e00700 1 -- 172.21.15.28:0/2802300216 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ec1a7ab0 con 0x7f05ec1046b0 2024-06-06T08:42:59.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.236+0000 7f05e8c00700 1 -- 172.21.15.28:0/2802300216 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f05dc004750 con 0x7f05ec1046b0 2024-06-06T08:42:59.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.237+0000 7f05fd81db80 1 Processor -- start 2024-06-06T08:42:59.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.237+0000 7f05fd81db80 1 -- start start 2024-06-06T08:42:59.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05e8c00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f05d00a2c20 0x7f05d00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05e8c00700 1 -- 172.21.15.28:0/2802300216 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f05dc0cf340 con 0x7f05ec1046b0 2024-06-06T08:42:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78d7d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d7d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d8a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05fd81db80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x561f78c8c9c0 con 0x561f78d882b0 2024-06-06T08:42:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05fd81db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f78ccfab0 con 0x561f78cf9df0 2024-06-06T08:42:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05fd81db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561f78c8a8a0 con 0x561f78d7d560 2024-06-06T08:42:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05f0e00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f05d00a2c20 0x7f05d00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05eb400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d7d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05eb400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d7d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:45180/0 (socket says 172.21.15.28:45180) 2024-06-06T08:42:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05eb400700 1 -- 172.21.15.28:0/2778910163 learned_addr learned my addr 172.21.15.28:0/2778910163 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05f0e00700 1 --2- 172.21.15.28:0/2778910163 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d8a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.238+0000 7f05ebe00700 1 --2- 172.21.15.28:0/2778910163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78d7d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.239+0000 7f05eb400700 1 -- 172.21.15.28:0/2778910163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 msgr2=0x561f78d7d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.239+0000 7f05eb400700 1 --2- 172.21.15.28:0/2778910163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78d7d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.239+0000 7f05eb400700 1 -- 172.21.15.28:0/2778910163 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 msgr2=0x561f78d8a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.239+0000 7f05eb400700 1 --2- 172.21.15.28:0/2778910163 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d8a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.239+0000 7f05eb400700 1 -- 172.21.15.28:0/2778910163 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f78c77f40 con 0x561f78d7d560 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.239+0000 7f05f0e00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f05d00a2c20 0x7f05d00a50e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009fd0 tx=0x7f05e4009230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.239+0000 7f05eb400700 1 --2- 172.21.15.28:0/2778910163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d7d9e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05d80098f0 tx=0x7f05d800bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aa7b2bba4f15258 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.239+0000 7f05e1600700 1 -- 172.21.15.28:0/2778910163 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8028070 con 0x561f78d7d560 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.239+0000 7f05e1600700 1 -- 172.21.15.28:0/2778910163 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05d8005520 con 0x561f78d7d560 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.239+0000 7f05e1600700 1 -- 172.21.15.28:0/2778910163 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8004b90 con 0x561f78d7d560 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.240+0000 7f05fd81db80 1 -- 172.21.15.28:0/2778910163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 msgr2=0x561f78d7d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.240+0000 7f05fd81db80 1 --2- 172.21.15.28:0/2778910163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d7d9e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05d80098f0 tx=0x7f05d800bf90 comp rx=0 tx=0).stop 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.240+0000 7f05fd81db80 1 -- 172.21.15.28:0/2778910163 shutdown_connections 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.240+0000 7f05fd81db80 1 --2- 172.21.15.28:0/2778910163 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d8a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.240+0000 7f05fd81db80 1 --2- 172.21.15.28:0/2778910163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78d7d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.240+0000 7f05fd81db80 1 --2- 172.21.15.28:0/2778910163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d7d9e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.240+0000 7f05fd81db80 1 -- 172.21.15.28:0/2778910163 >> 172.21.15.28:0/2778910163 conn(0x561f78caa120 msgr2=0x561f78d79460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.240+0000 7f05fd81db80 1 -- 172.21.15.28:0/2778910163 shutdown_connections 2024-06-06T08:42:59.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.240+0000 7f05fd81db80 1 -- 172.21.15.28:0/2778910163 wait complete. 2024-06-06T08:42:59.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.241+0000 7f05fd81db80 1 -- start start 2024-06-06T08:42:59.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.241+0000 7f05fd81db80 1 Processor -- start 2024-06-06T08:42:59.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78cf9df0 0x561f78d87970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78d7d560 0x561f78d84ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d85220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05fd81db80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x561f78c6bf10 con 0x561f78d882b0 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05fd81db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f78ccba70 con 0x561f78d7d560 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05fd81db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561f78d8af10 con 0x561f78cf9df0 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05fd81db80 10 client.0 _ll_register_callbacks cb 0x561f78c696d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05eb400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78d7d560 0x561f78d84ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05eb400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78d7d560 0x561f78d84ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:56550/0 (socket says 172.21.15.28:56550) 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05eb400700 1 -- 172.21.15.28:0/1188539131 learned_addr learned my addr 172.21.15.28:0/1188539131 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05ebe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78cf9df0 0x561f78d87970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05f0e00700 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d85220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05ebe00700 1 -- 172.21.15.28:0/1188539131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78d7d560 msgr2=0x561f78d84ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05ebe00700 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78d7d560 0x561f78d84ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05ebe00700 1 -- 172.21.15.28:0/1188539131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 msgr2=0x561f78d85220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05ebe00700 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d85220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.242+0000 7f05ebe00700 1 -- 172.21.15.28:0/1188539131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f78c1e880 con 0x561f78cf9df0 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.243+0000 7f05ebe00700 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78cf9df0 0x561f78d87970 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00c5b0 tx=0x7f05dc097e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d8dd013dc7a2ad0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.243+0000 7f05d6000700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.243+0000 7f05d6000700 1 -- 172.21.15.28:0/1188539131 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0b9060 con 0x561f78cf9df0 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.243+0000 7f05d6000700 1 -- 172.21.15.28:0/1188539131 <== mon.1 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f05dc00cd70 con 0x561f78cf9df0 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.243+0000 7f05fd81db80 1 -- 172.21.15.28:0/1188539131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05d8005520 con 0x561f78cf9df0 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.243+0000 7f05d6000700 1 -- 172.21.15.28:0/1188539131 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05dc0b3030 con 0x561f78cf9df0 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.243+0000 7f05fd81db80 10 client.24913 fetch_fsmap learned FSMap version 28 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.243+0000 7f05fd81db80 1 -- 172.21.15.28:0/1188539131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f78d95660 con 0x561f78cf9df0 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.243+0000 7f05d6000700 1 -- 172.21.15.28:0/1188539131 <== mon.1 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05d8005520 con 0x561f78cf9df0 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.244+0000 7f05d6000700 1 -- 172.21.15.28:0/1188539131 <== mon.1 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f05dc0ba250 con 0x561f78cf9df0 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.244+0000 7f05fd81db80 10 client.24913 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:42:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.244+0000 7f05fd81db80 10 client.24913 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T08:42:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.244+0000 7f05fd81db80 20 client.24913 populate_metadata read hostname 'smithi028' 2024-06-06T08:42:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.244+0000 7f05fd81db80 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x561f78d97c40 0x561f78d990b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.244+0000 7f05fd81db80 4 client.24913 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T08:42:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.244+0000 7f05fd81db80 1 -- 172.21.15.28:0/1188539131 --> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f78cdcfb0 con 0x561f78d97c40 2024-06-06T08:42:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.244+0000 7f05eb400700 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x561f78d97c40 0x561f78d990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.245+0000 7f05eb400700 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x561f78d97c40 0x561f78d990b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f00ddf927d79a8c server_cookie=b5910f6d36d64596 in_seq=0 out_seq=0 2024-06-06T08:42:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.245+0000 7f05d6000700 10 client.24913 ms_handle_connect on v2:172.21.15.59:6838/771325139 2024-06-06T08:42:59.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05d6000700 1 -- 172.21.15.28:0/1188539131 <== mds.2 v2:172.21.15.59:6838/771325139 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561f78cdcfb0 con 0x561f78d97c40 2024-06-06T08:42:59.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05d6000700 10 client.24913 handle_command_reply: tid=0 2024-06-06T08:42:59.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05fd81db80 1 client.24913 shutdown 2024-06-06T08:42:59.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05fd81db80 1 -- 172.21.15.28:0/1188539131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78cf9df0 msgr2=0x561f78d87970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:59.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05fd81db80 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78cf9df0 0x561f78d87970 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00c5b0 tx=0x7f05dc097e10 comp rx=0 tx=0).stop 2024-06-06T08:42:59.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05fd81db80 1 -- 172.21.15.28:0/1188539131 shutdown_connections 2024-06-06T08:42:59.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05fd81db80 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d85220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05fd81db80 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78cf9df0 0x561f78d87970 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05fd81db80 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x561f78d97c40 0x561f78d990b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05fd81db80 1 --2- 172.21.15.28:0/1188539131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78d7d560 0x561f78d84ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05d6000700 0 client.24913 ms_handle_reset on v2:172.21.15.59:6838/771325139 2024-06-06T08:42:59.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05fd81db80 1 -- 172.21.15.28:0/1188539131 >> 172.21.15.28:0/1188539131 conn(0x561f78caa120 msgr2=0x561f78d786f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:59.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05fd81db80 1 -- 172.21.15.28:0/1188539131 shutdown_connections 2024-06-06T08:42:59.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.246+0000 7f05fd81db80 1 -- 172.21.15.28:0/1188539131 wait complete. 2024-06-06T08:42:59.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.247+0000 7f05fd81db80 20 client.24913 trim_cache size 0 max 16384 2024-06-06T08:42:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.269+0000 7f05fd81db80 1 Processor -- start 2024-06-06T08:42:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.269+0000 7f05fd81db80 1 -- start start 2024-06-06T08:42:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.270+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78d85250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.270+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d87520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.270+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.270+0000 7f05fd81db80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x561f78d973f0 con 0x561f78d882b0 2024-06-06T08:42:59.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.270+0000 7f05fd81db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f78d97ac0 con 0x561f78cf9df0 2024-06-06T08:42:59.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.270+0000 7f05fd81db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561f78d98190 con 0x561f78d7d560 2024-06-06T08:42:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.270+0000 7f05f0e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.270+0000 7f05f0e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d896a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47542/0 (socket says 172.21.15.28:47542) 2024-06-06T08:42:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.270+0000 7f05f0e00700 1 -- 172.21.15.28:0/3718201613 learned_addr learned my addr 172.21.15.28:0/3718201613 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.270+0000 7f05ebe00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78d85250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.270+0000 7f05eb400700 1 --2- 172.21.15.28:0/3718201613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d87520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.271+0000 7f05f0e00700 1 -- 172.21.15.28:0/3718201613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 msgr2=0x561f78d87520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.271+0000 7f05f0e00700 1 --2- 172.21.15.28:0/3718201613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d87520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.271+0000 7f05f0e00700 1 -- 172.21.15.28:0/3718201613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 msgr2=0x561f78d85250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.271+0000 7f05f0e00700 1 --2- 172.21.15.28:0/3718201613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78d85250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.271+0000 7f05f0e00700 1 -- 172.21.15.28:0/3718201613 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f78d990b0 con 0x561f78d882b0 2024-06-06T08:42:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.271+0000 7f05ebe00700 1 --2- 172.21.15.28:0/3718201613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78d85250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:42:59.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.271+0000 7f05f0e00700 1 --2- 172.21.15.28:0/3718201613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d896a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05e401aac0 tx=0x7f05e401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5be015c23d893e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:59.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.271+0000 7f05e0c00700 1 -- 172.21.15.28:0/3718201613 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e402d070 con 0x561f78d882b0 2024-06-06T08:42:59.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.271+0000 7f05e0c00700 1 -- 172.21.15.28:0/3718201613 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05e401bd40 con 0x561f78d882b0 2024-06-06T08:42:59.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.271+0000 7f05e0c00700 1 -- 172.21.15.28:0/3718201613 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e4028c30 con 0x561f78d882b0 2024-06-06T08:42:59.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.272+0000 7f05fd81db80 1 -- 172.21.15.28:0/3718201613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 msgr2=0x561f78d896a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:59.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.272+0000 7f05fd81db80 1 --2- 172.21.15.28:0/3718201613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d896a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05e401aac0 tx=0x7f05e401d000 comp rx=0 tx=0).stop 2024-06-06T08:42:59.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.272+0000 7f05fd81db80 1 -- 172.21.15.28:0/3718201613 shutdown_connections 2024-06-06T08:42:59.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.272+0000 7f05fd81db80 1 --2- 172.21.15.28:0/3718201613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d896a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.272+0000 7f05fd81db80 1 --2- 172.21.15.28:0/3718201613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78d85250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.272+0000 7f05fd81db80 1 --2- 172.21.15.28:0/3718201613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d87520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.272+0000 7f05fd81db80 1 -- 172.21.15.28:0/3718201613 >> 172.21.15.28:0/3718201613 conn(0x561f78caa120 msgr2=0x561f78d835d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:59.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.272+0000 7f05fd81db80 1 -- 172.21.15.28:0/3718201613 shutdown_connections 2024-06-06T08:42:59.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.272+0000 7f05fd81db80 1 -- 172.21.15.28:0/3718201613 wait complete. 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.272+0000 7f05fd81db80 1 -- start start 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.273+0000 7f05fd81db80 1 Processor -- start 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.273+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78da2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.273+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d7f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.273+0000 7f05fd81db80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d7fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.273+0000 7f05fd81db80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x561f78d98f30 con 0x561f78d882b0 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.273+0000 7f05fd81db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f78d98860 con 0x561f78cf9df0 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.273+0000 7f05fd81db80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561f78d99600 con 0x561f78d7d560 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.273+0000 7f05fd81db80 10 client.0 _ll_register_callbacks cb 0x561f78c696d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.273+0000 7f05f0e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d7fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.273+0000 7f05ebe00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78da2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.274+0000 7f05f0e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d7fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47554/0 (socket says 172.21.15.28:47554) 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.274+0000 7f05f0e00700 1 -- 172.21.15.28:0/3243003714 learned_addr learned my addr 172.21.15.28:0/3243003714 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.274+0000 7f05ebe00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78da2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:56566/0 (socket says 172.21.15.28:56566) 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.274+0000 7f05eb400700 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d7f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.274+0000 7f05f0e00700 1 -- 172.21.15.28:0/3243003714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 msgr2=0x561f78d7f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.274+0000 7f05f0e00700 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d7f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.274+0000 7f05f0e00700 1 -- 172.21.15.28:0/3243003714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 msgr2=0x561f78da2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.274+0000 7f05f0e00700 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78da2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.274+0000 7f05f0e00700 1 -- 172.21.15.28:0/3243003714 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f78d800f0 con 0x561f78d882b0 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.274+0000 7f05f0e00700 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d7fab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05e401b730 tx=0x7f05e401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b49630690e3a314 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.274+0000 7f05d6000700 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.275+0000 7f05d6000700 1 -- 172.21.15.28:0/3243003714 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e4038060 con 0x561f78d882b0 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.275+0000 7f05fd81db80 1 -- 172.21.15.28:0/3243003714 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05e401bd40 con 0x561f78d882b0 2024-06-06T08:42:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.275+0000 7f05d6000700 1 -- 172.21.15.28:0/3243003714 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f05e401ba60 con 0x561f78d882b0 2024-06-06T08:42:59.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.275+0000 7f05d6000700 1 -- 172.21.15.28:0/3243003714 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05e402d040 con 0x561f78d882b0 2024-06-06T08:42:59.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.275+0000 7f05fd81db80 10 client.14790 fetch_fsmap learned FSMap version 28 2024-06-06T08:42:59.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.275+0000 7f05fd81db80 1 -- 172.21.15.28:0/3243003714 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f78d9f370 con 0x561f78d882b0 2024-06-06T08:42:59.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.275+0000 7f05d6000700 1 -- 172.21.15.28:0/3243003714 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05e401bd40 con 0x561f78d882b0 2024-06-06T08:42:59.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.275+0000 7f05d6000700 1 -- 172.21.15.28:0/3243003714 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f05e4025070 con 0x561f78d882b0 2024-06-06T08:42:59.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.275+0000 7f05fd81db80 10 client.14790 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:42:59.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.275+0000 7f05fd81db80 10 client.14790 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T08:42:59.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.275+0000 7f05fd81db80 20 client.14790 populate_metadata read hostname 'smithi028' 2024-06-06T08:42:59.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.276+0000 7f05fd81db80 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x561f78e07ac0 0x561f78e067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.276+0000 7f05fd81db80 4 client.14790 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.276+0000 7f05fd81db80 1 -- 172.21.15.28:0/3243003714 --> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] -- command(tid 0: {"prefix": "status"}) -- 0x561f78cd7530 con 0x561f78e07ac0 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.276+0000 7f05ebe00700 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x561f78e07ac0 0x561f78e067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.276+0000 7f05ebe00700 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x561f78e07ac0 0x561f78e067d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33b09cda5151defb server_cookie=81aa2f5a116f0e90 in_seq=0 out_seq=0 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.276+0000 7f05d6000700 10 client.14790 ms_handle_connect on v2:172.21.15.59:6838/771325139 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05d6000700 1 -- 172.21.15.28:0/3243003714 <== mds.2 v2:172.21.15.59:6838/771325139 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561f78cd7530 con 0x561f78e07ac0 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05d6000700 10 client.14790 handle_command_reply: tid=0 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 1 client.14790 shutdown 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 1 -- 172.21.15.28:0/3243003714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 msgr2=0x561f78d7fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d7fab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05e401b730 tx=0x7f05e401bf60 comp rx=0 tx=0).stop 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 1 -- 172.21.15.28:0/3243003714 shutdown_connections 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561f78d882b0 0x561f78d7fab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x561f78e07ac0 0x561f78e067d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f78cf9df0 0x561f78da2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 1 --2- 172.21.15.28:0/3243003714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f78d7d560 0x561f78d7f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 1 -- 172.21.15.28:0/3243003714 >> 172.21.15.28:0/3243003714 conn(0x561f78caa120 msgr2=0x561f78d77e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05d6000700 0 client.14790 ms_handle_reset on v2:172.21.15.59:6838/771325139 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 1 -- 172.21.15.28:0/3243003714 shutdown_connections 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 1 -- 172.21.15.28:0/3243003714 wait complete. 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.277+0000 7f05fd81db80 20 client.14790 trim_cache size 0 max 16384 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 2, 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24499, 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-06-06T08:42:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-06-06T08:42:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-06-06T08:42:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 156.655227056, 2024-06-06T08:42:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 28, 2024-06-06T08:42:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 92, 2024-06-06T08:42:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 88, 2024-06-06T08:42:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 210.04633552000001 2024-06-06T08:42:59.281 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 -- 172.21.15.28:0/2802300216 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f05d00a2c20 msgr2=0x7f05d00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f05d00a2c20 0x7f05d00a50e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009fd0 tx=0x7f05e4009230 comp rx=0 tx=0).stop 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 -- 172.21.15.28:0/2802300216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05ec1046b0 msgr2=0x7f05ec19af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05ec1046b0 0x7f05ec19af80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00e9c0 tx=0x7f05dc00ecd0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 -- 172.21.15.28:0/2802300216 shutdown_connections 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f05d00a2c20 0x7f05d00a50e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05ec10a6b0 0x7f05ec19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05ec1046b0 0x7f05ec19af80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 --2- 172.21.15.28:0/2802300216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05ec105070 0x7f05ec19b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 -- 172.21.15.28:0/2802300216 >> 172.21.15.28:0/2802300216 conn(0x7f05ec1001a0 msgr2=0x7f05ec100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 -- 172.21.15.28:0/2802300216 shutdown_connections 2024-06-06T08:42:59.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:42:59.278+0000 7f05f2e00700 1 -- 172.21.15.28:0/2802300216 wait complete. 2024-06-06T08:43:00.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:42:59 smithi028 ceph-mon[31564]: pgmap v421: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 9 op/s 2024-06-06T08:43:00.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:42:59 smithi059 ceph-mon[36684]: pgmap v421: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 9 op/s 2024-06-06T08:43:00.101 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:42:59 smithi037 ceph-mon[36609]: pgmap v421: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 9 op/s 2024-06-06T08:43:00.183 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell mds.h status 2024-06-06T08:43:00.663 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:01.890 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:01 smithi028 ceph-mon[31564]: pgmap v422: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:02.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:01 smithi037 ceph-mon[36609]: pgmap v422: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:02.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:01 smithi059 ceph-mon[36684]: pgmap v422: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:02.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.852+0000 7f515dc00700 1 -- 172.21.15.28:0/2404734576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f515810ee90 msgr2=0x7f5158111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:02.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.852+0000 7f515dc00700 1 --2- 172.21.15.28:0/2404734576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f515810ee90 0x7f5158111280 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f515000b0a0 tx=0x7f515000b3b0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.852+0000 7f515dc00700 1 -- 172.21.15.28:0/2404734576 shutdown_connections 2024-06-06T08:43:02.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.852+0000 7f515dc00700 1 --2- 172.21.15.28:0/2404734576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f515810ee90 0x7f5158111280 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.852+0000 7f515dc00700 1 --2- 172.21.15.28:0/2404734576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51580746c0 0x7f5158074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.852+0000 7f515dc00700 1 --2- 172.21.15.28:0/2404734576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5158074fe0 0x7f515810e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.852+0000 7f515dc00700 1 -- 172.21.15.28:0/2404734576 >> 172.21.15.28:0/2404734576 conn(0x7f51580795f0 msgr2=0x7f5158079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:02.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.852+0000 7f515dc00700 1 -- 172.21.15.28:0/2404734576 shutdown_connections 2024-06-06T08:43:02.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.852+0000 7f515dc00700 1 -- 172.21.15.28:0/2404734576 wait complete. 2024-06-06T08:43:02.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.854+0000 7f515dc00700 1 Processor -- start 2024-06-06T08:43:02.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.854+0000 7f515dc00700 1 -- start start 2024-06-06T08:43:02.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.854+0000 7f515dc00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51580746c0 0x7f515819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.854+0000 7f515dc00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5158074fe0 0x7f515819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.854+0000 7f515dc00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f515810ee90 0x7f515819f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.854+0000 7f515dc00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f51581149d0 con 0x7f515810ee90 2024-06-06T08:43:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.854+0000 7f515dc00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5158114850 con 0x7f51580746c0 2024-06-06T08:43:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.854+0000 7f515dc00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5158114b50 con 0x7f5158074fe0 2024-06-06T08:43:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.855+0000 7f5156a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51580746c0 0x7f515819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.855+0000 7f5156a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51580746c0 0x7f515819ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:56582/0 (socket says 172.21.15.28:56582) 2024-06-06T08:43:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.855+0000 7f5156a00700 1 -- 172.21.15.28:0/3823289854 learned_addr learned my addr 172.21.15.28:0/3823289854 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.855+0000 7f5157400700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f515810ee90 0x7f515819f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.855+0000 7f5156000700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5158074fe0 0x7f515819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.855+0000 7f5156a00700 1 -- 172.21.15.28:0/3823289854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5158074fe0 msgr2=0x7f515819b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:02.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.855+0000 7f5156a00700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5158074fe0 0x7f515819b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.855+0000 7f5156a00700 1 -- 172.21.15.28:0/3823289854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f515810ee90 msgr2=0x7f515819f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:02.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.855+0000 7f5156a00700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f515810ee90 0x7f515819f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.855+0000 7f5156a00700 1 -- 172.21.15.28:0/3823289854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515819fdb0 con 0x7f51580746c0 2024-06-06T08:43:02.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.856+0000 7f5156a00700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51580746c0 0x7f515819ada0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f514800e9a0 tx=0x7f514800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:02.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.856+0000 7f514f400700 1 -- 172.21.15.28:0/3823289854 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514800cbd0 con 0x7f51580746c0 2024-06-06T08:43:02.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.856+0000 7f514f400700 1 -- 172.21.15.28:0/3823289854 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f514800cd70 con 0x7f51580746c0 2024-06-06T08:43:02.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.856+0000 7f515dc00700 1 -- 172.21.15.28:0/3823289854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51581a00a0 con 0x7f51580746c0 2024-06-06T08:43:02.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.856+0000 7f514f400700 1 -- 172.21.15.28:0/3823289854 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148018750 con 0x7f51580746c0 2024-06-06T08:43:02.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.856+0000 7f515dc00700 1 -- 172.21.15.28:0/3823289854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51581a7920 con 0x7f51580746c0 2024-06-06T08:43:02.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.862+0000 7f514f400700 1 -- 172.21.15.28:0/3823289854 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5148010430 con 0x7f51580746c0 2024-06-06T08:43:02.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f516863cb80 1 Processor -- start 2024-06-06T08:43:02.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f516863cb80 1 -- start start 2024-06-06T08:43:02.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f514f400700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f513c0a2c20 0x7f513c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f516863cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbbb40 0x55aebbcbbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f516863cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbc460 0x55aebbcb5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f516863cb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 0x55aebbcb6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f516863cb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55aebbbc49c0 con 0x55aebbcb61f0 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f516863cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aebbc07ab0 con 0x55aebbcbbb40 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f516863cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55aebbbc28a0 con 0x55aebbcbc460 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f514f400700 1 -- 172.21.15.28:0/3823289854 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f51480cf3e0 con 0x7f51580746c0 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5156a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbbb40 0x55aebbcbbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5157400700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f513c0a2c20 0x7f513c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5156a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbbb40 0x55aebbcbbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:56586/0 (socket says 172.21.15.28:56586) 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5156a00700 1 -- 172.21.15.28:0/1116387055 learned_addr learned my addr 172.21.15.28:0/1116387055 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5157400700 1 --2- 172.21.15.28:0/1116387055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 0x55aebbcb6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5156000700 1 --2- 172.21.15.28:0/1116387055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbc460 0x55aebbcb5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5156a00700 1 -- 172.21.15.28:0/1116387055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbc460 msgr2=0x55aebbcb5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:02.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5156a00700 1 --2- 172.21.15.28:0/1116387055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbc460 0x55aebbcb5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5156a00700 1 -- 172.21.15.28:0/1116387055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 msgr2=0x55aebbcb6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:02.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5156a00700 1 --2- 172.21.15.28:0/1116387055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 0x55aebbcb6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5156a00700 1 -- 172.21.15.28:0/1116387055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebbbaff40 con 0x55aebbcbbb40 2024-06-06T08:43:02.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.863+0000 7f5156000700 1 --2- 172.21.15.28:0/1116387055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbc460 0x55aebbcb5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:43:02.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.864+0000 7f5156a00700 1 --2- 172.21.15.28:0/1116387055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbbb40 0x55aebbcbbf20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f514809baf0 tx=0x7f514809b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14116dadb82a1489 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:02.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.864+0000 7f5157400700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f513c0a2c20 0x7f513c0a50e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f515000b780 tx=0x7f51500097e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:02.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.864+0000 7f5143e00700 1 -- 172.21.15.28:0/1116387055 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51480bbf20 con 0x55aebbcbbb40 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.864+0000 7f5143e00700 1 -- 172.21.15.28:0/1116387055 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f514809c260 con 0x55aebbcbbb40 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.864+0000 7f5143e00700 1 -- 172.21.15.28:0/1116387055 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51480ccf10 con 0x55aebbcbbb40 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.865+0000 7f516863cb80 1 -- 172.21.15.28:0/1116387055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbbb40 msgr2=0x55aebbcbbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.865+0000 7f516863cb80 1 --2- 172.21.15.28:0/1116387055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbbb40 0x55aebbcbbf20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f514809baf0 tx=0x7f514809b720 comp rx=0 tx=0).stop 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.865+0000 7f516863cb80 1 -- 172.21.15.28:0/1116387055 shutdown_connections 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.865+0000 7f516863cb80 1 --2- 172.21.15.28:0/1116387055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 0x55aebbcb6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.865+0000 7f516863cb80 1 --2- 172.21.15.28:0/1116387055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbbb40 0x55aebbcbbf20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.865+0000 7f516863cb80 1 --2- 172.21.15.28:0/1116387055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbc460 0x55aebbcb5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.865+0000 7f516863cb80 1 -- 172.21.15.28:0/1116387055 >> 172.21.15.28:0/1116387055 conn(0x55aebbbe2120 msgr2=0x55aebbcb0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.865+0000 7f516863cb80 1 -- 172.21.15.28:0/1116387055 shutdown_connections 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.865+0000 7f516863cb80 1 -- 172.21.15.28:0/1116387055 wait complete. 2024-06-06T08:43:02.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.866+0000 7f516863cb80 1 -- start start 2024-06-06T08:43:02.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.866+0000 7f516863cb80 1 Processor -- start 2024-06-06T08:43:02.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.866+0000 7f516863cb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 0x55aebbcc2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f516863cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbbb40 0x55aebbcbf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f516863cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbc460 0x55aebbcbfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f516863cb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55aebbba3f10 con 0x55aebbcb61f0 2024-06-06T08:43:02.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f516863cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aebbc03a70 con 0x55aebbcbc460 2024-06-06T08:43:02.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f516863cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55aebbcc2de0 con 0x55aebbcbbb40 2024-06-06T08:43:02.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f516863cb80 10 client.0 _ll_register_callbacks cb 0x55aebbb9d330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:02.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f5156a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 0x55aebbcc2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f5156000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbbb40 0x55aebbcbf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f5156a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 0x55aebbcc2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47588/0 (socket says 172.21.15.28:47588) 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f5156a00700 1 -- 172.21.15.28:0/3885151764 learned_addr learned my addr 172.21.15.28:0/3885151764 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f5157400700 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbc460 0x55aebbcbfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f5156a00700 1 -- 172.21.15.28:0/3885151764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbbb40 msgr2=0x55aebbcbf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f5156a00700 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbbb40 0x55aebbcbf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f5156a00700 1 -- 172.21.15.28:0/3885151764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbc460 msgr2=0x55aebbcbfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f5156a00700 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbc460 0x55aebbcbfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f5156a00700 1 -- 172.21.15.28:0/3885151764 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebbb56880 con 0x55aebbcb61f0 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.867+0000 7f5156000700 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbbb40 0x55aebbcbf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.868+0000 7f5156a00700 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 0x55aebbcc2240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5148098530 tx=0x7f5148010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31802c6ee5ca5b29 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.868+0000 7f5140c00700 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.868+0000 7f5140c00700 1 -- 172.21.15.28:0/3885151764 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51480bbf20 con 0x55aebbcb61f0 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.868+0000 7f5140c00700 1 -- 172.21.15.28:0/3885151764 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f51480ccf10 con 0x55aebbcb61f0 2024-06-06T08:43:02.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.868+0000 7f516863cb80 1 -- 172.21.15.28:0/3885151764 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f514809c260 con 0x55aebbcb61f0 2024-06-06T08:43:02.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.868+0000 7f5140c00700 1 -- 172.21.15.28:0/3885151764 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f514809ff10 con 0x55aebbcb61f0 2024-06-06T08:43:02.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.868+0000 7f516863cb80 10 client.14802 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:02.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.868+0000 7f516863cb80 1 -- 172.21.15.28:0/3885151764 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aebbccd5b0 con 0x55aebbcb61f0 2024-06-06T08:43:02.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.869+0000 7f5140c00700 1 -- 172.21.15.28:0/3885151764 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f514809c260 con 0x55aebbcb61f0 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.869+0000 7f5140c00700 1 -- 172.21.15.28:0/3885151764 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f51480b71b0 con 0x55aebbcb61f0 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.869+0000 7f516863cb80 10 client.14802 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.869+0000 7f516863cb80 10 client.14802 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.869+0000 7f516863cb80 20 client.14802 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.869+0000 7f516863cb80 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55aebbcce900 0x55aebbcd0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.869+0000 7f516863cb80 4 client.14802 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.869+0000 7f516863cb80 1 -- 172.21.15.28:0/3885151764 --> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aebbc14fb0 con 0x55aebbcce900 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.870+0000 7f5156000700 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55aebbcce900 0x55aebbcd0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.870+0000 7f5156000700 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55aebbcce900 0x55aebbcd0b00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5e453e07aec36d9c server_cookie=e0ce6f501ea5d5db in_seq=0 out_seq=0 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.870+0000 7f5140c00700 10 client.14802 ms_handle_connect on v2:172.21.15.37:6836/1443905946 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.871+0000 7f5140c00700 1 -- 172.21.15.28:0/3885151764 <== mds.1 v2:172.21.15.37:6836/1443905946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55aebbc14fb0 con 0x55aebbcce900 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.871+0000 7f5140c00700 10 client.14802 handle_command_reply: tid=0 2024-06-06T08:43:02.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.871+0000 7f516863cb80 1 client.14802 shutdown 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f516863cb80 1 -- 172.21.15.28:0/3885151764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 msgr2=0x55aebbcc2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f516863cb80 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 0x55aebbcc2240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5148098530 tx=0x7f5148010d10 comp rx=0 tx=0).stop 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f516863cb80 1 -- 172.21.15.28:0/3885151764 shutdown_connections 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f516863cb80 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcbc460 0x55aebbcbfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f516863cb80 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcb61f0 0x55aebbcc2240 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f516863cb80 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55aebbcce900 0x55aebbcd0b00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f516863cb80 1 --2- 172.21.15.28:0/3885151764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbbb40 0x55aebbcbf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f516863cb80 1 -- 172.21.15.28:0/3885151764 >> 172.21.15.28:0/3885151764 conn(0x55aebbbe2120 msgr2=0x55aebbcaa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f5140c00700 0 client.14802 ms_handle_reset on v2:172.21.15.37:6836/1443905946 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f516863cb80 1 -- 172.21.15.28:0/3885151764 shutdown_connections 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f516863cb80 1 -- 172.21.15.28:0/3885151764 wait complete. 2024-06-06T08:43:02.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.872+0000 7f516863cb80 20 client.14802 trim_cache size 0 max 16384 2024-06-06T08:43:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.896+0000 7f516863cb80 1 Processor -- start 2024-06-06T08:43:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.896+0000 7f516863cb80 1 -- start start 2024-06-06T08:43:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.896+0000 7f516863cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcb5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.896+0000 7f516863cb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcbbb40 0x55aebbcab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.896+0000 7f516863cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbc460 0x55aebbcb10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.896+0000 7f516863cb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55aebbccee40 con 0x55aebbcbbb40 2024-06-06T08:43:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.896+0000 7f516863cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aebbccf510 con 0x55aebbcb61f0 2024-06-06T08:43:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.896+0000 7f516863cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55aebbccfbe0 con 0x55aebbcbc460 2024-06-06T08:43:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.897+0000 7f5156a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcb5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.897+0000 7f5157400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbc460 0x55aebbcb10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.897+0000 7f5156a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcb5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:56602/0 (socket says 172.21.15.28:56602) 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.897+0000 7f5156a00700 1 -- 172.21.15.28:0/2415026709 learned_addr learned my addr 172.21.15.28:0/2415026709 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.897+0000 7f5156000700 1 --2- 172.21.15.28:0/2415026709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcbbb40 0x55aebbcab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.897+0000 7f5156a00700 1 -- 172.21.15.28:0/2415026709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbc460 msgr2=0x55aebbcb10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.897+0000 7f5156a00700 1 --2- 172.21.15.28:0/2415026709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbc460 0x55aebbcb10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.897+0000 7f5156a00700 1 -- 172.21.15.28:0/2415026709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcbbb40 msgr2=0x55aebbcab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.897+0000 7f5156a00700 1 --2- 172.21.15.28:0/2415026709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcbbb40 0x55aebbcab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.897+0000 7f5156a00700 1 -- 172.21.15.28:0/2415026709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebbcb1cc0 con 0x55aebbcb61f0 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.898+0000 7f5156a00700 1 --2- 172.21.15.28:0/2415026709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcb5cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f51480a4910 tx=0x7f514809a070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a770c7d11cdc6e5b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.898+0000 7f5143400700 1 -- 172.21.15.28:0/2415026709 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514809afb0 con 0x55aebbcb61f0 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.898+0000 7f5143400700 1 -- 172.21.15.28:0/2415026709 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f514809c260 con 0x55aebbcb61f0 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.898+0000 7f5143400700 1 -- 172.21.15.28:0/2415026709 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514809b190 con 0x55aebbcb61f0 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.899+0000 7f516863cb80 1 -- 172.21.15.28:0/2415026709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 msgr2=0x55aebbcb5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.899+0000 7f516863cb80 1 --2- 172.21.15.28:0/2415026709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcb5cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f51480a4910 tx=0x7f514809a070 comp rx=0 tx=0).stop 2024-06-06T08:43:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.899+0000 7f516863cb80 1 -- 172.21.15.28:0/2415026709 shutdown_connections 2024-06-06T08:43:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.899+0000 7f516863cb80 1 --2- 172.21.15.28:0/2415026709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbc460 0x55aebbcb10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.899+0000 7f516863cb80 1 --2- 172.21.15.28:0/2415026709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcb5cb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.899+0000 7f516863cb80 1 --2- 172.21.15.28:0/2415026709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcbbb40 0x55aebbcab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.899+0000 7f516863cb80 1 -- 172.21.15.28:0/2415026709 >> 172.21.15.28:0/2415026709 conn(0x55aebbbe2120 msgr2=0x55aebbcbe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.899+0000 7f516863cb80 1 -- 172.21.15.28:0/2415026709 shutdown_connections 2024-06-06T08:43:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.899+0000 7f516863cb80 1 -- 172.21.15.28:0/2415026709 wait complete. 2024-06-06T08:43:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.899+0000 7f516863cb80 1 -- start start 2024-06-06T08:43:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.900+0000 7f516863cb80 1 Processor -- start 2024-06-06T08:43:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.900+0000 7f516863cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcda7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.900+0000 7f516863cb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbbb40 0x55aebbcc13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.900+0000 7f516863cb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcbc460 0x55aebbcc1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.900+0000 7f516863cb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55aebbcd0980 con 0x55aebbcbc460 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.900+0000 7f516863cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aebbcd02b0 con 0x55aebbcb61f0 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.900+0000 7f516863cb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55aebbcd1050 con 0x55aebbcbbb40 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.900+0000 7f516863cb80 10 client.0 _ll_register_callbacks cb 0x55aebbb9d330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5157400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcbc460 0x55aebbcc1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5156a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcda7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5156a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcda7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:56610/0 (socket says 172.21.15.28:56610) 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5156a00700 1 -- 172.21.15.28:0/3234662087 learned_addr learned my addr 172.21.15.28:0/3234662087 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5156000700 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbbb40 0x55aebbcc13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5156a00700 1 -- 172.21.15.28:0/3234662087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbbb40 msgr2=0x55aebbcc13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5156a00700 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbbb40 0x55aebbcc13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5156a00700 1 -- 172.21.15.28:0/3234662087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcbc460 msgr2=0x55aebbcc1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5156a00700 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcbc460 0x55aebbcc1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5156a00700 1 -- 172.21.15.28:0/3234662087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebbcc2210 con 0x55aebbcb61f0 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5156a00700 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcda7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5148097fc0 tx=0x7f5148010bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79ef23961e581253 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.901+0000 7f5140c00700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f5140c00700 1 -- 172.21.15.28:0/3234662087 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514809afb0 con 0x55aebbcb61f0 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f5140c00700 1 -- 172.21.15.28:0/3234662087 <== mon.2 v2:172.21.15.37:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f51480cce80 con 0x55aebbcb61f0 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f516863cb80 1 -- 172.21.15.28:0/3234662087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f514809c260 con 0x55aebbcb61f0 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f5140c00700 1 -- 172.21.15.28:0/3234662087 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f51480a9030 con 0x55aebbcb61f0 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f516863cb80 10 client.24944 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f516863cb80 1 -- 172.21.15.28:0/3234662087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aebbcc2210 con 0x55aebbcb61f0 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f5140c00700 1 -- 172.21.15.28:0/3234662087 <== mon.2 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f514809c260 con 0x55aebbcb61f0 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f5140c00700 1 -- 172.21.15.28:0/3234662087 <== mon.2 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f51480ac070 con 0x55aebbcb61f0 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f516863cb80 10 client.24944 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f516863cb80 10 client.24944 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-06T08:43:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f516863cb80 20 client.24944 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.902+0000 7f516863cb80 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55aebbd3f380 0x55aebbd3e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.903+0000 7f516863cb80 4 client.24944 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.903+0000 7f516863cb80 1 -- 172.21.15.28:0/3234662087 --> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] -- command(tid 0: {"prefix": "status"}) -- 0x55aebbc0f530 con 0x55aebbd3f380 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.903+0000 7f5156000700 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55aebbd3f380 0x55aebbd3e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.903+0000 7f5156000700 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55aebbd3f380 0x55aebbd3e090 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8f5ebf14ed699d1 server_cookie=d1c5bba9d233a4ce in_seq=0 out_seq=0 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.903+0000 7f5140c00700 10 client.24944 ms_handle_connect on v2:172.21.15.37:6836/1443905946 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f5140c00700 1 -- 172.21.15.28:0/3234662087 <== mds.1 v2:172.21.15.37:6836/1443905946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55aebbc0f530 con 0x55aebbd3f380 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f5140c00700 10 client.24944 handle_command_reply: tid=0 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 1 client.24944 shutdown 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 1 -- 172.21.15.28:0/3234662087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 msgr2=0x55aebbcda7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcda7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5148097fc0 tx=0x7f5148010bd0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 1 -- 172.21.15.28:0/3234662087 shutdown_connections 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55aebbcbc460 0x55aebbcc1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aebbcb61f0 0x55aebbcda7a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55aebbd3f380 0x55aebbd3e090 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f5140c00700 0 client.24944 ms_handle_reset on v2:172.21.15.37:6836/1443905946 2024-06-06T08:43:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 1 --2- 172.21.15.28:0/3234662087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aebbcbbb40 0x55aebbcc13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 1 -- 172.21.15.28:0/3234662087 >> 172.21.15.28:0/3234662087 conn(0x55aebbbe2120 msgr2=0x55aebbcba680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 1 -- 172.21.15.28:0/3234662087 shutdown_connections 2024-06-06T08:43:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 1 -- 172.21.15.28:0/3234662087 wait complete. 2024-06-06T08:43:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.904+0000 7f516863cb80 20 client.24944 trim_cache size 0 max 16384 2024-06-06T08:43:02.908 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:43:02.908 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:43:02.908 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 1, 2024-06-06T08:43:02.909 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24503, 2024-06-06T08:43:02.909 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-06-06T08:43:02.909 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-06-06T08:43:02.909 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-06-06T08:43:02.909 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 161.303952751, 2024-06-06T08:43:02.909 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 28, 2024-06-06T08:43:02.909 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 92, 2024-06-06T08:43:02.909 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 88, 2024-06-06T08:43:02.909 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 216.73262329900001 2024-06-06T08:43:02.909 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:43:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 -- 172.21.15.28:0/3823289854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f513c0a2c20 msgr2=0x7f513c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f513c0a2c20 0x7f513c0a50e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f515000b780 tx=0x7f51500097e0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 -- 172.21.15.28:0/3823289854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51580746c0 msgr2=0x7f515819ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51580746c0 0x7f515819ada0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f514800e9a0 tx=0x7f514800ecb0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 -- 172.21.15.28:0/3823289854 shutdown_connections 2024-06-06T08:43:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f513c0a2c20 0x7f513c0a50e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f515810ee90 0x7f515819f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51580746c0 0x7f515819ada0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 --2- 172.21.15.28:0/3823289854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5158074fe0 0x7f515819b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 -- 172.21.15.28:0/3823289854 >> 172.21.15.28:0/3823289854 conn(0x7f51580795f0 msgr2=0x7f51580ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 -- 172.21.15.28:0/3823289854 shutdown_connections 2024-06-06T08:43:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:02.905+0000 7f515dc00700 1 -- 172.21.15.28:0/3823289854 wait complete. 2024-06-06T08:43:03.846 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-06-06T08:43:04.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:03 smithi028 ceph-mon[31564]: pgmap v423: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-06-06T08:43:04.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:03 smithi037 ceph-mon[36609]: pgmap v423: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-06-06T08:43:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:03 smithi059 ceph-mon[36684]: pgmap v423: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-06-06T08:43:04.336 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:05.977 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:05 smithi028 ceph-mon[31564]: pgmap v424: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-06-06T08:43:06.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:05 smithi037 ceph-mon[36609]: pgmap v424: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-06-06T08:43:06.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:05 smithi059 ceph-mon[36684]: pgmap v424: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-06-06T08:43:06.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.510+0000 7fbc1e000700 1 -- 172.21.15.28:0/3708806209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbc181046b0 msgr2=0x7fbc18104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:06.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.510+0000 7fbc1e000700 1 --2- 172.21.15.28:0/3708806209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbc181046b0 0x7fbc18104b30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbc040098f0 tx=0x7fbc04009c00 comp rx=0 tx=0).stop 2024-06-06T08:43:06.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.511+0000 7fbc1e000700 1 -- 172.21.15.28:0/3708806209 shutdown_connections 2024-06-06T08:43:06.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.511+0000 7fbc1e000700 1 --2- 172.21.15.28:0/3708806209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc18105070 0x7fbc18111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.511+0000 7fbc1e000700 1 --2- 172.21.15.28:0/3708806209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc1810a6b0 0x7fbc1810aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.511+0000 7fbc1e000700 1 --2- 172.21.15.28:0/3708806209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbc181046b0 0x7fbc18104b30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.511+0000 7fbc1e000700 1 -- 172.21.15.28:0/3708806209 >> 172.21.15.28:0/3708806209 conn(0x7fbc181001a0 msgr2=0x7fbc181025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:06.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.511+0000 7fbc1e000700 1 -- 172.21.15.28:0/3708806209 shutdown_connections 2024-06-06T08:43:06.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.511+0000 7fbc1e000700 1 -- 172.21.15.28:0/3708806209 wait complete. 2024-06-06T08:43:06.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.512+0000 7fbc1e000700 1 Processor -- start 2024-06-06T08:43:06.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.512+0000 7fbc1e000700 1 -- start start 2024-06-06T08:43:06.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.512+0000 7fbc1e000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc181046b0 0x7fbc1819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.512+0000 7fbc1e000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbc18105070 0x7fbc1819b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.512+0000 7fbc1e000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc1810a6b0 0x7fbc1819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc1e000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbc18114a40 con 0x7fbc18105070 2024-06-06T08:43:06.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc1e000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbc181148c0 con 0x7fbc181046b0 2024-06-06T08:43:06.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc1e000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbc18114bc0 con 0x7fbc1810a6b0 2024-06-06T08:43:06.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc17400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc181046b0 0x7fbc1819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc17400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc181046b0 0x7fbc1819ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:51372/0 (socket says 172.21.15.28:51372) 2024-06-06T08:43:06.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc17400700 1 -- 172.21.15.28:0/378611919 learned_addr learned my addr 172.21.15.28:0/378611919 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:06.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc17e00700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc1810a6b0 0x7fbc1819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc16a00700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbc18105070 0x7fbc1819b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc17400700 1 -- 172.21.15.28:0/378611919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc1810a6b0 msgr2=0x7fbc1819f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:06.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc17400700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc1810a6b0 0x7fbc1819f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc17400700 1 -- 172.21.15.28:0/378611919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbc18105070 msgr2=0x7fbc1819b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:06.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc17400700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbc18105070 0x7fbc1819b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.513+0000 7fbc17400700 1 -- 172.21.15.28:0/378611919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1819fea0 con 0x7fbc181046b0 2024-06-06T08:43:06.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.514+0000 7fbc17400700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc181046b0 0x7fbc1819ae90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800c0c0 tx=0x7fbc0800c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:06.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.514+0000 7fbc0fe00700 1 -- 172.21.15.28:0/378611919 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc080092e0 con 0x7fbc181046b0 2024-06-06T08:43:06.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.514+0000 7fbc1e000700 1 -- 172.21.15.28:0/378611919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc181a0130 con 0x7fbc181046b0 2024-06-06T08:43:06.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.514+0000 7fbc0fe00700 1 -- 172.21.15.28:0/378611919 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc080075c0 con 0x7fbc181046b0 2024-06-06T08:43:06.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.514+0000 7fbc0fe00700 1 -- 172.21.15.28:0/378611919 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc080146e0 con 0x7fbc181046b0 2024-06-06T08:43:06.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.514+0000 7fbc1e000700 1 -- 172.21.15.28:0/378611919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc181a7a10 con 0x7fbc181046b0 2024-06-06T08:43:06.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.518+0000 7fbc0fe00700 1 -- 172.21.15.28:0/378611919 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbc0801b020 con 0x7fbc181046b0 2024-06-06T08:43:06.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.519+0000 7fbc288f3b80 1 Processor -- start 2024-06-06T08:43:06.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.519+0000 7fbc288f3b80 1 -- start start 2024-06-06T08:43:06.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.519+0000 7fbc0fe00700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbbfc0a2ca0 0x7fbbfc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.519+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 0x5562c77e0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.519+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 0x5562c77dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.520+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77db1f0 0x5562c77db630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.520+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5562c76e99c0 con 0x5562c77e1460 2024-06-06T08:43:06.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.520+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5562c772cab0 con 0x5562c77db1f0 2024-06-06T08:43:06.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.520+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5562c76e78a0 con 0x5562c77e0b40 2024-06-06T08:43:06.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.520+0000 7fbc0fe00700 1 -- 172.21.15.28:0/378611919 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fbc080cee60 con 0x7fbc181046b0 2024-06-06T08:43:06.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.520+0000 7fbc17e00700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbbfc0a2ca0 0x7fbbfc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.520+0000 7fbc17400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 0x5562c77e0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.520+0000 7fbc16a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 0x5562c77dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.520+0000 7fbc17400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 0x5562c77e0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:41918/0 (socket says 172.21.15.28:41918) 2024-06-06T08:43:06.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.520+0000 7fbc17400700 1 -- 172.21.15.28:0/2206909678 learned_addr learned my addr 172.21.15.28:0/2206909678 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:06.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.520+0000 7fbc17e00700 1 --2- 172.21.15.28:0/2206909678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77db1f0 0x5562c77db630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.521+0000 7fbc17400700 1 -- 172.21.15.28:0/2206909678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77db1f0 msgr2=0x5562c77db630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:06.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.521+0000 7fbc17400700 1 --2- 172.21.15.28:0/2206909678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77db1f0 0x5562c77db630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.521+0000 7fbc17400700 1 -- 172.21.15.28:0/2206909678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 msgr2=0x5562c77dacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:06.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.521+0000 7fbc17400700 1 --2- 172.21.15.28:0/2206909678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 0x5562c77dacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.521+0000 7fbc17400700 1 -- 172.21.15.28:0/2206909678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c76d4f40 con 0x5562c77e0b40 2024-06-06T08:43:06.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.521+0000 7fbc16a00700 1 --2- 172.21.15.28:0/2206909678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 0x5562c77dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:06.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.521+0000 7fbc17e00700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbbfc0a2ca0 0x7fbbfc0a5160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbc100134b0 tx=0x7fbc10013870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.521+0000 7fbc17400700 1 --2- 172.21.15.28:0/2206909678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 0x5562c77e0f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbc08097a40 tx=0x7fbc0809b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b05ae318fc7e3250 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.522+0000 7fbc0cc00700 1 -- 172.21.15.28:0/2206909678 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0809bce0 con 0x5562c77e0b40 2024-06-06T08:43:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.522+0000 7fbc0cc00700 1 -- 172.21.15.28:0/2206909678 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc0809b5e0 con 0x5562c77e0b40 2024-06-06T08:43:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.522+0000 7fbc0cc00700 1 -- 172.21.15.28:0/2206909678 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08007ac0 con 0x5562c77e0b40 2024-06-06T08:43:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.523+0000 7fbc288f3b80 1 -- 172.21.15.28:0/2206909678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 msgr2=0x5562c77e0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.523+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/2206909678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 0x5562c77e0f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbc08097a40 tx=0x7fbc0809b480 comp rx=0 tx=0).stop 2024-06-06T08:43:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.523+0000 7fbc288f3b80 1 -- 172.21.15.28:0/2206909678 shutdown_connections 2024-06-06T08:43:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.523+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/2206909678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77db1f0 0x5562c77db630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.523+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/2206909678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 0x5562c77e0f20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.523+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/2206909678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 0x5562c77dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.523+0000 7fbc288f3b80 1 -- 172.21.15.28:0/2206909678 >> 172.21.15.28:0/2206909678 conn(0x5562c7707120 msgr2=0x5562c77d5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:06.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.523+0000 7fbc288f3b80 1 -- 172.21.15.28:0/2206909678 shutdown_connections 2024-06-06T08:43:06.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.523+0000 7fbc288f3b80 1 -- 172.21.15.28:0/2206909678 wait complete. 2024-06-06T08:43:06.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.523+0000 7fbc288f3b80 1 -- start start 2024-06-06T08:43:06.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.524+0000 7fbc288f3b80 1 Processor -- start 2024-06-06T08:43:06.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.524+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77db1f0 0x5562c77e7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.524+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 0x5562c77e4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.524+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 0x5562c77e4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.524+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5562c76c8f10 con 0x5562c77db1f0 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.524+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5562c7728a70 con 0x5562c77e0b40 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.524+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5562c77e7e40 con 0x5562c77e1460 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.524+0000 7fbc288f3b80 10 client.0 _ll_register_callbacks cb 0x5562c76c2330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.524+0000 7fbc16a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 0x5562c77e4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.524+0000 7fbc17400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77db1f0 0x5562c77e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.525+0000 7fbc16a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 0x5562c77e4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:51390/0 (socket says 172.21.15.28:51390) 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.525+0000 7fbc16a00700 1 -- 172.21.15.28:0/3698079645 learned_addr learned my addr 172.21.15.28:0/3698079645 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.525+0000 7fbc17e00700 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 0x5562c77e4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.525+0000 7fbc16a00700 1 -- 172.21.15.28:0/3698079645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 msgr2=0x5562c77e4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.525+0000 7fbc16a00700 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 0x5562c77e4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.525+0000 7fbc16a00700 1 -- 172.21.15.28:0/3698079645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77db1f0 msgr2=0x5562c77e7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:06.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.525+0000 7fbc16a00700 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77db1f0 0x5562c77e7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.525+0000 7fbc16a00700 1 -- 172.21.15.28:0/3698079645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562c767b880 con 0x5562c77e0b40 2024-06-06T08:43:06.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.525+0000 7fbc17400700 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77db1f0 0x5562c77e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:06.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.525+0000 7fbc16a00700 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 0x5562c77e4530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc040098f0 tx=0x7fbc0400f9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f04838a9e9e327bf server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:06.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.525+0000 7fbc01600700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-06-06T08:43:06.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.526+0000 7fbc01600700 1 -- 172.21.15.28:0/3698079645 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04005450 con 0x5562c77e0b40 2024-06-06T08:43:06.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.526+0000 7fbc01600700 1 -- 172.21.15.28:0/3698079645 <== mon.2 v2:172.21.15.37:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fbc040055f0 con 0x5562c77e0b40 2024-06-06T08:43:06.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.526+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3698079645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc0809b5e0 con 0x5562c77e0b40 2024-06-06T08:43:06.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.526+0000 7fbc01600700 1 -- 172.21.15.28:0/3698079645 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbc04003680 con 0x5562c77e0b40 2024-06-06T08:43:06.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.526+0000 7fbc288f3b80 10 client.24956 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:06.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.526+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3698079645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5562c77f25f0 con 0x5562c77e0b40 2024-06-06T08:43:06.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.526+0000 7fbc01600700 1 -- 172.21.15.28:0/3698079645 <== mon.2 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc0809b5e0 con 0x5562c77e0b40 2024-06-06T08:43:06.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.527+0000 7fbc01600700 1 -- 172.21.15.28:0/3698079645 <== mon.2 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbc0400bac0 con 0x5562c77e0b40 2024-06-06T08:43:06.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.527+0000 7fbc288f3b80 10 client.24956 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:06.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.527+0000 7fbc288f3b80 10 client.24956 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-06T08:43:06.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.527+0000 7fbc288f3b80 20 client.24956 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:06.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.527+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x5562c77f4cc0 0x5562c77f6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.527+0000 7fbc288f3b80 4 client.24956 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.527+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3698079645 --> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562c7739fb0 con 0x5562c77f4cc0 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.527+0000 7fbc17400700 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x5562c77f4cc0 0x5562c77f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.528+0000 7fbc17400700 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x5562c77f4cc0 0x5562c77f6130 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51b37404f23f72d9 server_cookie=f49d5110b5f8eef7 in_seq=0 out_seq=0 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.528+0000 7fbc01600700 10 client.24956 ms_handle_connect on v2:172.21.15.37:6838/527311102 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.528+0000 7fbc01600700 1 -- 172.21.15.28:0/3698079645 <== mds.0 v2:172.21.15.37:6838/527311102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5562c7739fb0 con 0x5562c77f4cc0 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.528+0000 7fbc01600700 10 client.24956 handle_command_reply: tid=0 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc288f3b80 1 client.24956 shutdown 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3698079645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 msgr2=0x5562c77e4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 0x5562c77e4530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc040098f0 tx=0x7fbc0400f9a0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3698079645 shutdown_connections 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x5562c77f4cc0 0x5562c77f6130 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 0x5562c77e4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77db1f0 0x5562c77e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3698079645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 0x5562c77e4530 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc01600700 0 client.24956 ms_handle_reset on v2:172.21.15.37:6838/527311102 2024-06-06T08:43:06.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3698079645 >> 172.21.15.28:0/3698079645 conn(0x5562c7707120 msgr2=0x5562c77cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:06.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3698079645 shutdown_connections 2024-06-06T08:43:06.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.529+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3698079645 wait complete. 2024-06-06T08:43:06.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.530+0000 7fbc288f3b80 20 client.24956 trim_cache size 0 max 16384 2024-06-06T08:43:06.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.556+0000 7fbc288f3b80 1 Processor -- start 2024-06-06T08:43:06.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.556+0000 7fbc288f3b80 1 -- start start 2024-06-06T08:43:06.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.557+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77db1f0 0x5562c77dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.557+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 0x5562c77e3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.557+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 0x5562c77d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.557+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5562c77f4470 con 0x5562c77db1f0 2024-06-06T08:43:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.557+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5562c77f4b40 con 0x5562c77e0b40 2024-06-06T08:43:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.557+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5562c77f5210 con 0x5562c77e1460 2024-06-06T08:43:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.557+0000 7fbc17e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 0x5562c77d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.557+0000 7fbc17e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 0x5562c77d00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:41936/0 (socket says 172.21.15.28:41936) 2024-06-06T08:43:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.557+0000 7fbc17e00700 1 -- 172.21.15.28:0/2854090101 learned_addr learned my addr 172.21.15.28:0/2854090101 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.557+0000 7fbc16a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 0x5562c77e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.557+0000 7fbc17400700 1 --2- 172.21.15.28:0/2854090101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77db1f0 0x5562c77dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.558+0000 7fbc16a00700 1 -- 172.21.15.28:0/2854090101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 msgr2=0x5562c77d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.558+0000 7fbc16a00700 1 --2- 172.21.15.28:0/2854090101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 0x5562c77d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.558+0000 7fbc16a00700 1 -- 172.21.15.28:0/2854090101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77db1f0 msgr2=0x5562c77dacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:06.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.558+0000 7fbc16a00700 1 --2- 172.21.15.28:0/2854090101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77db1f0 0x5562c77dacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.558+0000 7fbc16a00700 1 -- 172.21.15.28:0/2854090101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c77f3ab0 con 0x5562c77e0b40 2024-06-06T08:43:06.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.558+0000 7fbc17e00700 1 --2- 172.21.15.28:0/2854090101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 0x5562c77d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:06.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.558+0000 7fbc16a00700 1 --2- 172.21.15.28:0/2854090101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 0x5562c77e3490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400beb0 tx=0x7fbc0400fa10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b36b6692528b6314 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:06.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.558+0000 7fbc03e00700 1 -- 172.21.15.28:0/2854090101 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc040227a0 con 0x5562c77e0b40 2024-06-06T08:43:06.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.558+0000 7fbc03e00700 1 -- 172.21.15.28:0/2854090101 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc04005250 con 0x5562c77e0b40 2024-06-06T08:43:06.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.558+0000 7fbc03e00700 1 -- 172.21.15.28:0/2854090101 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04003ce0 con 0x5562c77e0b40 2024-06-06T08:43:06.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.559+0000 7fbc288f3b80 1 -- 172.21.15.28:0/2854090101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 msgr2=0x5562c77e3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:06.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.559+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/2854090101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 0x5562c77e3490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400beb0 tx=0x7fbc0400fa10 comp rx=0 tx=0).stop 2024-06-06T08:43:06.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.559+0000 7fbc288f3b80 1 -- 172.21.15.28:0/2854090101 shutdown_connections 2024-06-06T08:43:06.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.559+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/2854090101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e1460 0x5562c77d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.559+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/2854090101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77db1f0 0x5562c77dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.559+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/2854090101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77e0b40 0x5562c77e3490 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.559+0000 7fbc288f3b80 1 -- 172.21.15.28:0/2854090101 >> 172.21.15.28:0/2854090101 conn(0x5562c7707120 msgr2=0x5562c77e1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.559+0000 7fbc288f3b80 1 -- 172.21.15.28:0/2854090101 shutdown_connections 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.559+0000 7fbc288f3b80 1 -- 172.21.15.28:0/2854090101 wait complete. 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.560+0000 7fbc288f3b80 1 -- start start 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.560+0000 7fbc288f3b80 1 Processor -- start 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.560+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77db1f0 0x5562c77e6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.560+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 0x5562c77e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.560+0000 7fbc288f3b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 0x5562c77e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.560+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5562c77f5fb0 con 0x5562c77e1460 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.560+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5562c77f58e0 con 0x5562c77db1f0 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc288f3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5562c77f6680 con 0x5562c77e0b40 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc288f3b80 10 client.0 _ll_register_callbacks cb 0x5562c76c2330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:06.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc17e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 0x5562c77e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc17e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 0x5562c77e70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59044/0 (socket says 172.21.15.28:59044) 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc17e00700 1 -- 172.21.15.28:0/3782331636 learned_addr learned my addr 172.21.15.28:0/3782331636 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc16a00700 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 0x5562c77e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc17400700 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77db1f0 0x5562c77e6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc17e00700 1 -- 172.21.15.28:0/3782331636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 msgr2=0x5562c77e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc17e00700 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 0x5562c77e6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc17e00700 1 -- 172.21.15.28:0/3782331636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77db1f0 msgr2=0x5562c77e6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc17e00700 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77db1f0 0x5562c77e6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc17e00700 1 -- 172.21.15.28:0/3782331636 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562c77fda70 con 0x5562c77e1460 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.561+0000 7fbc16a00700 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 0x5562c77e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.562+0000 7fbc17e00700 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 0x5562c77e70f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbc10012040 tx=0x7fbc1001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65438ffed8388b2e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.562+0000 7fbc01600700 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-06-06T08:43:06.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.562+0000 7fbc01600700 1 -- 172.21.15.28:0/3782331636 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10010e60 con 0x5562c77e1460 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.562+0000 7fbc01600700 1 -- 172.21.15.28:0/3782331636 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fbc10021a30 con 0x5562c77e1460 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.562+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3782331636 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc04005250 con 0x5562c77e1460 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.562+0000 7fbc01600700 1 -- 172.21.15.28:0/3782331636 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbc10021c30 con 0x5562c77e1460 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.562+0000 7fbc288f3b80 10 client.14826 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.562+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3782331636 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5562c78607d0 con 0x5562c77e1460 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.563+0000 7fbc01600700 1 -- 172.21.15.28:0/3782331636 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc04005250 con 0x5562c77e1460 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.563+0000 7fbc01600700 1 -- 172.21.15.28:0/3782331636 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbc1001f070 con 0x5562c77e1460 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.563+0000 7fbc288f3b80 10 client.14826 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.563+0000 7fbc288f3b80 10 client.14826 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.563+0000 7fbc288f3b80 20 client.14826 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.563+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x5562c7865490 0x5562c78641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.563+0000 7fbc288f3b80 4 client.14826 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.563+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3782331636 --> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] -- command(tid 0: {"prefix": "status"}) -- 0x5562c7734530 con 0x5562c7865490 2024-06-06T08:43:06.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.563+0000 7fbc17400700 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x5562c7865490 0x5562c78641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:06.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.564+0000 7fbc17400700 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x5562c7865490 0x5562c78641a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e602acf3db551c3 server_cookie=ae7b58e70e28a7f0 in_seq=0 out_seq=0 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.564+0000 7fbc01600700 10 client.14826 ms_handle_connect on v2:172.21.15.37:6838/527311102 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.564+0000 7fbc01600700 1 -- 172.21.15.28:0/3782331636 <== mds.0 v2:172.21.15.37:6838/527311102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5562c7734530 con 0x5562c7865490 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.564+0000 7fbc01600700 10 client.14826 handle_command_reply: tid=0 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.564+0000 7fbc288f3b80 1 client.14826 shutdown 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.564+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3782331636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 msgr2=0x5562c77e70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.564+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 0x5562c77e70f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbc10012040 tx=0x7fbc1001b000 comp rx=0 tx=0).stop 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.565+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3782331636 shutdown_connections 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.565+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5562c77e1460 0x5562c77e70f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.565+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c77db1f0 0x5562c77e6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.565+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x5562c7865490 0x5562c78641a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.565+0000 7fbc288f3b80 1 --2- 172.21.15.28:0/3782331636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562c77e0b40 0x5562c77e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.565+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3782331636 >> 172.21.15.28:0/3782331636 conn(0x5562c7707120 msgr2=0x5562c77df600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:06.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.565+0000 7fbc01600700 0 client.14826 ms_handle_reset on v2:172.21.15.37:6838/527311102 2024-06-06T08:43:06.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.565+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3782331636 shutdown_connections 2024-06-06T08:43:06.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.565+0000 7fbc288f3b80 1 -- 172.21.15.28:0/3782331636 wait complete. 2024-06-06T08:43:06.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.565+0000 7fbc288f3b80 20 client.14826 trim_cache size 0 max 16384 2024-06-06T08:43:06.568 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:43:06.568 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:43:06.568 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2024-06-06T08:43:06.568 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24542, 2024-06-06T08:43:06.568 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-06-06T08:43:06.568 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-06-06T08:43:06.568 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-06-06T08:43:06.568 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 181.054428645, 2024-06-06T08:43:06.569 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 28, 2024-06-06T08:43:06.569 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 92, 2024-06-06T08:43:06.569 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 88, 2024-06-06T08:43:06.569 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 205.12019405300001 2024-06-06T08:43:06.569 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:43:06.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 -- 172.21.15.28:0/378611919 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbbfc0a2ca0 msgr2=0x7fbbfc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:06.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbbfc0a2ca0 0x7fbbfc0a5160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbc100134b0 tx=0x7fbc10013870 comp rx=0 tx=0).stop 2024-06-06T08:43:06.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 -- 172.21.15.28:0/378611919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc181046b0 msgr2=0x7fbc1819ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:06.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc181046b0 0x7fbc1819ae90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800c0c0 tx=0x7fbc0800c3d0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 -- 172.21.15.28:0/378611919 shutdown_connections 2024-06-06T08:43:06.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fbbfc0a2ca0 0x7fbbfc0a5160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc1810a6b0 0x7fbc1819f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc181046b0 0x7fbc1819ae90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 --2- 172.21.15.28:0/378611919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbc18105070 0x7fbc1819b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:06.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 -- 172.21.15.28:0/378611919 >> 172.21.15.28:0/378611919 conn(0x7fbc181001a0 msgr2=0x7fbc181006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:06.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 -- 172.21.15.28:0/378611919 shutdown_connections 2024-06-06T08:43:06.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:06.566+0000 7fbc1e000700 1 -- 172.21.15.28:0/378611919 wait complete. 2024-06-06T08:43:07.386 INFO:tasks.cephadm:Setup complete, yielding 2024-06-06T08:43:07.387 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-06T08:43:07.396 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi028.front.sepia.ceph.com 2024-06-06T08:43:07.397 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch status' 2024-06-06T08:43:07.864 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:08.011 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:07 smithi028 ceph-mon[31564]: pgmap v425: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:08.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:07 smithi037 ceph-mon[36609]: pgmap v425: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:08.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:07 smithi059 ceph-mon[36684]: pgmap v425: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:09.851 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:09 smithi028 ceph-mon[31564]: pgmap v426: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:10.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:09 smithi037 ceph-mon[36609]: pgmap v426: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:10.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:09 smithi059 ceph-mon[36684]: pgmap v426: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:10.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.156+0000 7f1f2fa00700 1 -- 172.21.15.28:0/1027171087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f28069490 msgr2=0x7f1f28101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:10.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.156+0000 7f1f2fa00700 1 --2- 172.21.15.28:0/1027171087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f28069490 0x7f1f28101920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1f140098f0 tx=0x7f1f14009c00 comp rx=0 tx=0).stop 2024-06-06T08:43:10.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.156+0000 7f1f2fa00700 1 -- 172.21.15.28:0/1027171087 shutdown_connections 2024-06-06T08:43:10.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.156+0000 7f1f2fa00700 1 --2- 172.21.15.28:0/1027171087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f28101e60 0x7f1f28102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:10.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.156+0000 7f1f2fa00700 1 --2- 172.21.15.28:0/1027171087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28100720 0x7f1f28100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:10.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.156+0000 7f1f2fa00700 1 --2- 172.21.15.28:0/1027171087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f28069490 0x7f1f28101920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:10.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.156+0000 7f1f2fa00700 1 -- 172.21.15.28:0/1027171087 >> 172.21.15.28:0/1027171087 conn(0x7f1f280fbce0 msgr2=0x7f1f280fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:10.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.157+0000 7f1f2fa00700 1 -- 172.21.15.28:0/1027171087 shutdown_connections 2024-06-06T08:43:10.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.157+0000 7f1f2fa00700 1 -- 172.21.15.28:0/1027171087 wait complete. 2024-06-06T08:43:10.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.158+0000 7f1f2fa00700 1 Processor -- start 2024-06-06T08:43:10.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.158+0000 7f1f2fa00700 1 -- start start 2024-06-06T08:43:10.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.158+0000 7f1f2fa00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28069490 0x7f1f281987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:10.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2fa00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f28100720 0x7f1f28198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:10.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2fa00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f28101e60 0x7f1f2819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:10.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2fa00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2810d010 con 0x7f1f28101e60 2024-06-06T08:43:10.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2fa00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2810ce90 con 0x7f1f28100720 2024-06-06T08:43:10.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2fa00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2810d190 con 0x7f1f28069490 2024-06-06T08:43:10.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2d000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28069490 0x7f1f281987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:10.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2d000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28069490 0x7f1f281987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:41956/0 (socket says 172.21.15.28:41956) 2024-06-06T08:43:10.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2d000700 1 -- 172.21.15.28:0/2832935349 learned_addr learned my addr 172.21.15.28:0/2832935349 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:10.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f27e00700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f28100720 0x7f1f28198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:10.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2da00700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f28101e60 0x7f1f2819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:10.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2d000700 1 -- 172.21.15.28:0/2832935349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f28100720 msgr2=0x7f1f28198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:10.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2d000700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f28100720 0x7f1f28198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:10.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2d000700 1 -- 172.21.15.28:0/2832935349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f28101e60 msgr2=0x7f1f2819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:10.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2d000700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f28101e60 0x7f1f2819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:10.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.159+0000 7f1f2d000700 1 -- 172.21.15.28:0/2832935349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f281a0440 con 0x7f1f28069490 2024-06-06T08:43:10.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.160+0000 7f1f2d000700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28069490 0x7f1f281987e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00e9a0 tx=0x7f1f1c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:10.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.160+0000 7f1f25600700 1 -- 172.21.15.28:0/2832935349 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c004220 con 0x7f1f28069490 2024-06-06T08:43:10.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.160+0000 7f1f25600700 1 -- 172.21.15.28:0/2832935349 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f1c0043c0 con 0x7f1f28069490 2024-06-06T08:43:10.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.160+0000 7f1f25600700 1 -- 172.21.15.28:0/2832935349 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c003df0 con 0x7f1f28069490 2024-06-06T08:43:10.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.160+0000 7f1f2fa00700 1 -- 172.21.15.28:0/2832935349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f281a0730 con 0x7f1f28069490 2024-06-06T08:43:10.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.160+0000 7f1f2fa00700 1 -- 172.21.15.28:0/2832935349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f281a0c20 con 0x7f1f28069490 2024-06-06T08:43:10.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.161+0000 7f1f2fa00700 1 -- 172.21.15.28:0/2832935349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f28069180 con 0x7f1f28069490 2024-06-06T08:43:10.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.163+0000 7f1f25600700 1 -- 172.21.15.28:0/2832935349 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1f1c00c810 con 0x7f1f28069490 2024-06-06T08:43:10.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.165+0000 7f1f25600700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1f100a2c20 0x7f1f100a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:10.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.165+0000 7f1f25600700 1 -- 172.21.15.28:0/2832935349 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f1f1c0cf2f0 con 0x7f1f28069490 2024-06-06T08:43:10.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.165+0000 7f1f27e00700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1f100a2c20 0x7f1f100a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:10.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.166+0000 7f1f27e00700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1f100a2c20 0x7f1f100a50e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009810 tx=0x7f1f14019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:10.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.170+0000 7f1f25600700 1 -- 172.21.15.28:0/2832935349 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1f1c09c170 con 0x7f1f28069490 2024-06-06T08:43:10.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.424+0000 7f1f2fa00700 1 -- 172.21.15.28:0/2832935349 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f1f280628d0 con 0x7f1f100a2c20 2024-06-06T08:43:10.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.427+0000 7f1f25600700 1 -- 172.21.15.28:0/2832935349 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f1f280628d0 con 0x7f1f100a2c20 2024-06-06T08:43:10.426 INFO:teuthology.orchestra.run.smithi028.stdout:Backend: cephadm 2024-06-06T08:43:10.426 INFO:teuthology.orchestra.run.smithi028.stdout:Available: Yes 2024-06-06T08:43:10.426 INFO:teuthology.orchestra.run.smithi028.stdout:Paused: No 2024-06-06T08:43:10.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.430+0000 7f1f2fa00700 1 -- 172.21.15.28:0/2832935349 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1f100a2c20 msgr2=0x7f1f100a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:10.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.430+0000 7f1f2fa00700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1f100a2c20 0x7f1f100a50e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009810 tx=0x7f1f14019040 comp rx=0 tx=0).stop 2024-06-06T08:43:10.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.430+0000 7f1f2fa00700 1 -- 172.21.15.28:0/2832935349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28069490 msgr2=0x7f1f281987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:10.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.430+0000 7f1f2fa00700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28069490 0x7f1f281987e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00e9a0 tx=0x7f1f1c00ecb0 comp rx=0 tx=0).stop 2024-06-06T08:43:10.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.430+0000 7f1f2fa00700 1 -- 172.21.15.28:0/2832935349 shutdown_connections 2024-06-06T08:43:10.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.430+0000 7f1f2fa00700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1f100a2c20 0x7f1f100a50e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:10.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.430+0000 7f1f2fa00700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f28101e60 0x7f1f2819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:10.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.430+0000 7f1f2fa00700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28069490 0x7f1f281987e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:10.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.430+0000 7f1f2fa00700 1 --2- 172.21.15.28:0/2832935349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f28100720 0x7f1f28198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:10.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.430+0000 7f1f2fa00700 1 -- 172.21.15.28:0/2832935349 >> 172.21.15.28:0/2832935349 conn(0x7f1f280fbce0 msgr2=0x7f1f280ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:10.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.430+0000 7f1f2fa00700 1 -- 172.21.15.28:0/2832935349 shutdown_connections 2024-06-06T08:43:10.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:10.431+0000 7f1f2fa00700 1 -- 172.21.15.28:0/2832935349 wait complete. 2024-06-06T08:43:11.282 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ps' 2024-06-06T08:43:11.744 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:12.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:11 smithi028 ceph-mon[31564]: pgmap v427: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:12.042 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:11 smithi028 ceph-mon[31564]: from='client.24961 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:12.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:11 smithi037 ceph-mon[36609]: pgmap v427: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:12.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:11 smithi037 ceph-mon[36609]: from='client.24961 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:12.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:11 smithi059 ceph-mon[36684]: pgmap v427: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:12.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:11 smithi059 ceph-mon[36684]: from='client.24961 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:14.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.031+0000 7fac5a600700 1 -- 172.21.15.28:0/3838121958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5410a2f0 msgr2=0x7fac5410c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:14.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.031+0000 7fac5a600700 1 --2- 172.21.15.28:0/3838121958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5410a2f0 0x7fac5410c760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00b0a0 tx=0x7fac4c00b3b0 comp rx=0 tx=0).stop 2024-06-06T08:43:14.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.032+0000 7fac5a600700 1 -- 172.21.15.28:0/3838121958 shutdown_connections 2024-06-06T08:43:14.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.032+0000 7fac5a600700 1 --2- 172.21.15.28:0/3838121958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5410a2f0 0x7fac5410c760 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:14.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.032+0000 7fac5a600700 1 --2- 172.21.15.28:0/3838121958 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac54076440 0x7fac540748a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:14.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.032+0000 7fac5a600700 1 --2- 172.21.15.28:0/3838121958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac54074e70 0x7fac540752f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:14.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.032+0000 7fac5a600700 1 -- 172.21.15.28:0/3838121958 >> 172.21.15.28:0/3838121958 conn(0x7fac540fd970 msgr2=0x7fac540ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:14.032 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:13 smithi028 ceph-mon[31564]: pgmap v428: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:14.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.032+0000 7fac5a600700 1 -- 172.21.15.28:0/3838121958 shutdown_connections 2024-06-06T08:43:14.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.032+0000 7fac5a600700 1 -- 172.21.15.28:0/3838121958 wait complete. 2024-06-06T08:43:14.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.034+0000 7fac5a600700 1 Processor -- start 2024-06-06T08:43:14.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.034+0000 7fac5a600700 1 -- start start 2024-06-06T08:43:14.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.034+0000 7fac5a600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac54074e70 0x7fac5419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:14.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.034+0000 7fac5a600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac54076440 0x7fac5419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:14.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.034+0000 7fac5a600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5410a2f0 0x7fac541a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:14.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.034+0000 7fac5a600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fac541101e0 con 0x7fac54074e70 2024-06-06T08:43:14.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.034+0000 7fac5a600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fac54110060 con 0x7fac5410a2f0 2024-06-06T08:43:14.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.034+0000 7fac5a600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fac54110360 con 0x7fac54076440 2024-06-06T08:43:14.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac59200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac54074e70 0x7fac5419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:14.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac53e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac54076440 0x7fac5419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:14.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac59c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5410a2f0 0x7fac541a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:14.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac59c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5410a2f0 0x7fac541a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:51440/0 (socket says 172.21.15.28:51440) 2024-06-06T08:43:14.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac59200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac54074e70 0x7fac5419a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59086/0 (socket says 172.21.15.28:59086) 2024-06-06T08:43:14.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac59c00700 1 -- 172.21.15.28:0/3026200746 learned_addr learned my addr 172.21.15.28:0/3026200746 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:14.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac53e00700 1 -- 172.21.15.28:0/3026200746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5410a2f0 msgr2=0x7fac541a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:14.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac53e00700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5410a2f0 0x7fac541a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:14.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac53e00700 1 -- 172.21.15.28:0/3026200746 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac54074e70 msgr2=0x7fac5419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:14.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac53e00700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac54074e70 0x7fac5419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:14.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac53e00700 1 -- 172.21.15.28:0/3026200746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac541a2370 con 0x7fac54076440 2024-06-06T08:43:14.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.035+0000 7fac59c00700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5410a2f0 0x7fac541a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:14.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.036+0000 7fac53e00700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac54076440 0x7fac5419ac50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac4400ea20 tx=0x7fac4400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:14.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.036+0000 7fac51600700 1 -- 172.21.15.28:0/3026200746 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44004220 con 0x7fac54076440 2024-06-06T08:43:14.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.036+0000 7fac51600700 1 -- 172.21.15.28:0/3026200746 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac4400ce50 con 0x7fac54076440 2024-06-06T08:43:14.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.036+0000 7fac51600700 1 -- 172.21.15.28:0/3026200746 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44003dc0 con 0x7fac54076440 2024-06-06T08:43:14.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.036+0000 7fac5a600700 1 -- 172.21.15.28:0/3026200746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac541a2660 con 0x7fac54076440 2024-06-06T08:43:14.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.036+0000 7fac5a600700 1 -- 172.21.15.28:0/3026200746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac541a2bf0 con 0x7fac54076440 2024-06-06T08:43:14.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.037+0000 7fac5a600700 1 -- 172.21.15.28:0/3026200746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac54069180 con 0x7fac54076440 2024-06-06T08:43:14.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.039+0000 7fac51600700 1 -- 172.21.15.28:0/3026200746 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fac4400c970 con 0x7fac54076440 2024-06-06T08:43:14.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.041+0000 7fac51600700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fac3c0a2ca0 0x7fac3c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:14.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.041+0000 7fac51600700 1 -- 172.21.15.28:0/3026200746 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fac440cf280 con 0x7fac54076440 2024-06-06T08:43:14.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.041+0000 7fac59200700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fac3c0a2ca0 0x7fac3c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:14.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.042+0000 7fac59200700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fac3c0a2ca0 0x7fac3c0a5160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fac48009c60 tx=0x7fac48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:14.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.045+0000 7fac51600700 1 -- 172.21.15.28:0/3026200746 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fac4409c100 con 0x7fac54076440 2024-06-06T08:43:14.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:13 smithi037 ceph-mon[36609]: pgmap v428: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:14.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:13 smithi059 ceph-mon[36684]: pgmap v428: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:14.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.286+0000 7fac5a600700 1 -- 172.21.15.28:0/3026200746 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fac540628d0 con 0x7fac3c0a2ca0 2024-06-06T08:43:14.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.327+0000 7fac51600700 1 -- 172.21.15.28:0/3026200746 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fac540628d0 con 0x7fac3c0a2ca0 2024-06-06T08:43:14.327 INFO:teuthology.orchestra.run.smithi028.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-06T08:43:14.327 INFO:teuthology.orchestra.run.smithi028.stdout:mds.a smithi028 running (3m) 52s ago 3m 18.1M - 19.0.0-2946-g3d89accf b045ac545f82 cca8901e7351 2024-06-06T08:43:14.327 INFO:teuthology.orchestra.run.smithi028.stdout:mds.b smithi037 running (3m) 74s ago 3m 25.4M - 19.0.0-2946-g3d89accf b045ac545f82 9b5f9b2bc609 2024-06-06T08:43:14.327 INFO:teuthology.orchestra.run.smithi028.stdout:mds.c smithi059 running (3m) 73s ago 3m 21.1M - 19.0.0-2946-g3d89accf b045ac545f82 e6f5b1445916 2024-06-06T08:43:14.328 INFO:teuthology.orchestra.run.smithi028.stdout:mds.d smithi028 running (4m) 52s ago 3m 13.2M - 19.0.0-2946-g3d89accf b045ac545f82 c29d2ec501a3 2024-06-06T08:43:14.328 INFO:teuthology.orchestra.run.smithi028.stdout:mds.e smithi037 running (3m) 74s ago 3m 19.0M - 19.0.0-2946-g3d89accf b045ac545f82 f451a0b45195 2024-06-06T08:43:14.328 INFO:teuthology.orchestra.run.smithi028.stdout:mds.f smithi059 running (3m) 73s ago 3m 22.5M - 19.0.0-2946-g3d89accf b045ac545f82 2a4b5056d183 2024-06-06T08:43:14.328 INFO:teuthology.orchestra.run.smithi028.stdout:mds.g smithi028 running (3m) 52s ago 3m 18.1M - 19.0.0-2946-g3d89accf b045ac545f82 ee17ab967d38 2024-06-06T08:43:14.328 INFO:teuthology.orchestra.run.smithi028.stdout:mds.h smithi037 running (3m) 74s ago 3m 19.5M - 19.0.0-2946-g3d89accf b045ac545f82 bfa090feaa21 2024-06-06T08:43:14.328 INFO:teuthology.orchestra.run.smithi028.stdout:mds.i smithi059 running (3m) 73s ago 3m 18.7M - 19.0.0-2946-g3d89accf b045ac545f82 9b4c36b19d7b 2024-06-06T08:43:14.328 INFO:teuthology.orchestra.run.smithi028.stdout:mds.j smithi028 running (4m) 52s ago 4m 13.2M - 19.0.0-2946-g3d89accf b045ac545f82 de48cba5fc90 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:mds.k smithi037 running (4m) 74s ago 4m 21.4M - 19.0.0-2946-g3d89accf b045ac545f82 22164ee410a4 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:mds.l smithi059 running (4m) 73s ago 4m 18.0M - 19.0.0-2946-g3d89accf b045ac545f82 21f07610004f 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:mgr.x smithi028 *:9283,8765 running (12m) 52s ago 12m 516M - 19.0.0-2946-g3d89accf b045ac545f82 2b47e19df158 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:mgr.y smithi037 *:8443,8765 running (10m) 74s ago 10m 455M - 19.0.0-2946-g3d89accf b045ac545f82 1c61dd9f9c0e 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:mgr.z smithi059 *:8443,8765 running (10m) 73s ago 10m 453M - 19.0.0-2946-g3d89accf b045ac545f82 a3cbafc5e16e 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:mon.a smithi028 running (12m) 52s ago 12m 49.7M 2048M 19.0.0-2946-g3d89accf b045ac545f82 82bd645ae771 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:mon.b smithi037 running (10m) 74s ago 10m 42.5M 2048M 19.0.0-2946-g3d89accf b045ac545f82 cad5b6259a97 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:mon.c smithi059 running (10m) 73s ago 10m 42.1M 2048M 19.0.0-2946-g3d89accf b045ac545f82 5e521794a5c0 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:osd.0 smithi028 running (9m) 52s ago 9m 46.1M 4273M 19.0.0-2946-g3d89accf b045ac545f82 3738f6b6eac9 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:osd.1 smithi037 running (9m) 74s ago 9m 56.2M 4273M 19.0.0-2946-g3d89accf b045ac545f82 9fe900380fad 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:osd.2 smithi059 running (8m) 73s ago 8m 60.0M 4273M 19.0.0-2946-g3d89accf b045ac545f82 786209f0d7e6 2024-06-06T08:43:14.329 INFO:teuthology.orchestra.run.smithi028.stdout:osd.3 smithi028 running (8m) 52s ago 8m 43.6M 4273M 19.0.0-2946-g3d89accf b045ac545f82 9cc3e80f3ec4 2024-06-06T08:43:14.330 INFO:teuthology.orchestra.run.smithi028.stdout:osd.4 smithi037 running (7m) 74s ago 7m 44.9M 4273M 19.0.0-2946-g3d89accf b045ac545f82 ed4eafc12fce 2024-06-06T08:43:14.330 INFO:teuthology.orchestra.run.smithi028.stdout:osd.5 smithi059 running (7m) 73s ago 7m 47.1M 4273M 19.0.0-2946-g3d89accf b045ac545f82 5f59f8b84598 2024-06-06T08:43:14.330 INFO:teuthology.orchestra.run.smithi028.stdout:osd.6 smithi028 running (6m) 52s ago 6m 52.7M 4273M 19.0.0-2946-g3d89accf b045ac545f82 40b85554efd2 2024-06-06T08:43:14.330 INFO:teuthology.orchestra.run.smithi028.stdout:osd.7 smithi037 running (6m) 74s ago 6m 44.3M 4273M 19.0.0-2946-g3d89accf b045ac545f82 ddb090c6c0d2 2024-06-06T08:43:14.330 INFO:teuthology.orchestra.run.smithi028.stdout:osd.8 smithi059 running (6m) 73s ago 6m 55.0M 4273M 19.0.0-2946-g3d89accf b045ac545f82 f9ed6082cfd6 2024-06-06T08:43:14.330 INFO:teuthology.orchestra.run.smithi028.stdout:osd.9 smithi028 running (5m) 52s ago 5m 43.1M 4273M 19.0.0-2946-g3d89accf b045ac545f82 8dd3245d8de1 2024-06-06T08:43:14.330 INFO:teuthology.orchestra.run.smithi028.stdout:osd.10 smithi037 running (5m) 74s ago 5m 43.5M 4273M 19.0.0-2946-g3d89accf b045ac545f82 6e7aefc5b3c5 2024-06-06T08:43:14.330 INFO:teuthology.orchestra.run.smithi028.stdout:osd.11 smithi059 running (4m) 73s ago 4m 41.0M 4273M 19.0.0-2946-g3d89accf b045ac545f82 4a9d09db3122 2024-06-06T08:43:14.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.331+0000 7fac5a600700 1 -- 172.21.15.28:0/3026200746 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fac3c0a2ca0 msgr2=0x7fac3c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:14.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.331+0000 7fac5a600700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fac3c0a2ca0 0x7fac3c0a5160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fac48009c60 tx=0x7fac48009260 comp rx=0 tx=0).stop 2024-06-06T08:43:14.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.331+0000 7fac5a600700 1 -- 172.21.15.28:0/3026200746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac54076440 msgr2=0x7fac5419ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:14.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.331+0000 7fac5a600700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac54076440 0x7fac5419ac50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac4400ea20 tx=0x7fac4400ed30 comp rx=0 tx=0).stop 2024-06-06T08:43:14.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.331+0000 7fac5a600700 1 -- 172.21.15.28:0/3026200746 shutdown_connections 2024-06-06T08:43:14.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.332+0000 7fac5a600700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fac3c0a2ca0 0x7fac3c0a5160 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.332+0000 7fac5a600700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5410a2f0 0x7fac541a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.332+0000 7fac5a600700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac54074e70 0x7fac5419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.332+0000 7fac5a600700 1 --2- 172.21.15.28:0/3026200746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac54076440 0x7fac5419ac50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.332+0000 7fac5a600700 1 -- 172.21.15.28:0/3026200746 >> 172.21.15.28:0/3026200746 conn(0x7fac540fd970 msgr2=0x7fac54106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.332+0000 7fac5a600700 1 -- 172.21.15.28:0/3026200746 shutdown_connections 2024-06-06T08:43:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:14.332+0000 7fac5a600700 1 -- 172.21.15.28:0/3026200746 wait complete. 2024-06-06T08:43:15.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ls' 2024-06-06T08:43:15.629 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:16.019 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:15 smithi028 ceph-mon[31564]: from='client.24967 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:16.019 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:15 smithi028 ceph-mon[31564]: pgmap v429: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:16.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:15 smithi037 ceph-mon[36609]: from='client.24967 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:16.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:15 smithi037 ceph-mon[36609]: pgmap v429: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:16.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:15 smithi059 ceph-mon[36684]: from='client.24967 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:16.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:15 smithi059 ceph-mon[36684]: pgmap v429: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:17.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.899+0000 7f6123a00700 1 -- 172.21.15.28:0/63789712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f611c102f80 msgr2=0x7f611c105370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:17.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.899+0000 7f6123a00700 1 --2- 172.21.15.28:0/63789712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f611c102f80 0x7f611c105370 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6104009990 tx=0x7f6104009ca0 comp rx=0 tx=0).stop 2024-06-06T08:43:17.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.900+0000 7f6123a00700 1 -- 172.21.15.28:0/63789712 shutdown_connections 2024-06-06T08:43:17.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.900+0000 7f6123a00700 1 --2- 172.21.15.28:0/63789712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f611c1081e0 0x7f611c10a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:17.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.900+0000 7f6123a00700 1 --2- 172.21.15.28:0/63789712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f611c102f80 0x7f611c105370 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:17.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.900+0000 7f6123a00700 1 --2- 172.21.15.28:0/63789712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f611c1058b0 0x7f611c107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:17.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.900+0000 7f6123a00700 1 -- 172.21.15.28:0/63789712 >> 172.21.15.28:0/63789712 conn(0x7f611c0fc990 msgr2=0x7f611c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:17.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.900+0000 7f6123a00700 1 -- 172.21.15.28:0/63789712 shutdown_connections 2024-06-06T08:43:17.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.900+0000 7f6123a00700 1 -- 172.21.15.28:0/63789712 wait complete. 2024-06-06T08:43:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.901+0000 7f6123a00700 1 Processor -- start 2024-06-06T08:43:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.901+0000 7f6123a00700 1 -- start start 2024-06-06T08:43:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.901+0000 7f6123a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f611c102f80 0x7f611c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.901+0000 7f6123a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f611c1058b0 0x7f611c19af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.901+0000 7f6123a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f611c1081e0 0x7f611c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6123a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f611c10e110 con 0x7f611c1058b0 2024-06-06T08:43:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6123a00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f611c10df90 con 0x7f611c102f80 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6123a00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f611c10e290 con 0x7f611c1081e0 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6113e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f611c1058b0 0x7f611c19af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6113e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f611c1058b0 0x7f611c19af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59136/0 (socket says 172.21.15.28:59136) 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6113e00700 1 -- 172.21.15.28:0/2384698499 learned_addr learned my addr 172.21.15.28:0/2384698499 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6121000700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f611c102f80 0x7f611c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6121a00700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f611c1081e0 0x7f611c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6121a00700 1 -- 172.21.15.28:0/2384698499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f611c102f80 msgr2=0x7f611c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6121a00700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f611c102f80 0x7f611c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6121a00700 1 -- 172.21.15.28:0/2384698499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f611c1058b0 msgr2=0x7f611c19af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6121a00700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f611c1058b0 0x7f611c19af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6121a00700 1 -- 172.21.15.28:0/2384698499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c1a2630 con 0x7f611c1081e0 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6121000700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f611c102f80 0x7f611c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.902+0000 7f6113e00700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f611c1058b0 0x7f611c19af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.903+0000 7f6121a00700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f611c1081e0 0x7f611c1a1f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f611400efc0 tx=0x7f611400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:17.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.903+0000 7f611a000700 1 -- 172.21.15.28:0/2384698499 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61140092e0 con 0x7f611c1081e0 2024-06-06T08:43:17.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.903+0000 7f611a000700 1 -- 172.21.15.28:0/2384698499 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6114004bb0 con 0x7f611c1081e0 2024-06-06T08:43:17.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.903+0000 7f611a000700 1 -- 172.21.15.28:0/2384698499 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114004280 con 0x7f611c1081e0 2024-06-06T08:43:17.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.903+0000 7f6123a00700 1 -- 172.21.15.28:0/2384698499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611c1a28c0 con 0x7f611c1081e0 2024-06-06T08:43:17.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.903+0000 7f6123a00700 1 -- 172.21.15.28:0/2384698499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f611c1a2e00 con 0x7f611c1081e0 2024-06-06T08:43:17.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.904+0000 7f6123a00700 1 -- 172.21.15.28:0/2384698499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f8005330 con 0x7f611c1081e0 2024-06-06T08:43:17.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.906+0000 7f611a000700 1 -- 172.21.15.28:0/2384698499 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f611401b030 con 0x7f611c1081e0 2024-06-06T08:43:17.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.908+0000 7f611a000700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60fc0a2ca0 0x7f60fc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:17.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.908+0000 7f611a000700 1 -- 172.21.15.28:0/2384698499 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f61140ceaa0 con 0x7f611c1081e0 2024-06-06T08:43:17.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.908+0000 7f6121000700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60fc0a2ca0 0x7f60fc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:17.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.909+0000 7f6121000700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60fc0a2ca0 0x7f60fc0a5160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f610400b7b0 tx=0x7f610400b880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:17.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:17.913+0000 7f611a000700 1 -- 172.21.15.28:0/2384698499 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6114022020 con 0x7f611c1081e0 2024-06-06T08:43:18.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:17 smithi028 ceph-mon[31564]: pgmap v430: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:18.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:17 smithi037 ceph-mon[36609]: pgmap v430: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:18.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:17 smithi059 ceph-mon[36684]: pgmap v430: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:18.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.152+0000 7f6123a00700 1 -- 172.21.15.28:0/2384698499 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f60f8000bc0 con 0x7f60fc0a2ca0 2024-06-06T08:43:18.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.169+0000 7f611a000700 1 -- 172.21.15.28:0/2384698499 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f60f8000bc0 con 0x7f60fc0a2ca0 2024-06-06T08:43:18.168 INFO:teuthology.orchestra.run.smithi028.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-06-06T08:43:18.168 INFO:teuthology.orchestra.run.smithi028.stdout:mds.all 12/12 77s ago 4m smithi028=a;smithi028=d;smithi028=g;smithi028=j;smithi037=b;smithi037=e;smithi037=h;smithi037=k;smithi059=c;smithi059=f;smithi059=i;smithi059=l;count:12 2024-06-06T08:43:18.168 INFO:teuthology.orchestra.run.smithi028.stdout:mgr 3/3 77s ago 10m smithi028=x;smithi037=y;smithi059=z;count:3 2024-06-06T08:43:18.169 INFO:teuthology.orchestra.run.smithi028.stdout:mon 3/3 77s ago 10m smithi028:172.21.15.28=a;smithi037:172.21.15.37=b;smithi059:172.21.15.59=c;count:3 2024-06-06T08:43:18.169 INFO:teuthology.orchestra.run.smithi028.stdout:osd 12 77s ago - 2024-06-06T08:43:18.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.172+0000 7f6123a00700 1 -- 172.21.15.28:0/2384698499 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60fc0a2ca0 msgr2=0x7f60fc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:18.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.172+0000 7f6123a00700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60fc0a2ca0 0x7f60fc0a5160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f610400b7b0 tx=0x7f610400b880 comp rx=0 tx=0).stop 2024-06-06T08:43:18.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.172+0000 7f6123a00700 1 -- 172.21.15.28:0/2384698499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f611c1081e0 msgr2=0x7f611c1a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:18.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.172+0000 7f6123a00700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f611c1081e0 0x7f611c1a1f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f611400efc0 tx=0x7f611400c3a0 comp rx=0 tx=0).stop 2024-06-06T08:43:18.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.172+0000 7f6123a00700 1 -- 172.21.15.28:0/2384698499 shutdown_connections 2024-06-06T08:43:18.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.172+0000 7f6123a00700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f60fc0a2ca0 0x7f60fc0a5160 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:18.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.172+0000 7f6123a00700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f611c1081e0 0x7f611c1a1f90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:18.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.172+0000 7f6123a00700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f611c102f80 0x7f611c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:18.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.172+0000 7f6123a00700 1 --2- 172.21.15.28:0/2384698499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f611c1058b0 0x7f611c19af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:18.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.172+0000 7f6123a00700 1 -- 172.21.15.28:0/2384698499 >> 172.21.15.28:0/2384698499 conn(0x7f611c0fc990 msgr2=0x7f611c1027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:18.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.173+0000 7f6123a00700 1 -- 172.21.15.28:0/2384698499 shutdown_connections 2024-06-06T08:43:18.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:18.173+0000 7f6123a00700 1 -- 172.21.15.28:0/2384698499 wait complete. 2024-06-06T08:43:19.055 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch host ls' 2024-06-06T08:43:19.558 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:20.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:19 smithi028 ceph-mon[31564]: from='client.24973 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:20.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:19 smithi028 ceph-mon[31564]: pgmap v431: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:20.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:19 smithi037 ceph-mon[36609]: from='client.24973 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:20.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:19 smithi037 ceph-mon[36609]: pgmap v431: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:20.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:19 smithi059 ceph-mon[36684]: from='client.24973 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:20.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:19 smithi059 ceph-mon[36684]: pgmap v431: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:21.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.859+0000 7f48da200700 1 -- 172.21.15.28:0/1699450064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f48d410a5a0 msgr2=0x7f48d4110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:21.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.859+0000 7f48da200700 1 --2- 172.21.15.28:0/1699450064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f48d410a5a0 0x7f48d4110e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00b0d0 tx=0x7f48cc00b3e0 comp rx=0 tx=0).stop 2024-06-06T08:43:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.859+0000 7f48da200700 1 -- 172.21.15.28:0/1699450064 shutdown_connections 2024-06-06T08:43:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.859+0000 7f48da200700 1 --2- 172.21.15.28:0/1699450064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f48d410a5a0 0x7f48d4110e50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.859+0000 7f48da200700 1 --2- 172.21.15.28:0/1699450064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d4108a00 0x7f48d4108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.859+0000 7f48da200700 1 --2- 172.21.15.28:0/1699450064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d4109c00 0x7f48d410a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.859+0000 7f48da200700 1 -- 172.21.15.28:0/1699450064 >> 172.21.15.28:0/1699450064 conn(0x7f48d40779d0 msgr2=0x7f48d4079e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.859+0000 7f48da200700 1 -- 172.21.15.28:0/1699450064 shutdown_connections 2024-06-06T08:43:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.859+0000 7f48da200700 1 -- 172.21.15.28:0/1699450064 wait complete. 2024-06-06T08:43:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.860+0000 7f48da200700 1 Processor -- start 2024-06-06T08:43:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.861+0000 7f48da200700 1 -- start start 2024-06-06T08:43:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.861+0000 7f48da200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d4108a00 0x7f48d419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.861+0000 7f48da200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d4109c00 0x7f48d419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.861+0000 7f48da200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f48d410a5a0 0x7f48d41a6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.861+0000 7f48da200700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f48d4114640 con 0x7f48d410a5a0 2024-06-06T08:43:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.861+0000 7f48da200700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f48d41144c0 con 0x7f48d4109c00 2024-06-06T08:43:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.861+0000 7f48da200700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f48d41147c0 con 0x7f48d4108a00 2024-06-06T08:43:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.861+0000 7f48d9800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f48d410a5a0 0x7f48d41a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.862+0000 7f48cbe00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d4109c00 0x7f48d419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.862+0000 7f48d9800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f48d410a5a0 0x7f48d41a6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59144/0 (socket says 172.21.15.28:59144) 2024-06-06T08:43:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.862+0000 7f48d9800700 1 -- 172.21.15.28:0/4024067783 learned_addr learned my addr 172.21.15.28:0/4024067783 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.862+0000 7f48d8e00700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d4108a00 0x7f48d419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.862+0000 7f48d9800700 1 -- 172.21.15.28:0/4024067783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d4108a00 msgr2=0x7f48d419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.862+0000 7f48d9800700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d4108a00 0x7f48d419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.862+0000 7f48d9800700 1 -- 172.21.15.28:0/4024067783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d4109c00 msgr2=0x7f48d419f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.862+0000 7f48d9800700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d4109c00 0x7f48d419f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.862+0000 7f48d9800700 1 -- 172.21.15.28:0/4024067783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d41a67c0 con 0x7f48d410a5a0 2024-06-06T08:43:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.862+0000 7f48cbe00700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d4109c00 0x7f48d419f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.862+0000 7f48d9800700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f48d410a5a0 0x7f48d41a6120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f48cc007fa0 tx=0x7f48cc0079a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.863+0000 7f48d2000700 1 -- 172.21.15.28:0/4024067783 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc003c00 con 0x7f48d410a5a0 2024-06-06T08:43:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.863+0000 7f48da200700 1 -- 172.21.15.28:0/4024067783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d41a6a50 con 0x7f48d410a5a0 2024-06-06T08:43:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.863+0000 7f48d2000700 1 -- 172.21.15.28:0/4024067783 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48cc003da0 con 0x7f48d410a5a0 2024-06-06T08:43:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.863+0000 7f48d2000700 1 -- 172.21.15.28:0/4024067783 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc01b9e0 con 0x7f48d410a5a0 2024-06-06T08:43:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.863+0000 7f48da200700 1 -- 172.21.15.28:0/4024067783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d41a6e50 con 0x7f48d410a5a0 2024-06-06T08:43:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.864+0000 7f48da200700 1 -- 172.21.15.28:0/4024067783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d4069180 con 0x7f48d410a5a0 2024-06-06T08:43:21.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.866+0000 7f48d2000700 1 -- 172.21.15.28:0/4024067783 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f48cc026400 con 0x7f48d410a5a0 2024-06-06T08:43:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.867+0000 7f48d2000700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f48b80a2c20 0x7f48b80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.868+0000 7f48d2000700 1 -- 172.21.15.28:0/4024067783 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f48cc0d06f0 con 0x7f48d410a5a0 2024-06-06T08:43:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.868+0000 7f48d8e00700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f48b80a2c20 0x7f48b80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:21.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.868+0000 7f48d8e00700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f48b80a2c20 0x7f48b80a50e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f48d4109a60 tx=0x7f48c400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:21.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:21.872+0000 7f48d2000700 1 -- 172.21.15.28:0/4024067783 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f48cc02d2f0 con 0x7f48d410a5a0 2024-06-06T08:43:22.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:21 smithi028 ceph-mon[31564]: pgmap v432: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:22.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:21 smithi037 ceph-mon[36609]: pgmap v432: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:22.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:21 smithi059 ceph-mon[36684]: pgmap v432: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:22.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.113+0000 7f48da200700 1 -- 172.21.15.28:0/4024067783 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f48d40628d0 con 0x7f48b80a2c20 2024-06-06T08:43:22.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.116+0000 7f48d2000700 1 -- 172.21.15.28:0/4024067783 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f48d40628d0 con 0x7f48b80a2c20 2024-06-06T08:43:22.115 INFO:teuthology.orchestra.run.smithi028.stdout:HOST ADDR LABELS STATUS 2024-06-06T08:43:22.115 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028 172.21.15.28 2024-06-06T08:43:22.116 INFO:teuthology.orchestra.run.smithi028.stdout:smithi037 172.21.15.37 2024-06-06T08:43:22.116 INFO:teuthology.orchestra.run.smithi028.stdout:smithi059 172.21.15.59 2024-06-06T08:43:22.116 INFO:teuthology.orchestra.run.smithi028.stdout:3 hosts in cluster 2024-06-06T08:43:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.119+0000 7f48da200700 1 -- 172.21.15.28:0/4024067783 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f48b80a2c20 msgr2=0x7f48b80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.119+0000 7f48da200700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f48b80a2c20 0x7f48b80a50e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f48d4109a60 tx=0x7f48c400b410 comp rx=0 tx=0).stop 2024-06-06T08:43:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.119+0000 7f48da200700 1 -- 172.21.15.28:0/4024067783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f48d410a5a0 msgr2=0x7f48d41a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.119+0000 7f48da200700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f48d410a5a0 0x7f48d41a6120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f48cc007fa0 tx=0x7f48cc0079a0 comp rx=0 tx=0).stop 2024-06-06T08:43:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.119+0000 7f48da200700 1 -- 172.21.15.28:0/4024067783 shutdown_connections 2024-06-06T08:43:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.119+0000 7f48da200700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f48b80a2c20 0x7f48b80a50e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.119+0000 7f48da200700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f48d410a5a0 0x7f48d41a6120 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.119+0000 7f48da200700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d4108a00 0x7f48d419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.119+0000 7f48da200700 1 --2- 172.21.15.28:0/4024067783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48d4109c00 0x7f48d419f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.119+0000 7f48da200700 1 -- 172.21.15.28:0/4024067783 >> 172.21.15.28:0/4024067783 conn(0x7f48d40779d0 msgr2=0x7f48d410ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.120+0000 7f48da200700 1 -- 172.21.15.28:0/4024067783 shutdown_connections 2024-06-06T08:43:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:22.120+0000 7f48da200700 1 -- 172.21.15.28:0/4024067783 wait complete. 2024-06-06T08:43:22.957 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch device ls' 2024-06-06T08:43:23.426 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:23.945 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:23 smithi028 ceph-mon[31564]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:23.945 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:23 smithi028 ceph-mon[31564]: pgmap v433: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:23.945 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:23 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:43:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:23 smithi037 ceph-mon[36609]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:23 smithi037 ceph-mon[36609]: pgmap v433: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:23 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:43:24.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:23 smithi059 ceph-mon[36684]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:24.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:23 smithi059 ceph-mon[36684]: pgmap v433: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:24.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:23 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:43:25.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:24 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:24 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:24 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.683+0000 7f6680e00700 1 -- 172.21.15.28:0/1241151025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f667c103610 msgr2=0x7f667c103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:25.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.683+0000 7f6680e00700 1 --2- 172.21.15.28:0/1241151025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f667c103610 0x7f667c103a70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f66640099c0 tx=0x7f6664009cd0 comp rx=0 tx=0).stop 2024-06-06T08:43:25.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.684+0000 7f6680e00700 1 -- 172.21.15.28:0/1241151025 shutdown_connections 2024-06-06T08:43:25.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.684+0000 7f6680e00700 1 --2- 172.21.15.28:0/1241151025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f667c103fb0 0x7f667c10a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:25.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.684+0000 7f6680e00700 1 --2- 172.21.15.28:0/1241151025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c102410 0x7f667c102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:25.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.684+0000 7f6680e00700 1 --2- 172.21.15.28:0/1241151025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f667c103610 0x7f667c103a70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:25.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.684+0000 7f6680e00700 1 -- 172.21.15.28:0/1241151025 >> 172.21.15.28:0/1241151025 conn(0x7f667c0fd9d0 msgr2=0x7f667c0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:25.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.684+0000 7f6680e00700 1 -- 172.21.15.28:0/1241151025 shutdown_connections 2024-06-06T08:43:25.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.684+0000 7f6680e00700 1 -- 172.21.15.28:0/1241151025 wait complete. 2024-06-06T08:43:25.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.685+0000 7f6680e00700 1 Processor -- start 2024-06-06T08:43:25.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.686+0000 7f6680e00700 1 -- start start 2024-06-06T08:43:25.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.686+0000 7f6680e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f667c102410 0x7f667c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:25.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.686+0000 7f6680e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c103fb0 0x7f667c198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:25.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.686+0000 7f6680e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f667c19de20 0x7f667c1a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:25.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.686+0000 7f6680e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f667c10e000 con 0x7f667c102410 2024-06-06T08:43:25.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.686+0000 7f6680e00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f667c10de80 con 0x7f667c19de20 2024-06-06T08:43:25.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.686+0000 7f6680e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f667c10e180 con 0x7f667c103fb0 2024-06-06T08:43:25.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.686+0000 7f667b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f667c102410 0x7f667c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.686+0000 7f6672a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c103fb0 0x7f667c198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.686+0000 7f667b400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f667c102410 0x7f667c1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59162/0 (socket says 172.21.15.28:59162) 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.686+0000 7f667b400700 1 -- 172.21.15.28:0/1015458702 learned_addr learned my addr 172.21.15.28:0/1015458702 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.687+0000 7f667be00700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f667c19de20 0x7f667c1a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.687+0000 7f6672a00700 1 -- 172.21.15.28:0/1015458702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f667c19de20 msgr2=0x7f667c1a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.687+0000 7f6672a00700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f667c19de20 0x7f667c1a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.687+0000 7f6672a00700 1 -- 172.21.15.28:0/1015458702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f667c102410 msgr2=0x7f667c1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.687+0000 7f6672a00700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f667c102410 0x7f667c1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.687+0000 7f6672a00700 1 -- 172.21.15.28:0/1015458702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667c1a08b0 con 0x7f667c103fb0 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.687+0000 7f6672a00700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c103fb0 0x7f667c198e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6664008000 tx=0x7f6664009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.687+0000 7f6678c00700 1 -- 172.21.15.28:0/1015458702 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6664009e60 con 0x7f667c103fb0 2024-06-06T08:43:25.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.688+0000 7f6678c00700 1 -- 172.21.15.28:0/1015458702 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66640055b0 con 0x7f667c103fb0 2024-06-06T08:43:25.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.688+0000 7f6680e00700 1 -- 172.21.15.28:0/1015458702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667c1a0b40 con 0x7f667c103fb0 2024-06-06T08:43:25.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.688+0000 7f6678c00700 1 -- 172.21.15.28:0/1015458702 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6664017740 con 0x7f667c103fb0 2024-06-06T08:43:25.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.688+0000 7f6680e00700 1 -- 172.21.15.28:0/1015458702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f667c1a1010 con 0x7f667c103fb0 2024-06-06T08:43:25.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.689+0000 7f6680e00700 1 -- 172.21.15.28:0/1015458702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6658005360 con 0x7f667c103fb0 2024-06-06T08:43:25.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.691+0000 7f6678c00700 1 -- 172.21.15.28:0/1015458702 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6664005070 con 0x7f667c103fb0 2024-06-06T08:43:25.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.692+0000 7f6678c00700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f66600a2ca0 0x7f66600a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:25.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.693+0000 7f6678c00700 1 -- 172.21.15.28:0/1015458702 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f66640cef60 con 0x7f667c103fb0 2024-06-06T08:43:25.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.693+0000 7f667b400700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f66600a2ca0 0x7f66600a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:25.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.693+0000 7f667b400700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f66600a2ca0 0x7f66600a5160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f666c005950 tx=0x7f666c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:25.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.697+0000 7f6678c00700 1 -- 172.21.15.28:0/1015458702 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6664013070 con 0x7f667c103fb0 2024-06-06T08:43:25.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.939+0000 7f6680e00700 1 -- 172.21.15.28:0/1015458702 --> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f6658000bf0 con 0x7f66600a2ca0 2024-06-06T08:43:25.938 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:25 smithi028 ceph-mon[31564]: pgmap v434: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:25.939 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:43:25.939 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:43:25.939 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:25.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.943+0000 7f6678c00700 1 -- 172.21.15.28:0/1015458702 <== mgr.14152 v2:172.21.15.28:6800/2061522436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f6658000bf0 con 0x7f66600a2ca0 2024-06-06T08:43:25.942 INFO:teuthology.orchestra.run.smithi028.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-06-06T08:43:25.942 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747401F4480DGN 447G No 5m ago Has a FileSystem, LVM detected 2024-06-06T08:43:25.942 INFO:teuthology.orchestra.run.smithi028.stdout:smithi037 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005T400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-06-06T08:43:25.942 INFO:teuthology.orchestra.run.smithi028.stdout:smithi059 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009L400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-06-06T08:43:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.946+0000 7f6680e00700 1 -- 172.21.15.28:0/1015458702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f66600a2ca0 msgr2=0x7f66600a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.946+0000 7f6680e00700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f66600a2ca0 0x7f66600a5160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f666c005950 tx=0x7f666c009260 comp rx=0 tx=0).stop 2024-06-06T08:43:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.946+0000 7f6680e00700 1 -- 172.21.15.28:0/1015458702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c103fb0 msgr2=0x7f667c198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:25.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.946+0000 7f6680e00700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c103fb0 0x7f667c198e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6664008000 tx=0x7f6664009580 comp rx=0 tx=0).stop 2024-06-06T08:43:25.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.946+0000 7f6680e00700 1 -- 172.21.15.28:0/1015458702 shutdown_connections 2024-06-06T08:43:25.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.946+0000 7f6680e00700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f66600a2ca0 0x7f66600a5160 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:25.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.946+0000 7f6680e00700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f667c19de20 0x7f667c1a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:25.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.946+0000 7f6680e00700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f667c102410 0x7f667c1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:25.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.946+0000 7f6680e00700 1 --2- 172.21.15.28:0/1015458702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c103fb0 0x7f667c198e00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:25.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.946+0000 7f6680e00700 1 -- 172.21.15.28:0/1015458702 >> 172.21.15.28:0/1015458702 conn(0x7f667c0fd9d0 msgr2=0x7f667c106a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:25.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.947+0000 7f6680e00700 1 -- 172.21.15.28:0/1015458702 shutdown_connections 2024-06-06T08:43:25.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:25.947+0000 7f6680e00700 1 -- 172.21.15.28:0/1015458702 wait complete. 2024-06-06T08:43:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:25 smithi037 ceph-mon[36609]: pgmap v434: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:43:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:43:26.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:26.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:25 smithi059 ceph-mon[36684]: pgmap v434: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:43:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:43:26.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:43:26.724 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-06T08:43:26.733 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi028.front.sepia.ceph.com 2024-06-06T08:43:26.734 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-06T08:43:27.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:26 smithi037 ceph-mon[36609]: from='client.24985 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:27.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:26 smithi059 ceph-mon[36684]: from='client.24985 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:27.216 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:27.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:26 smithi028 ceph-mon[31564]: from='client.24985 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T08:43:27.980 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:27 smithi028 ceph-mon[31564]: pgmap v435: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:28.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:27 smithi059 ceph-mon[36684]: pgmap v435: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:28.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:27 smithi037 ceph-mon[36609]: pgmap v435: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:29.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.435+0000 7fd3cca00700 1 -- 172.21.15.28:0/3757836678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c8076460 msgr2=0x7fd3c80748c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:29.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.435+0000 7fd3cca00700 1 --2- 172.21.15.28:0/3757836678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c8076460 0x7fd3c80748c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009990 tx=0x7fd3b8009ca0 comp rx=0 tx=0).stop 2024-06-06T08:43:29.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.436+0000 7fd3cca00700 1 -- 172.21.15.28:0/3757836678 shutdown_connections 2024-06-06T08:43:29.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.436+0000 7fd3cca00700 1 --2- 172.21.15.28:0/3757836678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c810a300 0x7fd3c810c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:29.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.436+0000 7fd3cca00700 1 --2- 172.21.15.28:0/3757836678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c8076460 0x7fd3c80748c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:29.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.436+0000 7fd3cca00700 1 --2- 172.21.15.28:0/3757836678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3c8074e90 0x7fd3c8075310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:29.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.436+0000 7fd3cca00700 1 -- 172.21.15.28:0/3757836678 >> 172.21.15.28:0/3757836678 conn(0x7fd3c80fd9c0 msgr2=0x7fd3c80ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:29.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.436+0000 7fd3cca00700 1 -- 172.21.15.28:0/3757836678 shutdown_connections 2024-06-06T08:43:29.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.436+0000 7fd3cca00700 1 -- 172.21.15.28:0/3757836678 wait complete. 2024-06-06T08:43:29.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.437+0000 7fd3cca00700 1 Processor -- start 2024-06-06T08:43:29.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.437+0000 7fd3cca00700 1 -- start start 2024-06-06T08:43:29.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.437+0000 7fd3cca00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c8074e90 0x7fd3c819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:29.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.437+0000 7fd3cca00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c8076460 0x7fd3c819ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:29.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3cca00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3c810a300 0x7fd3c81a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:29.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3cca00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c8110230 con 0x7fd3c8076460 2024-06-06T08:43:29.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3cca00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c81100b0 con 0x7fd3c8074e90 2024-06-06T08:43:29.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3cca00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c81103b0 con 0x7fd3c810a300 2024-06-06T08:43:29.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3bfe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c8076460 0x7fd3c819ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:29.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3bfe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c8076460 0x7fd3c819ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41026/0 (socket says 172.21.15.28:41026) 2024-06-06T08:43:29.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3c7400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c8074e90 0x7fd3c819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:29.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3bfe00700 1 -- 172.21.15.28:0/2276134042 learned_addr learned my addr 172.21.15.28:0/2276134042 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:29.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3c7e00700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3c810a300 0x7fd3c81a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:29.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3c7400700 1 -- 172.21.15.28:0/2276134042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3c810a300 msgr2=0x7fd3c81a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:29.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3c7400700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3c810a300 0x7fd3c81a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:29.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3c7400700 1 -- 172.21.15.28:0/2276134042 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c8076460 msgr2=0x7fd3c819ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:29.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3c7400700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c8076460 0x7fd3c819ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:29.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.438+0000 7fd3c7400700 1 -- 172.21.15.28:0/2276134042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c81a2470 con 0x7fd3c8074e90 2024-06-06T08:43:29.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.439+0000 7fd3c7400700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c8074e90 0x7fd3c819a810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800b8e0 tx=0x7fd3b800bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:29.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.439+0000 7fd3c4c00700 1 -- 172.21.15.28:0/2276134042 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8026070 con 0x7fd3c8074e90 2024-06-06T08:43:29.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.439+0000 7fd3cca00700 1 -- 172.21.15.28:0/2276134042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c81a2700 con 0x7fd3c8074e90 2024-06-06T08:43:29.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.439+0000 7fd3c4c00700 1 -- 172.21.15.28:0/2276134042 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b8003d70 con 0x7fd3c8074e90 2024-06-06T08:43:29.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.439+0000 7fd3c4c00700 1 -- 172.21.15.28:0/2276134042 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8021410 con 0x7fd3c8074e90 2024-06-06T08:43:29.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.439+0000 7fd3cca00700 1 -- 172.21.15.28:0/2276134042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c81a2b60 con 0x7fd3c8074e90 2024-06-06T08:43:29.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.440+0000 7fd3cca00700 1 -- 172.21.15.28:0/2276134042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c8069180 con 0x7fd3c8074e90 2024-06-06T08:43:29.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.443+0000 7fd3c4c00700 1 -- 172.21.15.28:0/2276134042 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd3b8029070 con 0x7fd3c8074e90 2024-06-06T08:43:29.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.444+0000 7fd3c4c00700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd3ac0a2c20 0x7fd3ac0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:29.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.444+0000 7fd3c4c00700 1 -- 172.21.15.28:0/2276134042 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fd3b80d0410 con 0x7fd3c8074e90 2024-06-06T08:43:29.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.444+0000 7fd3bfe00700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd3ac0a2c20 0x7fd3ac0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:29.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.445+0000 7fd3bfe00700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd3ac0a2c20 0x7fd3ac0a50e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009d60 tx=0x7fd3b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:29.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.446+0000 7fd3c4c00700 1 -- 172.21.15.28:0/2276134042 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd3b8030080 con 0x7fd3c8074e90 2024-06-06T08:43:29.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.714+0000 7fd3cca00700 1 -- 172.21.15.28:0/2276134042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd3c802dca0 con 0x7fd3c8074e90 2024-06-06T08:43:29.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.715+0000 7fd3c4c00700 1 -- 172.21.15.28:0/2276134042 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3076 (secure 0 0 0) 0x7fd3b8087020 con 0x7fd3c8074e90 2024-06-06T08:43:29.714 INFO:teuthology.orchestra.run.smithi028.stdout:e28 2024-06-06T08:43:29.714 INFO:teuthology.orchestra.run.smithi028.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-06T08:43:29.714 INFO:teuthology.orchestra.run.smithi028.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T08:43:29.714 INFO:teuthology.orchestra.run.smithi028.stdout:legacy client fscid: 1 2024-06-06T08:43:29.714 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:43:29.714 INFO:teuthology.orchestra.run.smithi028.stdout:Filesystem 'cephfs' (1) 2024-06-06T08:43:29.714 INFO:teuthology.orchestra.run.smithi028.stdout:fs_name cephfs 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 28 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:created 2024-06-06T08:40:05.416261+0000 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:modified 2024-06-06T08:40:29.442708+0000 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:tableserver 0 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:root 0 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:session_timeout 300 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:session_autoclose 300 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:max_file_size 1099511627776 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:max_xattr_size 65536 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:required_client_features {} 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:last_failure 0 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:last_failure_osd_epoch 0 2024-06-06T08:43:29.715 INFO:teuthology.orchestra.run.smithi028.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T08:43:29.716 INFO:teuthology.orchestra.run.smithi028.stdout:max_mds 5 2024-06-06T08:43:29.716 INFO:teuthology.orchestra.run.smithi028.stdout:in 0,1,2,3,4 2024-06-06T08:43:29.716 INFO:teuthology.orchestra.run.smithi028.stdout:up {0=24542,1=24503,2=24499,3=24485,4=24484} 2024-06-06T08:43:29.716 INFO:teuthology.orchestra.run.smithi028.stdout:failed 2024-06-06T08:43:29.716 INFO:teuthology.orchestra.run.smithi028.stdout:damaged 2024-06-06T08:43:29.716 INFO:teuthology.orchestra.run.smithi028.stdout:stopped 2024-06-06T08:43:29.716 INFO:teuthology.orchestra.run.smithi028.stdout:data_pools [3] 2024-06-06T08:43:29.716 INFO:teuthology.orchestra.run.smithi028.stdout:metadata_pool 2 2024-06-06T08:43:29.716 INFO:teuthology.orchestra.run.smithi028.stdout:inline_data disabled 2024-06-06T08:43:29.716 INFO:teuthology.orchestra.run.smithi028.stdout:balancer 2024-06-06T08:43:29.716 INFO:teuthology.orchestra.run.smithi028.stdout:bal_rank_mask -1 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:standby_count_wanted 0 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:qdb_cluster leader: 24542 members: 24499,24485,24484,24503,24542 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b{0:24542} state up:active seq 8 addr [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.f{0:24472} state up:standby-replay seq 1 addr [v2:172.21.15.59:6834/2983089313,v1:172.21.15.59:6835/2983089313] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.h{1:24503} state up:active seq 15 addr [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.k{1:24455} state up:standby-replay seq 1 addr [v2:172.21.15.37:6832/1955606328,v1:172.21.15.37:6833/1955606328] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.i{2:24499} state up:active seq 15 addr [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.l{2:24436} state up:standby-replay seq 1 addr [v2:172.21.15.59:6832/3120575580,v1:172.21.15.59:6833/3120575580] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.e{3:24485} state up:active seq 18 addr [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a{3:14400} state up:standby-replay seq 1 addr [v2:172.21.15.28:6840/3192274308,v1:172.21.15.28:6841/3192274308] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c{4:24484} state up:active seq 17 addr [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.g{4:14388} state up:standby-replay seq 1 addr [v2:172.21.15.28:6838/735176440,v1:172.21.15.28:6839/735176440] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.717 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:43:29.718 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:43:29.718 INFO:teuthology.orchestra.run.smithi028.stdout:Standby daemons: 2024-06-06T08:43:29.718 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:43:29.718 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.j{-1:14358} state up:standby seq 1 addr [v2:172.21.15.28:6834/906327649,v1:172.21.15.28:6835/906327649] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.718 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.d{-1:14364} state up:standby seq 1 addr [v2:172.21.15.28:6836/165707269,v1:172.21.15.28:6837/165707269] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T08:43:29.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 -- 172.21.15.28:0/2276134042 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd3ac0a2c20 msgr2=0x7fd3ac0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:29.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd3ac0a2c20 0x7fd3ac0a50e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009d60 tx=0x7fd3b0009260 comp rx=0 tx=0).stop 2024-06-06T08:43:29.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 -- 172.21.15.28:0/2276134042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c8074e90 msgr2=0x7fd3c819a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:29.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c8074e90 0x7fd3c819a810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800b8e0 tx=0x7fd3b800bb90 comp rx=0 tx=0).stop 2024-06-06T08:43:29.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 -- 172.21.15.28:0/2276134042 shutdown_connections 2024-06-06T08:43:29.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd3ac0a2c20 0x7fd3ac0a50e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:29.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3c810a300 0x7fd3c81a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:29.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c8074e90 0x7fd3c819a810 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:29.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 --2- 172.21.15.28:0/2276134042 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c8076460 0x7fd3c819ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:29.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 -- 172.21.15.28:0/2276134042 >> 172.21.15.28:0/2276134042 conn(0x7fd3c80fd9c0 msgr2=0x7fd3c8106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:29.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 -- 172.21.15.28:0/2276134042 shutdown_connections 2024-06-06T08:43:29.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:29.718+0000 7fd3cca00700 1 -- 172.21.15.28:0/2276134042 wait complete. 2024-06-06T08:43:29.720 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 28 2024-06-06T08:43:30.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:29 smithi028 ceph-mon[31564]: pgmap v436: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:30.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:29 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2276134042' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-06T08:43:30.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:29 smithi059 ceph-mon[36684]: pgmap v436: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:30.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:29 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2276134042' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-06T08:43:30.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:29 smithi037 ceph-mon[36609]: pgmap v436: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:30.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:29 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2276134042' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-06T08:43:30.453 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- bash -c 'ceph osd dump' 2024-06-06T08:43:30.942 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:32.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:31 smithi059 ceph-mon[36684]: pgmap v437: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:32.139 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:31 smithi028 ceph-mon[31564]: pgmap v437: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:32.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:31 smithi037 ceph-mon[36609]: pgmap v437: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:33.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.206+0000 7f5d8fe00700 1 -- 172.21.15.28:0/2348607769 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d881081e0 msgr2=0x7f5d8810a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:33.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.206+0000 7f5d8fe00700 1 --2- 172.21.15.28:0/2348607769 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d881081e0 0x7f5d8810a650 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000b0a0 tx=0x7f5d8000b3b0 comp rx=0 tx=0).stop 2024-06-06T08:43:33.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.206+0000 7f5d8fe00700 1 -- 172.21.15.28:0/2348607769 shutdown_connections 2024-06-06T08:43:33.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.206+0000 7f5d8fe00700 1 --2- 172.21.15.28:0/2348607769 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d881081e0 0x7f5d8810a650 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:33.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.206+0000 7f5d8fe00700 1 --2- 172.21.15.28:0/2348607769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d88102f80 0x7f5d88105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:33.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.206+0000 7f5d8fe00700 1 --2- 172.21.15.28:0/2348607769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d881058b0 0x7f5d88107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:33.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.206+0000 7f5d8fe00700 1 -- 172.21.15.28:0/2348607769 >> 172.21.15.28:0/2348607769 conn(0x7f5d880fc990 msgr2=0x7f5d880fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:33.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.207+0000 7f5d8fe00700 1 -- 172.21.15.28:0/2348607769 shutdown_connections 2024-06-06T08:43:33.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.207+0000 7f5d8fe00700 1 -- 172.21.15.28:0/2348607769 wait complete. 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.208+0000 7f5d8fe00700 1 Processor -- start 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.208+0000 7f5d8fe00700 1 -- start start 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.208+0000 7f5d8fe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d88102f80 0x7f5d8819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.208+0000 7f5d8fe00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d881058b0 0x7f5d8819aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.208+0000 7f5d8fe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d881081e0 0x7f5d881a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.208+0000 7f5d8fe00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8810e0f0 con 0x7f5d881081e0 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.208+0000 7f5d8fe00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8810df70 con 0x7f5d881058b0 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.208+0000 7f5d8fe00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8810e270 con 0x7f5d88102f80 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.209+0000 7f5d8d400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d88102f80 0x7f5d8819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.209+0000 7f5d8d400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d88102f80 0x7f5d8819a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:55030/0 (socket says 172.21.15.28:55030) 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.209+0000 7f5d8d400700 1 -- 172.21.15.28:0/964112687 learned_addr learned my addr 172.21.15.28:0/964112687 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:33.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.209+0000 7f5d8ca00700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d881058b0 0x7f5d8819aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:33.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.209+0000 7f5d8de00700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d881081e0 0x7f5d881a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:33.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.209+0000 7f5d8d400700 1 -- 172.21.15.28:0/964112687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d881058b0 msgr2=0x7f5d8819aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:33.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.209+0000 7f5d8d400700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d881058b0 0x7f5d8819aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:33.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.209+0000 7f5d8d400700 1 -- 172.21.15.28:0/964112687 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d881081e0 msgr2=0x7f5d881a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:33.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.209+0000 7f5d8d400700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d881081e0 0x7f5d881a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:33.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.209+0000 7f5d8d400700 1 -- 172.21.15.28:0/964112687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d881a2580 con 0x7f5d88102f80 2024-06-06T08:43:33.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.209+0000 7f5d8d400700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d88102f80 0x7f5d8819a990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00e9d0 tx=0x7f5d7c00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:33.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.210+0000 7f5d86000700 1 -- 172.21.15.28:0/964112687 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00cbd0 con 0x7f5d88102f80 2024-06-06T08:43:33.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.210+0000 7f5d86000700 1 -- 172.21.15.28:0/964112687 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d7c00ee70 con 0x7f5d88102f80 2024-06-06T08:43:33.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.210+0000 7f5d86000700 1 -- 172.21.15.28:0/964112687 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c018660 con 0x7f5d88102f80 2024-06-06T08:43:33.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.210+0000 7f5d8fe00700 1 -- 172.21.15.28:0/964112687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d881a2870 con 0x7f5d88102f80 2024-06-06T08:43:33.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.210+0000 7f5d8fe00700 1 -- 172.21.15.28:0/964112687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d881a2d60 con 0x7f5d88102f80 2024-06-06T08:43:33.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.211+0000 7f5d8fe00700 1 -- 172.21.15.28:0/964112687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d88069180 con 0x7f5d88102f80 2024-06-06T08:43:33.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.213+0000 7f5d86000700 1 -- 172.21.15.28:0/964112687 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5d7c010430 con 0x7f5d88102f80 2024-06-06T08:43:33.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.214+0000 7f5d86000700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5d700a2ca0 0x7f5d700a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:33.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.215+0000 7f5d86000700 1 -- 172.21.15.28:0/964112687 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f5d7c0cf280 con 0x7f5d88102f80 2024-06-06T08:43:33.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.215+0000 7f5d8ca00700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5d700a2ca0 0x7f5d700a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:33.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.215+0000 7f5d8ca00700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5d700a2ca0 0x7f5d700a5160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009c60 tx=0x7f5d74009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:33.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.219+0000 7f5d86000700 1 -- 172.21.15.28:0/964112687 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5d7c09c100 con 0x7f5d88102f80 2024-06-06T08:43:33.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.456+0000 7f5d8fe00700 1 -- 172.21.15.28:0/964112687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f5d880630a0 con 0x7f5d88102f80 2024-06-06T08:43:33.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.457+0000 7f5d86000700 1 -- 172.21.15.28:0/964112687 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v92) ==== 56+0+5370 (secure 0 0 0) 0x7f5d7c00cd70 con 0x7f5d88102f80 2024-06-06T08:43:33.457 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 92 2024-06-06T08:43:33.457 INFO:teuthology.orchestra.run.smithi028.stdout:fsid e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:created 2024-06-06T08:30:30.991501+0000 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:modified 2024-06-06T08:41:41.833381+0000 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:crush_version 26 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:full_ratio 0.95 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:backfillfull_ratio 0.9 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:nearfull_ratio 0.85 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:require_min_compat_client luminous 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:min_compat_client luminous 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:require_osd_release squid 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:stretch_mode_enabled false 2024-06-06T08:43:33.458 INFO:teuthology.orchestra.run.smithi028.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-06-06T08:43:33.459 INFO:teuthology.orchestra.run.smithi028.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-06-06T08:43:33.459 INFO:teuthology.orchestra.run.smithi028.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-06-06T08:43:33.459 INFO:teuthology.orchestra.run.smithi028.stdout:max_osd 12 2024-06-06T08:43:33.459 INFO:teuthology.orchestra.run.smithi028.stdout:osd.0 up in weight 1 up_from 8 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.28:6802/2001709636,v1:172.21.15.28:6803/2001709636] [v2:172.21.15.28:6804/2001709636,v1:172.21.15.28:6805/2001709636] exists,up 7edaffea-7613-4d20-b9b8-108a17af8f00 2024-06-06T08:43:33.459 INFO:teuthology.orchestra.run.smithi028.stdout:osd.1 up in weight 1 up_from 13 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6800/593429648,v1:172.21.15.37:6801/593429648] [v2:172.21.15.37:6802/593429648,v1:172.21.15.37:6803/593429648] exists,up 17eb7536-c2a4-4f8b-bec4-b1abb5125836 2024-06-06T08:43:33.459 INFO:teuthology.orchestra.run.smithi028.stdout:osd.2 up in weight 1 up_from 18 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6800/88678886,v1:172.21.15.59:6801/88678886] [v2:172.21.15.59:6802/88678886,v1:172.21.15.59:6803/88678886] exists,up 3ea64fd8-13f4-4d53-933b-07055ec72701 2024-06-06T08:43:33.459 INFO:teuthology.orchestra.run.smithi028.stdout:osd.3 up in weight 1 up_from 25 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.28:6810/484290430,v1:172.21.15.28:6811/484290430] [v2:172.21.15.28:6812/484290430,v1:172.21.15.28:6813/484290430] exists,up 8be9cdb5-12a9-438e-b8cd-ce65988b0ac6 2024-06-06T08:43:33.459 INFO:teuthology.orchestra.run.smithi028.stdout:osd.4 up in weight 1 up_from 33 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6808/3596500266,v1:172.21.15.37:6809/3596500266] [v2:172.21.15.37:6810/3596500266,v1:172.21.15.37:6811/3596500266] exists,up ddea397d-d7b1-46f3-9a13-dd318cade055 2024-06-06T08:43:33.459 INFO:teuthology.orchestra.run.smithi028.stdout:osd.5 up in weight 1 up_from 38 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6808/3037648282,v1:172.21.15.59:6809/3037648282] [v2:172.21.15.59:6810/3037648282,v1:172.21.15.59:6811/3037648282] exists,up ee19857b-b047-4d15-8b17-257b6e4966a2 2024-06-06T08:43:33.459 INFO:teuthology.orchestra.run.smithi028.stdout:osd.6 up in weight 1 up_from 46 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.28:6818/3794924886,v1:172.21.15.28:6819/3794924886] [v2:172.21.15.28:6820/3794924886,v1:172.21.15.28:6821/3794924886] exists,up 1d57d0ba-8e37-4ac2-87e8-40b20b24fc53 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:osd.7 up in weight 1 up_from 51 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6816/724042860,v1:172.21.15.37:6817/724042860] [v2:172.21.15.37:6818/724042860,v1:172.21.15.37:6819/724042860] exists,up 43f3c2c8-752d-4a70-99dd-2c14aeefa137 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:osd.8 up in weight 1 up_from 59 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6816/1240363223,v1:172.21.15.59:6817/1240363223] [v2:172.21.15.59:6818/1240363223,v1:172.21.15.59:6819/1240363223] exists,up 3ffc07d7-ca79-419d-88a4-2b53d07ffae3 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:osd.9 up in weight 1 up_from 67 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.28:6826/2555848355,v1:172.21.15.28:6827/2555848355] [v2:172.21.15.28:6828/2555848355,v1:172.21.15.28:6829/2555848355] exists,up 4e014fc7-1ca3-4d6c-acdd-95ca59541310 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:osd.10 up in weight 1 up_from 72 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6824/176857372,v1:172.21.15.37:6825/176857372] [v2:172.21.15.37:6826/176857372,v1:172.21.15.37:6827/176857372] exists,up fc418661-5e89-4241-b14b-241a2be432f6 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:osd.11 up in weight 1 up_from 80 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6824/2675673798,v1:172.21.15.59:6825/2675673798] [v2:172.21.15.59:6826/2675673798,v1:172.21.15.59:6827/2675673798] exists,up e54d81ee-1461-4229-a1c0-c6e750dd66ed 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 2.5 [8,11] 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 2.c [2,1] 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 2.1b [2,4] 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 2.1f [7,11] 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.0 [4,6] 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.2 [5,8] 2024-06-06T08:43:33.460 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.6 [4,7] 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.e [4,8] 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.1b [4,7,5,9] 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.1f [1,2] 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.20 [5,9] 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.28 [3,6] 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:pg_upmap_items 3.38 [3,9] 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/4230567915 expires 2024-06-07T08:31:40.064884+0000 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:6801/2022015677 expires 2024-06-07T08:31:40.064884+0000 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:6800/3383589520 expires 2024-06-07T08:31:04.770627+0000 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/2860387445 expires 2024-06-07T08:31:04.770627+0000 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/886961600 expires 2024-06-07T08:31:40.064884+0000 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:6800/2022015677 expires 2024-06-07T08:31:40.064884+0000 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:6801/3383589520 expires 2024-06-07T08:31:04.770627+0000 2024-06-06T08:43:33.461 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/3217551014 expires 2024-06-07T08:31:40.064884+0000 2024-06-06T08:43:33.462 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/1629731223 expires 2024-06-07T08:31:04.770627+0000 2024-06-06T08:43:33.462 INFO:teuthology.orchestra.run.smithi028.stdout:blocklist 172.21.15.28:0/219831273 expires 2024-06-07T08:31:04.770627+0000 2024-06-06T08:43:33.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.460+0000 7f5d8fe00700 1 -- 172.21.15.28:0/964112687 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5d700a2ca0 msgr2=0x7f5d700a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:33.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.460+0000 7f5d8fe00700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5d700a2ca0 0x7f5d700a5160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009c60 tx=0x7f5d74009260 comp rx=0 tx=0).stop 2024-06-06T08:43:33.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.460+0000 7f5d8fe00700 1 -- 172.21.15.28:0/964112687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d88102f80 msgr2=0x7f5d8819a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:33.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.460+0000 7f5d8fe00700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d88102f80 0x7f5d8819a990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00e9d0 tx=0x7f5d7c00ece0 comp rx=0 tx=0).stop 2024-06-06T08:43:33.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.461+0000 7f5d8fe00700 1 -- 172.21.15.28:0/964112687 shutdown_connections 2024-06-06T08:43:33.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.461+0000 7f5d8fe00700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f5d700a2ca0 0x7f5d700a5160 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:33.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.461+0000 7f5d8fe00700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d881081e0 0x7f5d881a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:33.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.461+0000 7f5d8fe00700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d88102f80 0x7f5d8819a990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:33.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.461+0000 7f5d8fe00700 1 --2- 172.21.15.28:0/964112687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d881058b0 0x7f5d8819aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:33.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.461+0000 7f5d8fe00700 1 -- 172.21.15.28:0/964112687 >> 172.21.15.28:0/964112687 conn(0x7f5d880fc990 msgr2=0x7f5d881026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:33.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.461+0000 7f5d8fe00700 1 -- 172.21.15.28:0/964112687 shutdown_connections 2024-06-06T08:43:33.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:33.461+0000 7f5d8fe00700 1 -- 172.21.15.28:0/964112687 wait complete. 2024-06-06T08:43:34.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:33 smithi059 ceph-mon[36684]: pgmap v438: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:34.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:33 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/964112687' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-06T08:43:34.209 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:33 smithi028 ceph-mon[31564]: pgmap v438: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:34.209 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:33 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/964112687' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-06T08:43:34.287 INFO:teuthology.run_tasks:Running task fs.ready... 2024-06-06T08:43:34.297 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:43:34.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:33 smithi037 ceph-mon[36609]: pgmap v438: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:34.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:33 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/964112687' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-06T08:43:34.745 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:36.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:35 smithi028 ceph-mon[31564]: pgmap v439: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:36.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:35 smithi059 ceph-mon[36684]: pgmap v439: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:36.116 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:35 smithi037 ceph-mon[36609]: pgmap v439: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.973+0000 7fd914c00700 1 -- 172.21.15.28:0/4198810908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9101046b0 msgr2=0x7fd910104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.973+0000 7fd914c00700 1 --2- 172.21.15.28:0/4198810908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9101046b0 0x7fd910104b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009990 tx=0x7fd8fc009ca0 comp rx=0 tx=0).stop 2024-06-06T08:43:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.973+0000 7fd914c00700 1 -- 172.21.15.28:0/4198810908 shutdown_connections 2024-06-06T08:43:36.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.973+0000 7fd914c00700 1 --2- 172.21.15.28:0/4198810908 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd910105070 0x7fd910111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:36.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.973+0000 7fd914c00700 1 --2- 172.21.15.28:0/4198810908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd91010a6b0 0x7fd91010aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:36.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.973+0000 7fd914c00700 1 --2- 172.21.15.28:0/4198810908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9101046b0 0x7fd910104b30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:36.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.973+0000 7fd914c00700 1 -- 172.21.15.28:0/4198810908 >> 172.21.15.28:0/4198810908 conn(0x7fd9101001a0 msgr2=0x7fd9101025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:36.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.973+0000 7fd914c00700 1 -- 172.21.15.28:0/4198810908 shutdown_connections 2024-06-06T08:43:36.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.973+0000 7fd914c00700 1 -- 172.21.15.28:0/4198810908 wait complete. 2024-06-06T08:43:36.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.974+0000 7fd914c00700 1 Processor -- start 2024-06-06T08:43:36.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.974+0000 7fd914c00700 1 -- start start 2024-06-06T08:43:36.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd914c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9101046b0 0x7fd91019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd914c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd910105070 0x7fd91019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd914c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91010a6b0 0x7fd91019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd914c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd910114a40 con 0x7fd91010a6b0 2024-06-06T08:43:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd914c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd9101148c0 con 0x7fd9101046b0 2024-06-06T08:43:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd914c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd910114bc0 con 0x7fd910105070 2024-06-06T08:43:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd90d400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd910105070 0x7fd91019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd90de00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9101046b0 0x7fd91019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd90d400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd910105070 0x7fd91019b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:44492/0 (socket says 172.21.15.28:44492) 2024-06-06T08:43:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd90de00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9101046b0 0x7fd91019ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:51680/0 (socket says 172.21.15.28:51680) 2024-06-06T08:43:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd90d400700 1 -- 172.21.15.28:0/1521586772 learned_addr learned my addr 172.21.15.28:0/1521586772 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.975+0000 7fd90e800700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91010a6b0 0x7fd91019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd90d400700 1 -- 172.21.15.28:0/1521586772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9101046b0 msgr2=0x7fd91019ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd90d400700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9101046b0 0x7fd91019ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd90d400700 1 -- 172.21.15.28:0/1521586772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91010a6b0 msgr2=0x7fd91019f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd90d400700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91010a6b0 0x7fd91019f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd90d400700 1 -- 172.21.15.28:0/1521586772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91019fe10 con 0x7fd910105070 2024-06-06T08:43:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd90de00700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9101046b0 0x7fd91019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd90e800700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91010a6b0 0x7fd91019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:43:36.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd90d400700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd910105070 0x7fd91019b390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00bae0 tx=0x7fd8fc00bb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:36.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd906a00700 1 -- 172.21.15.28:0/1521586772 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc026070 con 0x7fd910105070 2024-06-06T08:43:36.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd906a00700 1 -- 172.21.15.28:0/1521586772 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8fc003d70 con 0x7fd910105070 2024-06-06T08:43:36.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd914c00700 1 -- 172.21.15.28:0/1521586772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9101a00a0 con 0x7fd910105070 2024-06-06T08:43:36.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.976+0000 7fd906a00700 1 -- 172.21.15.28:0/1521586772 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc021410 con 0x7fd910105070 2024-06-06T08:43:36.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.977+0000 7fd914c00700 1 -- 172.21.15.28:0/1521586772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9101a7980 con 0x7fd910105070 2024-06-06T08:43:36.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.978+0000 7fd914c00700 1 -- 172.21.15.28:0/1521586772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd910069180 con 0x7fd910105070 2024-06-06T08:43:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.980+0000 7fd906a00700 1 -- 172.21.15.28:0/1521586772 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd8fc029070 con 0x7fd910105070 2024-06-06T08:43:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.981+0000 7fd906a00700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8f40a2ca0 0x7fd8f40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.981+0000 7fd906a00700 1 -- 172.21.15.28:0/1521586772 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fd8fc0cfe20 con 0x7fd910105070 2024-06-06T08:43:36.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.981+0000 7fd90de00700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8f40a2ca0 0x7fd8f40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:36.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.982+0000 7fd90de00700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8f40a2ca0 0x7fd8f40a5160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd900009fd0 tx=0x7fd900009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:36.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:36.986+0000 7fd906a00700 1 -- 172.21.15.28:0/1521586772 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd8fc05d850 con 0x7fd910105070 2024-06-06T08:43:37.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.267+0000 7fd914c00700 1 -- 172.21.15.28:0/1521586772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd91019c160 con 0x7fd910105070 2024-06-06T08:43:37.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.269+0000 7fd906a00700 1 -- 172.21.15.28:0/1521586772 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11909 (secure 0 0 0) 0x7fd8fc013070 con 0x7fd910105070 2024-06-06T08:43:37.269 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:43:37.269 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T08:40:05.416261+0000","modified":"2024-06-06T08:40:29.442708+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24542,"mds_1":24503,"mds_2":24499,"mds_3":24485,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14388":{"gid":14388,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6839/735176440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":735176440},{"type":"v1","addr":"172.21.15.28:6839","nonce":735176440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14400":{"gid":14400,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6841/3192274308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":3192274308},{"type":"v1","addr":"172.21.15.28:6841","nonce":3192274308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6839/771325139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":771325139},{"type":"v1","addr":"172.21.15.59:6839","nonce":771325139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.37:6839/527311102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":527311102},{"type":"v1","addr":"172.21.15.37:6839","nonce":527311102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24499,24485,24484,24503,24542]},"id":1}]} 2024-06-06T08:43:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.272+0000 7fd914c00700 1 -- 172.21.15.28:0/1521586772 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8f40a2ca0 msgr2=0x7fd8f40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.272+0000 7fd914c00700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8f40a2ca0 0x7fd8f40a5160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd900009fd0 tx=0x7fd900009260 comp rx=0 tx=0).stop 2024-06-06T08:43:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.272+0000 7fd914c00700 1 -- 172.21.15.28:0/1521586772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd910105070 msgr2=0x7fd91019b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.272+0000 7fd914c00700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd910105070 0x7fd91019b390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00bae0 tx=0x7fd8fc00bb10 comp rx=0 tx=0).stop 2024-06-06T08:43:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.272+0000 7fd914c00700 1 -- 172.21.15.28:0/1521586772 shutdown_connections 2024-06-06T08:43:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.272+0000 7fd914c00700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd8f40a2ca0 0x7fd8f40a5160 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.272+0000 7fd914c00700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91010a6b0 0x7fd91019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.272+0000 7fd914c00700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9101046b0 0x7fd91019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.272+0000 7fd914c00700 1 --2- 172.21.15.28:0/1521586772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd910105070 0x7fd91019b390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.272+0000 7fd914c00700 1 -- 172.21.15.28:0/1521586772 >> 172.21.15.28:0/1521586772 conn(0x7fd9101001a0 msgr2=0x7fd9101007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.272+0000 7fd914c00700 1 -- 172.21.15.28:0/1521586772 shutdown_connections 2024-06-06T08:43:37.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:37.273+0000 7fd914c00700 1 -- 172.21.15.28:0/1521586772 wait complete. 2024-06-06T08:43:37.276 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 28 2024-06-06T08:43:37.970 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:37 smithi028 ceph-mon[31564]: pgmap v440: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:37.971 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:37 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1521586772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:43:38.037 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:43:38.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:37 smithi059 ceph-mon[36684]: pgmap v440: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:38.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:37 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1521586772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:43:38.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:37 smithi037 ceph-mon[36609]: pgmap v440: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:38.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:37 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1521586772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:43:38.510 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:40.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:39 smithi028 ceph-mon[31564]: pgmap v441: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:40.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:39 smithi037 ceph-mon[36609]: pgmap v441: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:40.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:39 smithi059 ceph-mon[36684]: pgmap v441: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:43:40.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.748+0000 7fd0f2000700 1 -- 172.21.15.28:0/2225189777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ec107450 msgr2=0x7fd0ec107830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:40.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.748+0000 7fd0f2000700 1 --2- 172.21.15.28:0/2225189777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ec107450 0x7fd0ec107830 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009990 tx=0x7fd0dc009ca0 comp rx=0 tx=0).stop 2024-06-06T08:43:40.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.748+0000 7fd0f2000700 1 -- 172.21.15.28:0/2225189777 shutdown_connections 2024-06-06T08:43:40.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.748+0000 7fd0f2000700 1 --2- 172.21.15.28:0/2225189777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0ec102ee0 0x7fd0ec10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:40.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.748+0000 7fd0f2000700 1 --2- 172.21.15.28:0/2225189777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ec107450 0x7fd0ec107830 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:40.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.748+0000 7fd0f2000700 1 --2- 172.21.15.28:0/2225189777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0ec102540 0x7fd0ec1029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:40.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.748+0000 7fd0f2000700 1 -- 172.21.15.28:0/2225189777 >> 172.21.15.28:0/2225189777 conn(0x7fd0ec0795f0 msgr2=0x7fd0ec079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:40.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.748+0000 7fd0f2000700 1 -- 172.21.15.28:0/2225189777 shutdown_connections 2024-06-06T08:43:40.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.748+0000 7fd0f2000700 1 -- 172.21.15.28:0/2225189777 wait complete. 2024-06-06T08:43:40.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.749+0000 7fd0f2000700 1 Processor -- start 2024-06-06T08:43:40.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.750+0000 7fd0f2000700 1 -- start start 2024-06-06T08:43:40.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.750+0000 7fd0f2000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0ec102540 0x7fd0ec074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:40.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.750+0000 7fd0f2000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ec102ee0 0x7fd0ec074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:40.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.750+0000 7fd0f2000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0ec107450 0x7fd0ec075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:40.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.750+0000 7fd0f2000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec1127c0 con 0x7fd0ec102540 2024-06-06T08:43:40.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.750+0000 7fd0f2000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec112640 con 0x7fd0ec102ee0 2024-06-06T08:43:40.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.750+0000 7fd0f2000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec112940 con 0x7fd0ec107450 2024-06-06T08:43:40.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.750+0000 7fd0eb400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0ec102540 0x7fd0ec074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:40.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.750+0000 7fd0eb400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0ec102540 0x7fd0ec074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33680/0 (socket says 172.21.15.28:33680) 2024-06-06T08:43:40.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.750+0000 7fd0eb400700 1 -- 172.21.15.28:0/1898307892 learned_addr learned my addr 172.21.15.28:0/1898307892 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:40.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.751+0000 7fd0eaa00700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ec102ee0 0x7fd0ec074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:40.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.751+0000 7fd0ebe00700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0ec107450 0x7fd0ec075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:40.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.751+0000 7fd0eb400700 1 -- 172.21.15.28:0/1898307892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0ec107450 msgr2=0x7fd0ec075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:40.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.751+0000 7fd0eb400700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0ec107450 0x7fd0ec075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:40.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.751+0000 7fd0eb400700 1 -- 172.21.15.28:0/1898307892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ec102ee0 msgr2=0x7fd0ec074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:40.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.751+0000 7fd0eb400700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ec102ee0 0x7fd0ec074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:40.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.751+0000 7fd0eb400700 1 -- 172.21.15.28:0/1898307892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec1a7180 con 0x7fd0ec102540 2024-06-06T08:43:40.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.751+0000 7fd0eaa00700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ec102ee0 0x7fd0ec074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:40.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.751+0000 7fd0eb400700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0ec102540 0x7fd0ec074790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc000c00 tx=0x7fd0dc00bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:40.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.752+0000 7fd0e3e00700 1 -- 172.21.15.28:0/1898307892 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc026070 con 0x7fd0ec102540 2024-06-06T08:43:40.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.752+0000 7fd0f2000700 1 -- 172.21.15.28:0/1898307892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ec1a7410 con 0x7fd0ec102540 2024-06-06T08:43:40.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.752+0000 7fd0e3e00700 1 -- 172.21.15.28:0/1898307892 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0dc003d70 con 0x7fd0ec102540 2024-06-06T08:43:40.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.752+0000 7fd0e3e00700 1 -- 172.21.15.28:0/1898307892 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00fdf0 con 0x7fd0ec102540 2024-06-06T08:43:40.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.752+0000 7fd0f2000700 1 -- 172.21.15.28:0/1898307892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ec1a78f0 con 0x7fd0ec102540 2024-06-06T08:43:40.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.753+0000 7fd0f2000700 1 -- 172.21.15.28:0/1898307892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0ec10aa80 con 0x7fd0ec102540 2024-06-06T08:43:40.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.755+0000 7fd0e3e00700 1 -- 172.21.15.28:0/1898307892 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd0dc029070 con 0x7fd0ec102540 2024-06-06T08:43:40.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.756+0000 7fd0e3e00700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0d00a2c20 0x7fd0d00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:40.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.757+0000 7fd0e3e00700 1 -- 172.21.15.28:0/1898307892 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fd0dc0cfe00 con 0x7fd0ec102540 2024-06-06T08:43:40.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.757+0000 7fd0eaa00700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0d00a2c20 0x7fd0d00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:40.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.758+0000 7fd0eaa00700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0d00a2c20 0x7fd0d00a50e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009680 tx=0x7fd0d8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:40.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:40.761+0000 7fd0e3e00700 1 -- 172.21.15.28:0/1898307892 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd0dc05d850 con 0x7fd0ec102540 2024-06-06T08:43:41.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.042+0000 7fd0f2000700 1 -- 172.21.15.28:0/1898307892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0ec069180 con 0x7fd0ec102540 2024-06-06T08:43:41.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.044+0000 7fd0e3e00700 1 -- 172.21.15.28:0/1898307892 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11909 (secure 0 0 0) 0x7fd0dc013070 con 0x7fd0ec102540 2024-06-06T08:43:41.043 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:43:41.043 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T08:40:05.416261+0000","modified":"2024-06-06T08:40:29.442708+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24542,"mds_1":24503,"mds_2":24499,"mds_3":24485,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14388":{"gid":14388,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6839/735176440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":735176440},{"type":"v1","addr":"172.21.15.28:6839","nonce":735176440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14400":{"gid":14400,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6841/3192274308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":3192274308},{"type":"v1","addr":"172.21.15.28:6841","nonce":3192274308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6839/771325139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":771325139},{"type":"v1","addr":"172.21.15.59:6839","nonce":771325139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.37:6839/527311102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":527311102},{"type":"v1","addr":"172.21.15.37:6839","nonce":527311102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24499,24485,24484,24503,24542]},"id":1}]} 2024-06-06T08:43:41.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.047+0000 7fd0f2000700 1 -- 172.21.15.28:0/1898307892 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0d00a2c20 msgr2=0x7fd0d00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:41.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.047+0000 7fd0f2000700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0d00a2c20 0x7fd0d00a50e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009680 tx=0x7fd0d8009260 comp rx=0 tx=0).stop 2024-06-06T08:43:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.047+0000 7fd0f2000700 1 -- 172.21.15.28:0/1898307892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0ec102540 msgr2=0x7fd0ec074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.047+0000 7fd0f2000700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0ec102540 0x7fd0ec074790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc000c00 tx=0x7fd0dc00bb30 comp rx=0 tx=0).stop 2024-06-06T08:43:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.048+0000 7fd0f2000700 1 -- 172.21.15.28:0/1898307892 shutdown_connections 2024-06-06T08:43:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.048+0000 7fd0f2000700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd0d00a2c20 0x7fd0d00a50e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.048+0000 7fd0f2000700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0ec107450 0x7fd0ec075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.048+0000 7fd0f2000700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0ec102540 0x7fd0ec074790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.048+0000 7fd0f2000700 1 --2- 172.21.15.28:0/1898307892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ec102ee0 0x7fd0ec074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.048+0000 7fd0f2000700 1 -- 172.21.15.28:0/1898307892 >> 172.21.15.28:0/1898307892 conn(0x7fd0ec0795f0 msgr2=0x7fd0ec1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.048+0000 7fd0f2000700 1 -- 172.21.15.28:0/1898307892 shutdown_connections 2024-06-06T08:43:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:41.048+0000 7fd0f2000700 1 -- 172.21.15.28:0/1898307892 wait complete. 2024-06-06T08:43:41.048 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 28 2024-06-06T08:43:42.016 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T08:43:42.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:41 smithi028 ceph-mon[31564]: pgmap v442: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:42.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:41 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1898307892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:43:42.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:41 smithi037 ceph-mon[36609]: pgmap v442: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:42.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:41 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1898307892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:43:42.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:41 smithi059 ceph-mon[36684]: pgmap v442: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:42.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:41 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1898307892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:43:42.489 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:44.217 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:43 smithi028 ceph-mon[31564]: pgmap v443: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-06-06T08:43:44.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:43 smithi037 ceph-mon[36609]: pgmap v443: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-06-06T08:43:44.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:43 smithi059 ceph-mon[36684]: pgmap v443: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-06-06T08:43:44.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.786+0000 7f1f0da00700 1 -- 172.21.15.28:0/1588708420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f081045c0 msgr2=0x7f1f08104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:44.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.786+0000 7f1f0da00700 1 --2- 172.21.15.28:0/1588708420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f081045c0 0x7f1f08104a40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009990 tx=0x7f1ef4009ca0 comp rx=0 tx=0).stop 2024-06-06T08:43:44.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.786+0000 7f1f0da00700 1 -- 172.21.15.28:0/1588708420 shutdown_connections 2024-06-06T08:43:44.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.786+0000 7f1f0da00700 1 --2- 172.21.15.28:0/1588708420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f08104f80 0x7f1f08111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:44.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.786+0000 7f1f0da00700 1 --2- 172.21.15.28:0/1588708420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0810a650 0x7f1f0810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:44.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.786+0000 7f1f0da00700 1 --2- 172.21.15.28:0/1588708420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f081045c0 0x7f1f08104a40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:44.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.786+0000 7f1f0da00700 1 -- 172.21.15.28:0/1588708420 >> 172.21.15.28:0/1588708420 conn(0x7f1f081000b0 msgr2=0x7f1f081024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:44.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.786+0000 7f1f0da00700 1 -- 172.21.15.28:0/1588708420 shutdown_connections 2024-06-06T08:43:44.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.786+0000 7f1f0da00700 1 -- 172.21.15.28:0/1588708420 wait complete. 2024-06-06T08:43:44.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.788+0000 7f1f0da00700 1 Processor -- start 2024-06-06T08:43:44.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.788+0000 7f1f0da00700 1 -- start start 2024-06-06T08:43:44.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.788+0000 7f1f0da00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f081045c0 0x7f1f081a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:44.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.788+0000 7f1f0da00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f08104f80 0x7f1f081a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:44.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.788+0000 7f1f0da00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f0810a650 0x7f1f0819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:44.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.788+0000 7f1f0da00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081148f0 con 0x7f1f081045c0 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.788+0000 7f1f0da00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f08114770 con 0x7f1f08104f80 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.788+0000 7f1f0da00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1f08114a70 con 0x7f1f0810a650 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.789+0000 7f1f07e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f081045c0 0x7f1f081a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.789+0000 7f1f07e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f081045c0 0x7f1f081a08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33706/0 (socket says 172.21.15.28:33706) 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.789+0000 7f1f07e00700 1 -- 172.21.15.28:0/2173272682 learned_addr learned my addr 172.21.15.28:0/2173272682 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.789+0000 7f1f07400700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f08104f80 0x7f1f081a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.789+0000 7f1f0d000700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f0810a650 0x7f1f0819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.789+0000 7f1f07400700 1 -- 172.21.15.28:0/2173272682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f0810a650 msgr2=0x7f1f0819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.789+0000 7f1f07400700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f0810a650 0x7f1f0819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.789+0000 7f1f07400700 1 -- 172.21.15.28:0/2173272682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f081045c0 msgr2=0x7f1f081a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.789+0000 7f1f07400700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f081045c0 0x7f1f081a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.789+0000 7f1f07400700 1 -- 172.21.15.28:0/2173272682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0819b210 con 0x7f1f08104f80 2024-06-06T08:43:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.789+0000 7f1f07e00700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f081045c0 0x7f1f081a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:44.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.790+0000 7f1f07400700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f08104f80 0x7f1f081a0e30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4006010 tx=0x7f1ef400bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:44.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.790+0000 7f1f04c00700 1 -- 172.21.15.28:0/2173272682 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4027070 con 0x7f1f08104f80 2024-06-06T08:43:44.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.790+0000 7f1f0da00700 1 -- 172.21.15.28:0/2173272682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0819b4a0 con 0x7f1f08104f80 2024-06-06T08:43:44.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.790+0000 7f1f04c00700 1 -- 172.21.15.28:0/2173272682 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ef40056d0 con 0x7f1f08104f80 2024-06-06T08:43:44.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.790+0000 7f1f04c00700 1 -- 172.21.15.28:0/2173272682 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4022d90 con 0x7f1f08104f80 2024-06-06T08:43:44.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.790+0000 7f1f0da00700 1 -- 172.21.15.28:0/2173272682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f081a77c0 con 0x7f1f08104f80 2024-06-06T08:43:44.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.791+0000 7f1f0da00700 1 -- 172.21.15.28:0/2173272682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f08069180 con 0x7f1f08104f80 2024-06-06T08:43:44.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.794+0000 7f1f04c00700 1 -- 172.21.15.28:0/2173272682 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1ef402a070 con 0x7f1f08104f80 2024-06-06T08:43:44.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.795+0000 7f1f04c00700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1eec0a2c20 0x7f1eec0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:44.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.796+0000 7f1f04c00700 1 -- 172.21.15.28:0/2173272682 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f1ef40cffe0 con 0x7f1f08104f80 2024-06-06T08:43:44.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.796+0000 7f1f07e00700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1eec0a2c20 0x7f1eec0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:44.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.796+0000 7f1f07e00700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1eec0a2c20 0x7f1eec0a50e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1f0819bbf0 tx=0x7f1ef8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:44.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:44.800+0000 7f1f04c00700 1 -- 172.21.15.28:0/2173272682 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1ef405e850 con 0x7f1f08104f80 2024-06-06T08:43:45.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.032+0000 7f1f0da00700 1 -- 172.21.15.28:0/2173272682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f081a7990 con 0x7f1f08104f80 2024-06-06T08:43:45.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.034+0000 7f1f04c00700 1 -- 172.21.15.28:0/2173272682 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+22770 (secure 0 0 0) 0x7f1ef4013070 con 0x7f1f08104f80 2024-06-06T08:43:45.034 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:43:45.034 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":92,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","created":"2024-06-06T08:30:30.991501+0000","modified":"2024-06-06T08:41:41.833381+0000","last_up_change":"2024-06-06T08:38:45.850887+0000","last_in_change":"2024-06-06T08:38:26.532528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T08:34:26.800168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T08:39:56.375661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T08:40:01.096994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7edaffea-7613-4d20-b9b8-108a17af8f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6803","nonce":2001709636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6805","nonce":2001709636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6809","nonce":2001709636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6807","nonce":2001709636}]},"public_addr":"172.21.15.28:6803/2001709636","cluster_addr":"172.21.15.28:6805/2001709636","heartbeat_back_addr":"172.21.15.28:6809/2001709636","heartbeat_front_addr":"172.21.15.28:6807/2001709636","state":["exists","up"]},{"osd":1,"uuid":"17eb7536-c2a4-4f8b-bec4-b1abb5125836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6801","nonce":593429648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6803","nonce":593429648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6807","nonce":593429648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6805","nonce":593429648}]},"public_addr":"172.21.15.37:6801/593429648","cluster_addr":"172.21.15.37:6803/593429648","heartbeat_back_addr":"172.21.15.37:6807/593429648","heartbeat_front_addr":"172.21.15.37:6805/593429648","state":["exists","up"]},{"osd":2,"uuid":"3ea64fd8-13f4-4d53-933b-07055ec72701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6801","nonce":88678886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6803","nonce":88678886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6807","nonce":88678886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6805","nonce":88678886}]},"public_addr":"172.21.15.59:6801/88678886","cluster_addr":"172.21.15.59:6803/88678886","heartbeat_back_addr":"172.21.15.59:6807/88678886","heartbeat_front_addr":"172.21.15.59:6805/88678886","state":["exists","up"]},{"osd":3,"uuid":"8be9cdb5-12a9-438e-b8cd-ce65988b0ac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6811","nonce":484290430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6813","nonce":484290430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6817","nonce":484290430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6815","nonce":484290430}]},"public_addr":"172.21.15.28:6811/484290430","cluster_addr":"172.21.15.28:6813/484290430","heartbeat_back_addr":"172.21.15.28:6817/484290430","heartbeat_front_addr":"172.21.15.28:6815/484290430","state":["exists","up"]},{"osd":4,"uuid":"ddea397d-d7b1-46f3-9a13-dd318cade055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6809","nonce":3596500266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6811","nonce":3596500266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6815","nonce":3596500266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6813","nonce":3596500266}]},"public_addr":"172.21.15.37:6809/3596500266","cluster_addr":"172.21.15.37:6811/3596500266","heartbeat_back_addr":"172.21.15.37:6815/3596500266","heartbeat_front_addr":"172.21.15.37:6813/3596500266","state":["exists","up"]},{"osd":5,"uuid":"ee19857b-b047-4d15-8b17-257b6e4966a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6809","nonce":3037648282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6811","nonce":3037648282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6815","nonce":3037648282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6813","nonce":3037648282}]},"public_addr":"172.21.15.59:6809/3037648282","cluster_addr":"172.21.15.59:6811/3037648282","heartbeat_back_addr":"172.21.15.59:6815/3037648282","heartbeat_front_addr":"172.21.15.59:6813/3037648282","state":["exists","up"]},{"osd":6,"uuid":"1d57d0ba-8e37-4ac2-87e8-40b20b24fc53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6819","nonce":3794924886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6821","nonce":3794924886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6825","nonce":3794924886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6823","nonce":3794924886}]},"public_addr":"172.21.15.28:6819/3794924886","cluster_addr":"172.21.15.28:6821/3794924886","heartbeat_back_addr":"172.21.15.28:6825/3794924886","heartbeat_front_addr":"172.21.15.28:6823/3794924886","state":["exists","up"]},{"osd":7,"uuid":"43f3c2c8-752d-4a70-99dd-2c14aeefa137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6817","nonce":724042860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6819","nonce":724042860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6823","nonce":724042860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6821","nonce":724042860}]},"public_addr":"172.21.15.37:6817/724042860","cluster_addr":"172.21.15.37:6819/724042860","heartbeat_back_addr":"172.21.15.37:6823/724042860","heartbeat_front_addr":"172.21.15.37:6821/724042860","state":["exists","up"]},{"osd":8,"uuid":"3ffc07d7-ca79-419d-88a4-2b53d07ffae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6817","nonce":1240363223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6819","nonce":1240363223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6823","nonce":1240363223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6821","nonce":1240363223}]},"public_addr":"172.21.15.59:6817/1240363223","cluster_addr":"172.21.15.59:6819/1240363223","heartbeat_back_addr":"172.21.15.59:6823/1240363223","heartbeat_front_addr":"172.21.15.59:6821/1240363223","state":["exists","up"]},{"osd":9,"uuid":"4e014fc7-1ca3-4d6c-acdd-95ca59541310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6827","nonce":2555848355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6829","nonce":2555848355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6833","nonce":2555848355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6831","nonce":2555848355}]},"public_addr":"172.21.15.28:6827/2555848355","cluster_addr":"172.21.15.28:6829/2555848355","heartbeat_back_addr":"172.21.15.28:6833/2555848355","heartbeat_front_addr":"172.21.15.28:6831/2555848355","state":["exists","up"]},{"osd":10,"uuid":"fc418661-5e89-4241-b14b-241a2be432f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6825","nonce":176857372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6827","nonce":176857372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6831","nonce":176857372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6829","nonce":176857372}]},"public_addr":"172.21.15.37:6825/176857372","cluster_addr":"172.21.15.37:6827/176857372","heartbeat_back_addr":"172.21.15.37:6831/176857372","heartbeat_front_addr":"172.21.15.37:6829/176857372","state":["exists","up"]},{"osd":11,"uuid":"e54d81ee-1461-4229-a1c0-c6e750dd66ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6825","nonce":2675673798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6827","nonce":2675673798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6831","nonce":2675673798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6829","nonce":2675673798}]},"public_addr":"172.21.15.59:6825/2675673798","cluster_addr":"172.21.15.59:6827/2675673798","heartbeat_back_addr":"172.21.15.59:6831/2675673798","heartbeat_front_addr":"172.21.15.59:6829/2675673798","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:33.904270+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:58.988528+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:22.997033+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:57.171455+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:23.594371+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:48.928423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:22.957203+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:50.599655+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:16.166981+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:50.755673+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:18.677280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:44.432598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":5,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1f","mappings":[{"from":1,"to":2}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/4230567915":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/2860387445":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/886961600":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/3217551014":"2024-06-07T08:31:40.064884+0000","172.21.15.28:0/1629731223":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/219831273":"2024-06-07T08:31:04.770627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T08:43:45.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.038+0000 7f1f0da00700 1 -- 172.21.15.28:0/2173272682 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1eec0a2c20 msgr2=0x7f1eec0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:45.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.039+0000 7f1f0da00700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1eec0a2c20 0x7f1eec0a50e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1f0819bbf0 tx=0x7f1ef8009260 comp rx=0 tx=0).stop 2024-06-06T08:43:45.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.039+0000 7f1f0da00700 1 -- 172.21.15.28:0/2173272682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f08104f80 msgr2=0x7f1f081a0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:45.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.039+0000 7f1f0da00700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f08104f80 0x7f1f081a0e30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4006010 tx=0x7f1ef400bab0 comp rx=0 tx=0).stop 2024-06-06T08:43:45.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.039+0000 7f1f0da00700 1 -- 172.21.15.28:0/2173272682 shutdown_connections 2024-06-06T08:43:45.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.039+0000 7f1f0da00700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f1eec0a2c20 0x7f1eec0a50e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:45.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.039+0000 7f1f0da00700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f0810a650 0x7f1f0819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:45.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.039+0000 7f1f0da00700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f081045c0 0x7f1f081a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:45.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.039+0000 7f1f0da00700 1 --2- 172.21.15.28:0/2173272682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f08104f80 0x7f1f081a0e30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:45.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.039+0000 7f1f0da00700 1 -- 172.21.15.28:0/2173272682 >> 172.21.15.28:0/2173272682 conn(0x7f1f081000b0 msgr2=0x7f1f081082e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:45.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.039+0000 7f1f0da00700 1 -- 172.21.15.28:0/2173272682 shutdown_connections 2024-06-06T08:43:45.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:45.039+0000 7f1f0da00700 1 -- 172.21.15.28:0/2173272682 wait complete. 2024-06-06T08:43:45.912 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-06T08:40:05.416261+0000', 'modified': '2024-06-06T08:40:29.442708+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24542, 'mds_1': 24503, 'mds_2': 24499, 'mds_3': 24485, 'mds_4': 24484}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14388': {'gid': 14388, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.28:6839/735176440', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6838', 'nonce': 735176440}, {'type': 'v1', 'addr': '172.21.15.28:6839', 'nonce': 735176440}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14400': {'gid': 14400, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.28:6841/3192274308', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6840', 'nonce': 3192274308}, {'type': 'v1', 'addr': '172.21.15.28:6841', 'nonce': 3192274308}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24436': {'gid': 24436, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6833/3120575580', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3120575580}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3120575580}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24455': {'gid': 24455, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6833/1955606328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 1955606328}, {'type': 'v1', 'addr': '172.21.15.37:6833', 'nonce': 1955606328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6835/2983089313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 2983089313}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2983089313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.59:6837/2388488967', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6836', 'nonce': 2388488967}, {'type': 'v1', 'addr': '172.21.15.59:6837', 'nonce': 2388488967}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.37:6835/2566253946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 2566253946}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 2566253946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.59:6839/771325139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6838', 'nonce': 771325139}, {'type': 'v1', 'addr': '172.21.15.59:6839', 'nonce': 771325139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.37:6837/1443905946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6836', 'nonce': 1443905946}, {'type': 'v1', 'addr': '172.21.15.37:6837', 'nonce': 1443905946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24542': {'gid': 24542, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.37:6839/527311102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 527311102}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 527311102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24542, 'qdb_cluster': [24499, 24485, 24484, 24503, 24542]} 2024-06-06T08:43:45.912 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-06-06T08:43:45.912 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell mds.c status 2024-06-06T08:43:46.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:45 smithi028 ceph-mon[31564]: pgmap v444: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-06-06T08:43:46.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:45 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2173272682' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:43:46.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:45 smithi037 ceph-mon[36609]: pgmap v444: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-06-06T08:43:46.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:45 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2173272682' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:43:46.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:45 smithi059 ceph-mon[36684]: pgmap v444: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-06-06T08:43:46.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:45 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2173272682' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:43:46.354 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:48.146 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:47 smithi028 ceph-mon[31564]: pgmap v445: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:48.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:47 smithi037 ceph-mon[36609]: pgmap v445: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:48.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:47 smithi059 ceph-mon[36684]: pgmap v445: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:48.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.685+0000 7fe029800700 1 -- 172.21.15.28:0/1877776878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe024102fb0 msgr2=0x7fe024107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:48.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.685+0000 7fe029800700 1 --2- 172.21.15.28:0/1877776878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe024102fb0 0x7fe024107000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe010009920 tx=0x7fe010009c30 comp rx=0 tx=0).stop 2024-06-06T08:43:48.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.685+0000 7fe029800700 1 -- 172.21.15.28:0/1877776878 shutdown_connections 2024-06-06T08:43:48.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.685+0000 7fe029800700 1 --2- 172.21.15.28:0/1877776878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0241076e0 0x7fe02410f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.685+0000 7fe029800700 1 --2- 172.21.15.28:0/1877776878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe024102600 0x7fe0241029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.685+0000 7fe029800700 1 --2- 172.21.15.28:0/1877776878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe024102fb0 0x7fe024107000 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.685+0000 7fe029800700 1 -- 172.21.15.28:0/1877776878 >> 172.21.15.28:0/1877776878 conn(0x7fe0240fdeb0 msgr2=0x7fe0241002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:48.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.685+0000 7fe029800700 1 -- 172.21.15.28:0/1877776878 shutdown_connections 2024-06-06T08:43:48.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.685+0000 7fe029800700 1 -- 172.21.15.28:0/1877776878 wait complete. 2024-06-06T08:43:48.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.686+0000 7fe029800700 1 Processor -- start 2024-06-06T08:43:48.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.686+0000 7fe029800700 1 -- start start 2024-06-06T08:43:48.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.686+0000 7fe029800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe024102600 0x7fe02419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe029800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe024102fb0 0x7fe02419b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe029800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0241076e0 0x7fe02419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe029800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe0241126f0 con 0x7fe0241076e0 2024-06-06T08:43:48.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe029800700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe024112570 con 0x7fe024102600 2024-06-06T08:43:48.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe029800700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe024112870 con 0x7fe024102fb0 2024-06-06T08:43:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe023e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe024102600 0x7fe02419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe023400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe024102fb0 0x7fe02419b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe023400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe024102fb0 0x7fe02419b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:49292/0 (socket says 172.21.15.28:49292) 2024-06-06T08:43:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe023e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe024102600 0x7fe02419ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:44358/0 (socket says 172.21.15.28:44358) 2024-06-06T08:43:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe023400700 1 -- 172.21.15.28:0/3387642084 learned_addr learned my addr 172.21.15.28:0/3387642084 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe028e00700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0241076e0 0x7fe02419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe023e00700 1 -- 172.21.15.28:0/3387642084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe024102fb0 msgr2=0x7fe02419b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:48.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe023e00700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe024102fb0 0x7fe02419b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe023e00700 1 -- 172.21.15.28:0/3387642084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0241076e0 msgr2=0x7fe02419f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:48.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.687+0000 7fe023e00700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0241076e0 0x7fe02419f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.688+0000 7fe023e00700 1 -- 172.21.15.28:0/3387642084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02419fe20 con 0x7fe024102600 2024-06-06T08:43:48.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.688+0000 7fe023e00700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe024102600 0x7fe02419ae60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe01400eb90 tx=0x7fe01400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:48.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.688+0000 7fe020c00700 1 -- 172.21.15.28:0/3387642084 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01400cc90 con 0x7fe024102600 2024-06-06T08:43:48.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.688+0000 7fe029800700 1 -- 172.21.15.28:0/3387642084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0241a0110 con 0x7fe024102600 2024-06-06T08:43:48.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.688+0000 7fe020c00700 1 -- 172.21.15.28:0/3387642084 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe01400ce30 con 0x7fe024102600 2024-06-06T08:43:48.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.688+0000 7fe020c00700 1 -- 172.21.15.28:0/3387642084 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014010430 con 0x7fe024102600 2024-06-06T08:43:48.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.688+0000 7fe029800700 1 -- 172.21.15.28:0/3387642084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0241a7990 con 0x7fe024102600 2024-06-06T08:43:48.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.692+0000 7fe020c00700 1 -- 172.21.15.28:0/3387642084 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe014003680 con 0x7fe024102600 2024-06-06T08:43:48.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.693+0000 7fe0357efb80 1 Processor -- start 2024-06-06T08:43:48.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.693+0000 7fe020c00700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe0080a2c20 0x7fe0080a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.693+0000 7fe0357efb80 1 -- start start 2024-06-06T08:43:48.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.693+0000 7fe020c00700 1 -- 172.21.15.28:0/3387642084 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fe0140cf410 con 0x7fe024102600 2024-06-06T08:43:48.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.693+0000 7fe028e00700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe0080a2c20 0x7fe0080a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.694+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 0x562b7a2bc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.694+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.694+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 0x562b7a2c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.694+0000 7fe0357efb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x562b7a1cb9c0 con 0x562b7a2bc630 2024-06-06T08:43:48.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.694+0000 7fe0357efb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562b7a20eab0 con 0x562b7a2c74e0 2024-06-06T08:43:48.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.694+0000 7fe0357efb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562b7a1c98a0 con 0x562b7a2bbd10 2024-06-06T08:43:48.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.694+0000 7fe023e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 0x562b7a2bc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.694+0000 7fe023e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 0x562b7a2bc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:49302/0 (socket says 172.21.15.28:49302) 2024-06-06T08:43:48.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.694+0000 7fe023400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.694+0000 7fe023e00700 1 -- 172.21.15.28:0/3585332663 learned_addr learned my addr 172.21.15.28:0/3585332663 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:48.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.694+0000 7fe028e00700 1 --2- 172.21.15.28:0/3585332663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 0x562b7a2c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe023400700 1 -- 172.21.15.28:0/3585332663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 msgr2=0x562b7a2bc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:48.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe023400700 1 --2- 172.21.15.28:0/3585332663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 0x562b7a2bc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe023400700 1 -- 172.21.15.28:0/3585332663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 msgr2=0x562b7a2c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:48.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe023400700 1 --2- 172.21.15.28:0/3585332663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 0x562b7a2c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe023400700 1 -- 172.21.15.28:0/3585332663 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b7a1b6f40 con 0x562b7a2bc630 2024-06-06T08:43:48.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe028e00700 1 --2- 172.21.15.28:0/3585332663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 0x562b7a2c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:43:48.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe023e00700 1 --2- 172.21.15.28:0/3585332663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 0x562b7a2bc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:48.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe028e00700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe0080a2c20 0x7fe0080a50e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00f590 tx=0x7fe01c009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:48.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe023400700 1 --2- 172.21.15.28:0/3585332663 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2c6fa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe010009810 tx=0x7fe010009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18cc0863937f23a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:48.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe019600700 1 -- 172.21.15.28:0/3585332663 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01000f6e0 con 0x562b7a2bc630 2024-06-06T08:43:48.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe019600700 1 -- 172.21.15.28:0/3585332663 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe010005520 con 0x562b7a2bc630 2024-06-06T08:43:48.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.695+0000 7fe019600700 1 -- 172.21.15.28:0/3585332663 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010003d30 con 0x562b7a2bc630 2024-06-06T08:43:48.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.696+0000 7fe0357efb80 1 -- 172.21.15.28:0/3585332663 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 msgr2=0x562b7a2c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:48.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.696+0000 7fe0357efb80 1 --2- 172.21.15.28:0/3585332663 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2c6fa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe010009810 tx=0x7fe010009f80 comp rx=0 tx=0).stop 2024-06-06T08:43:48.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.696+0000 7fe0357efb80 1 -- 172.21.15.28:0/3585332663 shutdown_connections 2024-06-06T08:43:48.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.696+0000 7fe0357efb80 1 --2- 172.21.15.28:0/3585332663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 0x562b7a2c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.696+0000 7fe0357efb80 1 --2- 172.21.15.28:0/3585332663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 0x562b7a2bc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.696+0000 7fe0357efb80 1 --2- 172.21.15.28:0/3585332663 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2c6fa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.696+0000 7fe0357efb80 1 -- 172.21.15.28:0/3585332663 >> 172.21.15.28:0/3585332663 conn(0x562b7a1e9120 msgr2=0x562b7a2b8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:48.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.696+0000 7fe0357efb80 1 -- 172.21.15.28:0/3585332663 shutdown_connections 2024-06-06T08:43:48.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.696+0000 7fe0357efb80 1 -- 172.21.15.28:0/3585332663 wait complete. 2024-06-06T08:43:48.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.697+0000 7fe0357efb80 1 -- start start 2024-06-06T08:43:48.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.697+0000 7fe0357efb80 1 Processor -- start 2024-06-06T08:43:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bbd10 0x562b7a2c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bc630 0x562b7a2c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2c74e0 0x562b7a2c4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe0357efb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x562b7a1aaf10 con 0x562b7a2bbd10 2024-06-06T08:43:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe0357efb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562b7a20aa70 con 0x562b7a2bc630 2024-06-06T08:43:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe0357efb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562b7a2c9f10 con 0x562b7a2c74e0 2024-06-06T08:43:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe0357efb80 10 client.0 _ll_register_callbacks cb 0x562b7a1a4330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe023400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bc630 0x562b7a2c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe023e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bbd10 0x562b7a2c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe023400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bc630 0x562b7a2c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:44378/0 (socket says 172.21.15.28:44378) 2024-06-06T08:43:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe023e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bbd10 0x562b7a2c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43558/0 (socket says 172.21.15.28:43558) 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe023400700 1 -- 172.21.15.28:0/1960236675 learned_addr learned my addr 172.21.15.28:0/1960236675 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.698+0000 7fe028e00700 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2c74e0 0x562b7a2c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.699+0000 7fe023400700 1 -- 172.21.15.28:0/1960236675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2c74e0 msgr2=0x562b7a2c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.699+0000 7fe023400700 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2c74e0 0x562b7a2c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.699+0000 7fe023400700 1 -- 172.21.15.28:0/1960236675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bbd10 msgr2=0x562b7a2c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.699+0000 7fe023400700 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bbd10 0x562b7a2c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.699+0000 7fe023400700 1 -- 172.21.15.28:0/1960236675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b7a15d880 con 0x562b7a2bc630 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.699+0000 7fe023400700 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bc630 0x562b7a2c3f10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe010005920 tx=0x7fe010004b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8951637c5771cff server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.699+0000 7fe00e000700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.699+0000 7fe00e000700 1 -- 172.21.15.28:0/1960236675 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01002e070 con 0x562b7a2bc630 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.699+0000 7fe00e000700 1 -- 172.21.15.28:0/1960236675 <== mon.2 v2:172.21.15.37:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fe01000f6e0 con 0x562b7a2bc630 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.699+0000 7fe0357efb80 1 -- 172.21.15.28:0/1960236675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe010005520 con 0x562b7a2bc630 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.700+0000 7fe00e000700 1 -- 172.21.15.28:0/1960236675 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe01003a050 con 0x562b7a2bc630 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.700+0000 7fe0357efb80 10 client.25034 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:48.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.700+0000 7fe0357efb80 1 -- 172.21.15.28:0/1960236675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b7a2d45e0 con 0x562b7a2bc630 2024-06-06T08:43:48.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.700+0000 7fe00e000700 1 -- 172.21.15.28:0/1960236675 <== mon.2 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe010005520 con 0x562b7a2bc630 2024-06-06T08:43:48.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.700+0000 7fe00e000700 1 -- 172.21.15.28:0/1960236675 <== mon.2 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fe010020070 con 0x562b7a2bc630 2024-06-06T08:43:48.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.700+0000 7fe0357efb80 10 client.25034 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:48.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.700+0000 7fe0357efb80 10 client.25034 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-06T08:43:48.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.700+0000 7fe0357efb80 20 client.25034 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.700+0000 7fe0357efb80 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x562b7a2d5930 0x562b7a2d7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.700+0000 7fe0357efb80 4 client.25034 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.700+0000 7fe0357efb80 1 -- 172.21.15.28:0/1960236675 --> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b7a21bfb0 con 0x562b7a2d5930 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.701+0000 7fe023e00700 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x562b7a2d5930 0x562b7a2d7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.701+0000 7fe023e00700 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x562b7a2d5930 0x562b7a2d7af0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=760615a1bad5e823 server_cookie=3bd775290d3c9988 in_seq=0 out_seq=0 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.701+0000 7fe00e000700 10 client.25034 ms_handle_connect on v2:172.21.15.59:6836/2388488967 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe00e000700 1 -- 172.21.15.28:0/1960236675 <== mds.4 v2:172.21.15.59:6836/2388488967 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562b7a21bfb0 con 0x562b7a2d5930 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe00e000700 10 client.25034 handle_command_reply: tid=0 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe0357efb80 1 client.25034 shutdown 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe0357efb80 1 -- 172.21.15.28:0/1960236675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bc630 msgr2=0x562b7a2c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe0357efb80 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bc630 0x562b7a2c3f10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe010005920 tx=0x7fe010004b70 comp rx=0 tx=0).stop 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe0357efb80 1 -- 172.21.15.28:0/1960236675 shutdown_connections 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe0357efb80 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x562b7a2d5930 0x562b7a2d7af0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe0357efb80 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2c74e0 0x562b7a2c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe0357efb80 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bbd10 0x562b7a2c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe0357efb80 1 --2- 172.21.15.28:0/1960236675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bc630 0x562b7a2c3f10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe00e000700 0 client.25034 ms_handle_reset on v2:172.21.15.59:6836/2388488967 2024-06-06T08:43:48.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.702+0000 7fe0357efb80 1 -- 172.21.15.28:0/1960236675 >> 172.21.15.28:0/1960236675 conn(0x562b7a1e9120 msgr2=0x562b7a2b7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:48.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.703+0000 7fe0357efb80 1 -- 172.21.15.28:0/1960236675 shutdown_connections 2024-06-06T08:43:48.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.703+0000 7fe0357efb80 1 -- 172.21.15.28:0/1960236675 wait complete. 2024-06-06T08:43:48.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.703+0000 7fe0357efb80 20 client.25034 trim_cache size 0 max 16384 2024-06-06T08:43:48.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.726+0000 7fe0357efb80 1 Processor -- start 2024-06-06T08:43:48.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.726+0000 7fe0357efb80 1 -- start start 2024-06-06T08:43:48.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 0x562b7a2c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2bf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 0x562b7a2c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe0357efb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x562b7a2d5e30 con 0x562b7a2bc630 2024-06-06T08:43:48.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe0357efb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562b7a2d6500 con 0x562b7a2c74e0 2024-06-06T08:43:48.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe0357efb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562b7a2d6bd0 con 0x562b7a2bbd10 2024-06-06T08:43:48.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe023400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe023e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 0x562b7a2c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe023400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2bf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43570/0 (socket says 172.21.15.28:43570) 2024-06-06T08:43:48.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe023400700 1 -- 172.21.15.28:0/1180686328 learned_addr learned my addr 172.21.15.28:0/1180686328 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:48.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe028e00700 1 --2- 172.21.15.28:0/1180686328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 0x562b7a2c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe023400700 1 -- 172.21.15.28:0/1180686328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 msgr2=0x562b7a2c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:48.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe023400700 1 --2- 172.21.15.28:0/1180686328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 0x562b7a2c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe023400700 1 -- 172.21.15.28:0/1180686328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 msgr2=0x562b7a2c11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:48.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.727+0000 7fe023400700 1 --2- 172.21.15.28:0/1180686328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 0x562b7a2c11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.728+0000 7fe023400700 1 -- 172.21.15.28:0/1180686328 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b7a2b8d00 con 0x562b7a2bc630 2024-06-06T08:43:48.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.728+0000 7fe028e00700 1 --2- 172.21.15.28:0/1180686328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 0x562b7a2c11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:48.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.728+0000 7fe023400700 1 --2- 172.21.15.28:0/1180686328 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2bf440 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe010009810 tx=0x7fe010005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50961e421ce1de56 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:48.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.728+0000 7fe018c00700 1 -- 172.21.15.28:0/1180686328 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01002e070 con 0x562b7a2bc630 2024-06-06T08:43:48.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.728+0000 7fe018c00700 1 -- 172.21.15.28:0/1180686328 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe01002ae10 con 0x562b7a2bc630 2024-06-06T08:43:48.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.728+0000 7fe018c00700 1 -- 172.21.15.28:0/1180686328 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010004070 con 0x562b7a2bc630 2024-06-06T08:43:48.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.729+0000 7fe0357efb80 1 -- 172.21.15.28:0/1180686328 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 msgr2=0x562b7a2bf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:48.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.729+0000 7fe0357efb80 1 --2- 172.21.15.28:0/1180686328 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2bf440 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe010009810 tx=0x7fe010005dc0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.729+0000 7fe0357efb80 1 -- 172.21.15.28:0/1180686328 shutdown_connections 2024-06-06T08:43:48.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.729+0000 7fe0357efb80 1 --2- 172.21.15.28:0/1180686328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2c74e0 0x562b7a2c11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.729+0000 7fe0357efb80 1 --2- 172.21.15.28:0/1180686328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2bbd10 0x562b7a2c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.729+0000 7fe0357efb80 1 --2- 172.21.15.28:0/1180686328 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2bf440 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.729+0000 7fe0357efb80 1 -- 172.21.15.28:0/1180686328 >> 172.21.15.28:0/1180686328 conn(0x562b7a1e9120 msgr2=0x562b7a2bed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:48.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.729+0000 7fe0357efb80 1 -- 172.21.15.28:0/1180686328 shutdown_connections 2024-06-06T08:43:48.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.729+0000 7fe0357efb80 1 -- 172.21.15.28:0/1180686328 wait complete. 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.729+0000 7fe0357efb80 1 -- start start 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.730+0000 7fe0357efb80 1 Processor -- start 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.730+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bbd10 0x562b7a2dd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.730+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2dda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.730+0000 7fe0357efb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2c74e0 0x562b7a33aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.730+0000 7fe0357efb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x562b7a2d7970 con 0x562b7a2bc630 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.730+0000 7fe0357efb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562b7a2d72a0 con 0x562b7a2bbd10 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.730+0000 7fe0357efb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562b7a2d8040 con 0x562b7a2c74e0 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.730+0000 7fe0357efb80 10 client.0 _ll_register_callbacks cb 0x562b7a1a4330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.730+0000 7fe023400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2dda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.731+0000 7fe023400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2dda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43572/0 (socket says 172.21.15.28:43572) 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.731+0000 7fe023400700 1 -- 172.21.15.28:0/3749675573 learned_addr learned my addr 172.21.15.28:0/3749675573 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:48.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.731+0000 7fe028e00700 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2c74e0 0x562b7a33aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.731+0000 7fe023e00700 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bbd10 0x562b7a2dd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.731+0000 7fe023400700 1 -- 172.21.15.28:0/3749675573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2c74e0 msgr2=0x562b7a33aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.731+0000 7fe023400700 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2c74e0 0x562b7a33aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.731+0000 7fe023400700 1 -- 172.21.15.28:0/3749675573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bbd10 msgr2=0x562b7a2dd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.731+0000 7fe023400700 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bbd10 0x562b7a2dd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.731+0000 7fe023400700 1 -- 172.21.15.28:0/3749675573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b7a33b520 con 0x562b7a2bc630 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.731+0000 7fe023400700 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2dda60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe010005850 tx=0x7fe010005920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e082fd9ceda81d2a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.731+0000 7fe00e000700 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.732+0000 7fe00e000700 1 -- 172.21.15.28:0/3749675573 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01002e040 con 0x562b7a2bc630 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.732+0000 7fe00e000700 1 -- 172.21.15.28:0/3749675573 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fe01000f7f0 con 0x562b7a2bc630 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.732+0000 7fe0357efb80 1 -- 172.21.15.28:0/3749675573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe01002ae10 con 0x562b7a2bc630 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.732+0000 7fe00e000700 1 -- 172.21.15.28:0/3749675573 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe01000f9f0 con 0x562b7a2bc630 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.732+0000 7fe0357efb80 10 client.14904 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.732+0000 7fe0357efb80 1 -- 172.21.15.28:0/3749675573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b7a342890 con 0x562b7a2bc630 2024-06-06T08:43:48.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.732+0000 7fe00e000700 1 -- 172.21.15.28:0/3749675573 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe01002ae10 con 0x562b7a2bc630 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.732+0000 7fe00e000700 1 -- 172.21.15.28:0/3749675573 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fe010020040 con 0x562b7a2bc630 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.732+0000 7fe0357efb80 10 client.14904 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.733+0000 7fe0357efb80 10 client.14904 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.733+0000 7fe0357efb80 20 client.14904 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.733+0000 7fe0357efb80 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x562b7a347110 0x562b7a345e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.733+0000 7fe0357efb80 4 client.14904 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.733+0000 7fe0357efb80 1 -- 172.21.15.28:0/3749675573 --> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] -- command(tid 0: {"prefix": "status"}) -- 0x562b7a216530 con 0x562b7a347110 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.733+0000 7fe023e00700 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x562b7a347110 0x562b7a345e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.733+0000 7fe023e00700 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x562b7a347110 0x562b7a345e20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1fe2af38b73133d6 server_cookie=9d1639d348065e50 in_seq=0 out_seq=0 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.733+0000 7fe00e000700 10 client.14904 ms_handle_connect on v2:172.21.15.59:6836/2388488967 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe00e000700 1 -- 172.21.15.28:0/3749675573 <== mds.4 v2:172.21.15.59:6836/2388488967 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562b7a216530 con 0x562b7a347110 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe00e000700 10 client.14904 handle_command_reply: tid=0 2024-06-06T08:43:48.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 1 client.14904 shutdown 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 1 -- 172.21.15.28:0/3749675573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 msgr2=0x562b7a2dda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2dda60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe010005850 tx=0x7fe010005920 comp rx=0 tx=0).stop 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 1 -- 172.21.15.28:0/3749675573 shutdown_connections 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.59:6836/2388488967,v1:172.21.15.59:6837/2388488967] conn(0x562b7a347110 0x562b7a345e20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b7a2c74e0 0x562b7a33aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b7a2bbd10 0x562b7a2dd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 1 --2- 172.21.15.28:0/3749675573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b7a2bc630 0x562b7a2dda60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 1 -- 172.21.15.28:0/3749675573 >> 172.21.15.28:0/3749675573 conn(0x562b7a1e9120 msgr2=0x562b7a2be450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe00e000700 0 client.14904 ms_handle_reset on v2:172.21.15.59:6836/2388488967 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 1 -- 172.21.15.28:0/3749675573 shutdown_connections 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 1 -- 172.21.15.28:0/3749675573 wait complete. 2024-06-06T08:43:48.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.734+0000 7fe0357efb80 20 client.14904 trim_cache size 0 max 16384 2024-06-06T08:43:48.737 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:43:48.737 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:43:48.737 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 4, 2024-06-06T08:43:48.737 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24484, 2024-06-06T08:43:48.738 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-06-06T08:43:48.738 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-06-06T08:43:48.738 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-06-06T08:43:48.738 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 204.08330541699999, 2024-06-06T08:43:48.738 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 28, 2024-06-06T08:43:48.738 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 92, 2024-06-06T08:43:48.738 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 88, 2024-06-06T08:43:48.738 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 265.51778020199998 2024-06-06T08:43:48.738 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:43:48.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 -- 172.21.15.28:0/3387642084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe0080a2c20 msgr2=0x7fe0080a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:48.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe0080a2c20 0x7fe0080a50e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00f590 tx=0x7fe01c009920 comp rx=0 tx=0).stop 2024-06-06T08:43:48.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 -- 172.21.15.28:0/3387642084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe024102600 msgr2=0x7fe02419ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:48.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe024102600 0x7fe02419ae60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe01400eb90 tx=0x7fe01400eea0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 -- 172.21.15.28:0/3387642084 shutdown_connections 2024-06-06T08:43:48.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe0080a2c20 0x7fe0080a50e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0241076e0 0x7fe02419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe024102600 0x7fe02419ae60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 --2- 172.21.15.28:0/3387642084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe024102fb0 0x7fe02419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:48.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 -- 172.21.15.28:0/3387642084 >> 172.21.15.28:0/3387642084 conn(0x7fe0240fdeb0 msgr2=0x7fe0240ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:48.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 -- 172.21.15.28:0/3387642084 shutdown_connections 2024-06-06T08:43:48.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:48.735+0000 7fe029800700 1 -- 172.21.15.28:0/3387642084 wait complete. 2024-06-06T08:43:49.685 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell mds.e status 2024-06-06T08:43:50.150 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:50.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:49 smithi028 ceph-mon[31564]: pgmap v446: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-06-06T08:43:50.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:49 smithi037 ceph-mon[36609]: pgmap v446: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-06-06T08:43:50.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:49 smithi059 ceph-mon[36684]: pgmap v446: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-06-06T08:43:52.003 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:51 smithi028 ceph-mon[31564]: pgmap v447: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:52.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:51 smithi037 ceph-mon[36609]: pgmap v447: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:52.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:51 smithi059 ceph-mon[36684]: pgmap v447: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-06-06T08:43:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.506+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2359222868 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ab81133c0 msgr2=0x7f9ab81157b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.506+0000 7f9ab7e00700 1 --2- 172.21.15.28:0/2359222868 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ab81133c0 0x7f9ab81157b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000b0a0 tx=0x7f9ab000b3b0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.507+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2359222868 shutdown_connections 2024-06-06T08:43:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.507+0000 7f9ab7e00700 1 --2- 172.21.15.28:0/2359222868 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ab81133c0 0x7f9ab81157b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.507+0000 7f9ab7e00700 1 --2- 172.21.15.28:0/2359222868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab8074830 0x7f9ab8074c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.507+0000 7f9ab7e00700 1 --2- 172.21.15.28:0/2359222868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab8075150 0x7f9ab8112e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.507+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2359222868 >> 172.21.15.28:0/2359222868 conn(0x7f9ab80fdee0 msgr2=0x7f9ab8100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.507+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2359222868 shutdown_connections 2024-06-06T08:43:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.507+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2359222868 wait complete. 2024-06-06T08:43:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.508+0000 7f9ab7e00700 1 Processor -- start 2024-06-06T08:43:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab7e00700 1 -- start start 2024-06-06T08:43:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab7e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ab8074830 0x7f9ab819f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab7e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab8075150 0x7f9ab819f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab7e00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab81133c0 0x7f9ab81a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab7e00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8118d20 con 0x7f9ab8074830 2024-06-06T08:43:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab7e00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8118ba0 con 0x7f9ab8075150 2024-06-06T08:43:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab7e00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8118ea0 con 0x7f9ab81133c0 2024-06-06T08:43:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ab8074830 0x7f9ab819f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ab8074830 0x7f9ab819f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43594/0 (socket says 172.21.15.28:43594) 2024-06-06T08:43:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab6a00700 1 -- 172.21.15.28:0/2133249702 learned_addr learned my addr 172.21.15.28:0/2133249702 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab6000700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab8075150 0x7f9ab819f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.509+0000 7f9ab7400700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab81133c0 0x7f9ab81a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.510+0000 7f9ab6a00700 1 -- 172.21.15.28:0/2133249702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab81133c0 msgr2=0x7f9ab81a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:52.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.510+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab81133c0 0x7f9ab81a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.510+0000 7f9ab6a00700 1 -- 172.21.15.28:0/2133249702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab8075150 msgr2=0x7f9ab819f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:52.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.510+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab8075150 0x7f9ab819f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.510+0000 7f9ab6a00700 1 -- 172.21.15.28:0/2133249702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab81a4170 con 0x7f9ab8074830 2024-06-06T08:43:52.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.510+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ab8074830 0x7f9ab819f1b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800e9c0 tx=0x7f9aa800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:52.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.510+0000 7f9aaf400700 1 -- 172.21.15.28:0/2133249702 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa800cbd0 con 0x7f9ab8074830 2024-06-06T08:43:52.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.511+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2133249702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab81a4460 con 0x7f9ab8074830 2024-06-06T08:43:52.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.511+0000 7f9aaf400700 1 -- 172.21.15.28:0/2133249702 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9aa800ee60 con 0x7f9ab8074830 2024-06-06T08:43:52.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.511+0000 7f9aaf400700 1 -- 172.21.15.28:0/2133249702 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8005630 con 0x7f9ab8074830 2024-06-06T08:43:52.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.511+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2133249702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab81abce0 con 0x7f9ab8074830 2024-06-06T08:43:52.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.514+0000 7f9aaf400700 1 -- 172.21.15.28:0/2133249702 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9aa8004750 con 0x7f9ab8074830 2024-06-06T08:43:52.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.515+0000 7f9ac8318b80 1 Processor -- start 2024-06-06T08:43:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9ac8318b80 1 -- start start 2024-06-06T08:43:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9aaf400700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a9c0a2c20 0x7f9a9c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9aaf400700 1 -- 172.21.15.28:0/2133249702 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f9aa80cf3f0 con 0x7f9ab8074830 2024-06-06T08:43:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9ab7400700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a9c0a2c20 0x7f9a9c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d93613d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d9361910 0x55e8d9361d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d936a520 0x55e8d936c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55e8d926e9c0 con 0x55e8d92dbdf0 2024-06-06T08:43:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e8d92b1ab0 con 0x55e8d936a520 2024-06-06T08:43:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e8d926c8a0 con 0x55e8d9361910 2024-06-06T08:43:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9ab6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d93613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9ab6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d93613d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43606/0 (socket says 172.21.15.28:43606) 2024-06-06T08:43:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.516+0000 7f9ab6a00700 1 -- 172.21.15.28:0/189593193 learned_addr learned my addr 172.21.15.28:0/189593193 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.517+0000 7f9ab6000700 1 --2- 172.21.15.28:0/189593193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d9361910 0x55e8d9361d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.517+0000 7f9ab7400700 1 --2- 172.21.15.28:0/189593193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d936a520 0x55e8d936c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.517+0000 7f9ab6a00700 1 -- 172.21.15.28:0/189593193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d9361910 msgr2=0x55e8d9361d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.517+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/189593193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d9361910 0x55e8d9361d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.517+0000 7f9ab6a00700 1 -- 172.21.15.28:0/189593193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d936a520 msgr2=0x55e8d936c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.517+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/189593193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d936a520 0x55e8d936c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.517+0000 7f9ab6a00700 1 -- 172.21.15.28:0/189593193 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8d9259f40 con 0x55e8d92dbdf0 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.517+0000 7f9ab7400700 1 --2- 172.21.15.28:0/189593193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d936a520 0x55e8d936c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.517+0000 7f9ab7400700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a9c0a2c20 0x7f9a9c0a50e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000b780 tx=0x7f9ab0009440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.517+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/189593193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d93613d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9aa809bb00 tx=0x7f9aa809b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaeee16fa685dbc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.518+0000 7f9aa3e00700 1 -- 172.21.15.28:0/189593193 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa809ff20 con 0x55e8d92dbdf0 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.518+0000 7f9aa3e00700 1 -- 172.21.15.28:0/189593193 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9aa80a47e0 con 0x55e8d92dbdf0 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.518+0000 7f9aa3e00700 1 -- 172.21.15.28:0/189593193 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80a4350 con 0x55e8d92dbdf0 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.518+0000 7f9ac8318b80 1 -- 172.21.15.28:0/189593193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 msgr2=0x55e8d93613d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.518+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/189593193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d93613d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9aa809bb00 tx=0x7f9aa809b5a0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.519+0000 7f9ac8318b80 1 -- 172.21.15.28:0/189593193 shutdown_connections 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.519+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/189593193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d936a520 0x55e8d936c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.519+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/189593193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d93613d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.519+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/189593193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d9361910 0x55e8d9361d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.519+0000 7f9ac8318b80 1 -- 172.21.15.28:0/189593193 >> 172.21.15.28:0/189593193 conn(0x55e8d928c120 msgr2=0x55e8d935b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.519+0000 7f9ac8318b80 1 -- 172.21.15.28:0/189593193 shutdown_connections 2024-06-06T08:43:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.519+0000 7f9ac8318b80 1 -- 172.21.15.28:0/189593193 wait complete. 2024-06-06T08:43:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.519+0000 7f9ac8318b80 1 -- start start 2024-06-06T08:43:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ac8318b80 1 Processor -- start 2024-06-06T08:43:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d92dbdf0 0x55e8d9369d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9367040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d936a520 0x55e8d9367580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55e8d924df10 con 0x55e8d9361910 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e8d92ada70 con 0x55e8d936a520 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e8d936d190 con 0x55e8d92dbdf0 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ac8318b80 10 client.0 _ll_register_callbacks cb 0x55e8d924b6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ab6000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9367040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ab6a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d92dbdf0 0x55e8d9369d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ab6000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9367040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43612/0 (socket says 172.21.15.28:43612) 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ab6a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d92dbdf0 0x55e8d9369d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:49354/0 (socket says 172.21.15.28:49354) 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ab6000700 1 -- 172.21.15.28:0/368378221 learned_addr learned my addr 172.21.15.28:0/368378221 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.520+0000 7f9ab7400700 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d936a520 0x55e8d9367580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.521+0000 7f9ab6000700 1 -- 172.21.15.28:0/368378221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d92dbdf0 msgr2=0x55e8d9369d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.521+0000 7f9ab6000700 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d92dbdf0 0x55e8d9369d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.521+0000 7f9ab6000700 1 -- 172.21.15.28:0/368378221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d936a520 msgr2=0x55e8d9367580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.521+0000 7f9ab6000700 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d936a520 0x55e8d9367580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.521+0000 7f9ab6000700 1 -- 172.21.15.28:0/368378221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8d9200880 con 0x55e8d9361910 2024-06-06T08:43:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.521+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d92dbdf0 0x55e8d9369d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.521+0000 7f9ab6000700 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9367040 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40126d0 tx=0x7f9aa40129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbab411821d3cc66 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.521+0000 7f9aa0c00700 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-06-06T08:43:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.521+0000 7f9aa0c00700 1 -- 172.21.15.28:0/368378221 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4004030 con 0x55e8d9361910 2024-06-06T08:43:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.522+0000 7f9ac8318b80 1 -- 172.21.15.28:0/368378221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9aa80a47e0 con 0x55e8d9361910 2024-06-06T08:43:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.522+0000 7f9aa0c00700 1 -- 172.21.15.28:0/368378221 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f9aa40041d0 con 0x55e8d9361910 2024-06-06T08:43:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.522+0000 7f9aa0c00700 1 -- 172.21.15.28:0/368378221 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9aa4021020 con 0x55e8d9361910 2024-06-06T08:43:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.522+0000 7f9ac8318b80 10 client.14916 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.522+0000 7f9ac8318b80 1 -- 172.21.15.28:0/368378221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e8d9377a10 con 0x55e8d9361910 2024-06-06T08:43:52.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.522+0000 7f9aa0c00700 1 -- 172.21.15.28:0/368378221 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9aa80a47e0 con 0x55e8d9361910 2024-06-06T08:43:52.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.522+0000 7f9aa0c00700 1 -- 172.21.15.28:0/368378221 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9aa401c580 con 0x55e8d9361910 2024-06-06T08:43:52.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.523+0000 7f9ac8318b80 10 client.14916 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:52.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.523+0000 7f9ac8318b80 10 client.14916 resolve_mds: resolved name 'e' to daemon mds.e 2024-06-06T08:43:52.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.523+0000 7f9ac8318b80 20 client.14916 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:52.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.523+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x55e8d9379fc0 0x55e8d937b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.523+0000 7f9ac8318b80 4 client.14916 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.523+0000 7f9ac8318b80 1 -- 172.21.15.28:0/368378221 --> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8d92befb0 con 0x55e8d9379fc0 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.523+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x55e8d9379fc0 0x55e8d937b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.523+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x55e8d9379fc0 0x55e8d937b430 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4107b14e3bf573d9 server_cookie=ee26a28c1c5c66e3 in_seq=0 out_seq=0 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.523+0000 7f9aa0c00700 10 client.14916 ms_handle_connect on v2:172.21.15.37:6834/2566253946 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.524+0000 7f9aa0c00700 1 -- 172.21.15.28:0/368378221 <== mds.3 v2:172.21.15.37:6834/2566253946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e8d92befb0 con 0x55e8d9379fc0 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.524+0000 7f9aa0c00700 10 client.14916 handle_command_reply: tid=0 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.524+0000 7f9ac8318b80 1 client.14916 shutdown 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9ac8318b80 1 -- 172.21.15.28:0/368378221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 msgr2=0x55e8d9367040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9367040 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40126d0 tx=0x7f9aa40129e0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9ac8318b80 1 -- 172.21.15.28:0/368378221 shutdown_connections 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x55e8d9379fc0 0x55e8d937b430 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d936a520 0x55e8d9367580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d92dbdf0 0x55e8d9369d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/368378221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9367040 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9ac8318b80 1 -- 172.21.15.28:0/368378221 >> 172.21.15.28:0/368378221 conn(0x55e8d928c120 msgr2=0x55e8d935b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:52.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9aa0c00700 0 client.14916 ms_handle_reset on v2:172.21.15.37:6834/2566253946 2024-06-06T08:43:52.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9ac8318b80 1 -- 172.21.15.28:0/368378221 shutdown_connections 2024-06-06T08:43:52.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9ac8318b80 1 -- 172.21.15.28:0/368378221 wait complete. 2024-06-06T08:43:52.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.525+0000 7f9ac8318b80 20 client.14916 trim_cache size 0 max 16384 2024-06-06T08:43:52.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.548+0000 7f9ac8318b80 1 Processor -- start 2024-06-06T08:43:52.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ac8318b80 1 -- start start 2024-06-06T08:43:52.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d935b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d9361910 0x55e8d93642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d936a520 0x55e8d9364800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55e8d9379770 con 0x55e8d92dbdf0 2024-06-06T08:43:52.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e8d9379e40 con 0x55e8d9361910 2024-06-06T08:43:52.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e8d937a510 con 0x55e8d936a520 2024-06-06T08:43:52.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ab6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d935b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ab6a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d935b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43620/0 (socket says 172.21.15.28:43620) 2024-06-06T08:43:52.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ab6a00700 1 -- 172.21.15.28:0/1792517977 learned_addr learned my addr 172.21.15.28:0/1792517977 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:52.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ab7400700 1 --2- 172.21.15.28:0/1792517977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d936a520 0x55e8d9364800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.549+0000 7f9ab6000700 1 --2- 172.21.15.28:0/1792517977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d9361910 0x55e8d93642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.550+0000 7f9ab6a00700 1 -- 172.21.15.28:0/1792517977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d936a520 msgr2=0x55e8d9364800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:52.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.550+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/1792517977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d936a520 0x55e8d9364800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.550+0000 7f9ab6a00700 1 -- 172.21.15.28:0/1792517977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d9361910 msgr2=0x55e8d93642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:52.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.550+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/1792517977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d9361910 0x55e8d93642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.550+0000 7f9ab6a00700 1 -- 172.21.15.28:0/1792517977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8d936a210 con 0x55e8d92dbdf0 2024-06-06T08:43:52.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.550+0000 7f9ab7400700 1 --2- 172.21.15.28:0/1792517977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d936a520 0x55e8d9364800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:52.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.550+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/1792517977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d935b910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8099f80 tx=0x7f9aa8099fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321e0ff1deda28a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:52.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.550+0000 7f9aa3400700 1 -- 172.21.15.28:0/1792517977 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80a47e0 con 0x55e8d92dbdf0 2024-06-06T08:43:52.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.550+0000 7f9aa3400700 1 -- 172.21.15.28:0/1792517977 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9aa800cd70 con 0x55e8d92dbdf0 2024-06-06T08:43:52.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.550+0000 7f9aa3400700 1 -- 172.21.15.28:0/1792517977 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80ba2b0 con 0x55e8d92dbdf0 2024-06-06T08:43:52.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.551+0000 7f9ac8318b80 1 -- 172.21.15.28:0/1792517977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 msgr2=0x55e8d935b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:52.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.551+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/1792517977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d935b910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8099f80 tx=0x7f9aa8099fb0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.551+0000 7f9ac8318b80 1 -- 172.21.15.28:0/1792517977 shutdown_connections 2024-06-06T08:43:52.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.551+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/1792517977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d936a520 0x55e8d9364800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.551+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/1792517977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d92dbdf0 0x55e8d935b910 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.551+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/1792517977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d9361910 0x55e8d93642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.551+0000 7f9ac8318b80 1 -- 172.21.15.28:0/1792517977 >> 172.21.15.28:0/1792517977 conn(0x55e8d928c120 msgr2=0x55e8d9365930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:52.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.551+0000 7f9ac8318b80 1 -- 172.21.15.28:0/1792517977 shutdown_connections 2024-06-06T08:43:52.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.552+0000 7f9ac8318b80 1 -- 172.21.15.28:0/1792517977 wait complete. 2024-06-06T08:43:52.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.552+0000 7f9ac8318b80 1 -- start start 2024-06-06T08:43:52.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.552+0000 7f9ac8318b80 1 Processor -- start 2024-06-06T08:43:52.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d92dbdf0 0x55e8d93837b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9383cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ac8318b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d936a520 0x55e8d937ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55e8d937b2b0 con 0x55e8d9361910 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e8d937abe0 con 0x55e8d92dbdf0 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ac8318b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e8d937b980 con 0x55e8d936a520 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ac8318b80 10 client.0 _ll_register_callbacks cb 0x55e8d924b6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ab6000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9383cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ab6a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d92dbdf0 0x55e8d93837b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ab6000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9383cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43636/0 (socket says 172.21.15.28:43636) 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ab6a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d92dbdf0 0x55e8d93837b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:44454/0 (socket says 172.21.15.28:44454) 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ab6000700 1 -- 172.21.15.28:0/2614334411 learned_addr learned my addr 172.21.15.28:0/2614334411 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ab7400700 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d936a520 0x55e8d937ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ab6a00700 1 -- 172.21.15.28:0/2614334411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d936a520 msgr2=0x55e8d937ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:52.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d936a520 0x55e8d937ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ab6a00700 1 -- 172.21.15.28:0/2614334411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 msgr2=0x55e8d9383cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9383cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.553+0000 7f9ab6a00700 1 -- 172.21.15.28:0/2614334411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8d937e3f0 con 0x55e8d92dbdf0 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.554+0000 7f9ab6000700 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9383cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.554+0000 7f9ab6a00700 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d92dbdf0 0x55e8d93837b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8099f80 tx=0x7f9aa809ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfbca661f5af1031 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.554+0000 7f9aa0c00700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.554+0000 7f9aa0c00700 1 -- 172.21.15.28:0/2614334411 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80a4550 con 0x55e8d92dbdf0 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.554+0000 7f9ac8318b80 1 -- 172.21.15.28:0/2614334411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9aa800cd70 con 0x55e8d92dbdf0 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.554+0000 7f9aa0c00700 1 -- 172.21.15.28:0/2614334411 <== mon.2 v2:172.21.15.37:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f9aa80ba2b0 con 0x55e8d92dbdf0 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.554+0000 7f9aa0c00700 1 -- 172.21.15.28:0/2614334411 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9aa80a47e0 con 0x55e8d92dbdf0 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.554+0000 7f9ac8318b80 10 client.25058 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.554+0000 7f9ac8318b80 1 -- 172.21.15.28:0/2614334411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e8d9382ce0 con 0x55e8d92dbdf0 2024-06-06T08:43:52.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.555+0000 7f9aa0c00700 1 -- 172.21.15.28:0/2614334411 <== mon.2 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9aa800cd70 con 0x55e8d92dbdf0 2024-06-06T08:43:52.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.555+0000 7f9aa0c00700 1 -- 172.21.15.28:0/2614334411 <== mon.2 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9aa80978c0 con 0x55e8d92dbdf0 2024-06-06T08:43:52.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.555+0000 7f9ac8318b80 10 client.25058 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:52.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.555+0000 7f9ac8318b80 10 client.25058 resolve_mds: resolved name 'e' to daemon mds.e 2024-06-06T08:43:52.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.555+0000 7f9ac8318b80 20 client.25058 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:52.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.555+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x55e8d93e9330 0x55e8d93e8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:52.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.555+0000 7f9ac8318b80 4 client.25058 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T08:43:52.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.555+0000 7f9ac8318b80 1 -- 172.21.15.28:0/2614334411 --> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] -- command(tid 0: {"prefix": "status"}) -- 0x55e8d92b9530 con 0x55e8d93e9330 2024-06-06T08:43:52.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.555+0000 7f9ab6000700 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x55e8d93e9330 0x55e8d93e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:52.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9ab6000700 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x55e8d93e9330 0x55e8d93e8040 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c17cbb4b41e8dba3 server_cookie=4deec615b6639940 in_seq=0 out_seq=0 2024-06-06T08:43:52.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9aa0c00700 10 client.25058 ms_handle_connect on v2:172.21.15.37:6834/2566253946 2024-06-06T08:43:52.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9aa0c00700 1 -- 172.21.15.28:0/2614334411 <== mds.3 v2:172.21.15.37:6834/2566253946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e8d92b9530 con 0x55e8d93e9330 2024-06-06T08:43:52.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9aa0c00700 10 client.25058 handle_command_reply: tid=0 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9ac8318b80 1 client.25058 shutdown 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9ac8318b80 1 -- 172.21.15.28:0/2614334411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d92dbdf0 msgr2=0x55e8d93837b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d92dbdf0 0x55e8d93837b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8099f80 tx=0x7f9aa809ba70 comp rx=0 tx=0).stop 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9ac8318b80 1 -- 172.21.15.28:0/2614334411 shutdown_connections 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8d936a520 0x55e8d937ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.37:6834/2566253946,v1:172.21.15.37:6835/2566253946] conn(0x55e8d93e9330 0x55e8d93e8040 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8d92dbdf0 0x55e8d93837b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9ac8318b80 1 --2- 172.21.15.28:0/2614334411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e8d9361910 0x55e8d9383cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9aa0c00700 0 client.25058 ms_handle_reset on v2:172.21.15.37:6834/2566253946 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.556+0000 7f9ac8318b80 1 -- 172.21.15.28:0/2614334411 >> 172.21.15.28:0/2614334411 conn(0x55e8d928c120 msgr2=0x55e8d9368870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.557+0000 7f9ac8318b80 1 -- 172.21.15.28:0/2614334411 shutdown_connections 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.557+0000 7f9ac8318b80 1 -- 172.21.15.28:0/2614334411 wait complete. 2024-06-06T08:43:52.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.557+0000 7f9ac8318b80 20 client.25058 trim_cache size 0 max 16384 2024-06-06T08:43:52.559 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:43:52.559 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:43:52.559 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 3, 2024-06-06T08:43:52.559 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24485, 2024-06-06T08:43:52.559 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-06-06T08:43:52.559 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-06-06T08:43:52.559 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-06-06T08:43:52.559 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 208.920817763, 2024-06-06T08:43:52.559 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 28, 2024-06-06T08:43:52.559 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 92, 2024-06-06T08:43:52.560 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 88, 2024-06-06T08:43:52.560 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 275.21455009300001 2024-06-06T08:43:52.560 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:43:52.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.557+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2133249702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a9c0a2c20 msgr2=0x7f9a9c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:52.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.557+0000 7f9ab7e00700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a9c0a2c20 0x7f9a9c0a50e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000b780 tx=0x7f9ab0009440 comp rx=0 tx=0).stop 2024-06-06T08:43:52.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.557+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2133249702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ab8074830 msgr2=0x7f9ab819f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:52.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.557+0000 7f9ab7e00700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ab8074830 0x7f9ab819f1b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800e9c0 tx=0x7f9aa800ecd0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.557+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2133249702 shutdown_connections 2024-06-06T08:43:52.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.557+0000 7f9ab7e00700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f9a9c0a2c20 0x7f9a9c0a50e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.558+0000 7f9ab7e00700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab81133c0 0x7f9ab81a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.558+0000 7f9ab7e00700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ab8074830 0x7f9ab819f1b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.558+0000 7f9ab7e00700 1 --2- 172.21.15.28:0/2133249702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab8075150 0x7f9ab819f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:52.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.558+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2133249702 >> 172.21.15.28:0/2133249702 conn(0x7f9ab80fdee0 msgr2=0x7f9ab80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:52.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.558+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2133249702 shutdown_connections 2024-06-06T08:43:52.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:52.558+0000 7f9ab7e00700 1 -- 172.21.15.28:0/2133249702 wait complete. 2024-06-06T08:43:53.510 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-06T08:43:53.993 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:54.149 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:53 smithi028 ceph-mon[31564]: pgmap v448: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:54.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:53 smithi037 ceph-mon[36609]: pgmap v448: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:54.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:53 smithi059 ceph-mon[36684]: pgmap v448: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:56.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:55 smithi028 ceph-mon[31564]: pgmap v449: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:56.151 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:55 smithi059 ceph-mon[36684]: pgmap v449: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.250+0000 7f4567c00700 1 -- 172.21.15.28:0/820037612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f456010a6d0 msgr2=0x7f456010aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.250+0000 7f4567c00700 1 --2- 172.21.15.28:0/820037612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f456010a6d0 0x7f456010aab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4550009990 tx=0x7f4550009ca0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.250+0000 7f4567c00700 1 -- 172.21.15.28:0/820037612 shutdown_connections 2024-06-06T08:43:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.250+0000 7f4567c00700 1 --2- 172.21.15.28:0/820037612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4560105090 0x7f45601115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.250+0000 7f4567c00700 1 --2- 172.21.15.28:0/820037612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f456010a6d0 0x7f456010aab0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.250+0000 7f4567c00700 1 --2- 172.21.15.28:0/820037612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45601046d0 0x7f4560104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.250+0000 7f4567c00700 1 -- 172.21.15.28:0/820037612 >> 172.21.15.28:0/820037612 conn(0x7f45601001c0 msgr2=0x7f45601025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.250+0000 7f4567c00700 1 -- 172.21.15.28:0/820037612 shutdown_connections 2024-06-06T08:43:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.250+0000 7f4567c00700 1 -- 172.21.15.28:0/820037612 wait complete. 2024-06-06T08:43:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.251+0000 7f4567c00700 1 Processor -- start 2024-06-06T08:43:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.251+0000 7f4567c00700 1 -- start start 2024-06-06T08:43:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.252+0000 7f4567c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45601046d0 0x7f456019aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.252+0000 7f4567c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4560105090 0x7f456019b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.252+0000 7f4567c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f456010a6d0 0x7f456019f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.252+0000 7f4567c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4560114a60 con 0x7f45601046d0 2024-06-06T08:43:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.252+0000 7f4567c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f45601148e0 con 0x7f4560105090 2024-06-06T08:43:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.252+0000 7f4567c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4560114be0 con 0x7f456010a6d0 2024-06-06T08:43:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.252+0000 7f4565200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45601046d0 0x7f456019aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.252+0000 7f4557e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4560105090 0x7f456019b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.252+0000 7f4557e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4560105090 0x7f456019b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:51898/0 (socket says 172.21.15.28:51898) 2024-06-06T08:43:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.252+0000 7f4557e00700 1 -- 172.21.15.28:0/2682806310 learned_addr learned my addr 172.21.15.28:0/2682806310 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.252+0000 7f4565c00700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f456010a6d0 0x7f456019f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.253+0000 7f4557e00700 1 -- 172.21.15.28:0/2682806310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f456010a6d0 msgr2=0x7f456019f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:56.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.253+0000 7f4557e00700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f456010a6d0 0x7f456019f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.253+0000 7f4557e00700 1 -- 172.21.15.28:0/2682806310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45601046d0 msgr2=0x7f456019aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:56.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.253+0000 7f4557e00700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45601046d0 0x7f456019aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.253+0000 7f4557e00700 1 -- 172.21.15.28:0/2682806310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456019fe90 con 0x7f4560105090 2024-06-06T08:43:56.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.253+0000 7f4557e00700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4560105090 0x7f456019b410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f454800d950 tx=0x7f454800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:56.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.253+0000 7f455e000700 1 -- 172.21.15.28:0/2682806310 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548016070 con 0x7f4560105090 2024-06-06T08:43:56.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.253+0000 7f4567c00700 1 -- 172.21.15.28:0/2682806310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45601a0180 con 0x7f4560105090 2024-06-06T08:43:56.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.253+0000 7f455e000700 1 -- 172.21.15.28:0/2682806310 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f454800fd70 con 0x7f4560105090 2024-06-06T08:43:56.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.253+0000 7f455e000700 1 -- 172.21.15.28:0/2682806310 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454800e610 con 0x7f4560105090 2024-06-06T08:43:56.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.253+0000 7f4567c00700 1 -- 172.21.15.28:0/2682806310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45601a7a00 con 0x7f4560105090 2024-06-06T08:43:56.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.256+0000 7f455e000700 1 -- 172.21.15.28:0/2682806310 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4548019070 con 0x7f4560105090 2024-06-06T08:43:56.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.258+0000 7f455e000700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f45440a2c20 0x7f45440a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.258+0000 7f4572582b80 1 Processor -- start 2024-06-06T08:43:56.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.258+0000 7f455e000700 1 -- 172.21.15.28:0/2682806310 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f45480cebd0 con 0x7f4560105090 2024-06-06T08:43:56.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.258+0000 7f4572582b80 1 -- start start 2024-06-06T08:43:56.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.258+0000 7f4565200700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f45440a2c20 0x7f45440a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4572582b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250cc29df0 0x56250ccad020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4572582b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccad560 0x56250ccad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4572582b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250ccb82b0 0x56250ccba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4572582b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x56250cbbc9c0 con 0x56250ccad560 2024-06-06T08:43:56.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4572582b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56250cbffab0 con 0x56250ccb82b0 2024-06-06T08:43:56.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4572582b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56250cbba8a0 con 0x56250cc29df0 2024-06-06T08:43:56.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4557e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccad560 0x56250ccad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4565200700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f45440a2c20 0x7f45440a50e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4550006010 tx=0x7f455000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:56.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4565200700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250cc29df0 0x56250ccad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4565c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250ccb82b0 0x56250ccba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4557e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccad560 0x56250ccad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51042/0 (socket says 172.21.15.28:51042) 2024-06-06T08:43:56.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4557e00700 1 -- 172.21.15.28:0/1610184143 learned_addr learned my addr 172.21.15.28:0/1610184143 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:56.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4565c00700 1 -- 172.21.15.28:0/1610184143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250cc29df0 msgr2=0x56250ccad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:56.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4565c00700 1 --2- 172.21.15.28:0/1610184143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250cc29df0 0x56250ccad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4565c00700 1 -- 172.21.15.28:0/1610184143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccad560 msgr2=0x56250ccad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:56.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4565c00700 1 --2- 172.21.15.28:0/1610184143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccad560 0x56250ccad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.259+0000 7f4565c00700 1 -- 172.21.15.28:0/1610184143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56250cba7f40 con 0x56250ccb82b0 2024-06-06T08:43:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.260+0000 7f4565c00700 1 --2- 172.21.15.28:0/1610184143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250ccb82b0 0x56250ccba6a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4558003e80 tx=0x7f4558009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b956b9ee743995be server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.260+0000 7f4556000700 1 -- 172.21.15.28:0/1610184143 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558004bb0 con 0x56250ccb82b0 2024-06-06T08:43:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.260+0000 7f4556000700 1 -- 172.21.15.28:0/1610184143 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4558004850 con 0x56250ccb82b0 2024-06-06T08:43:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.260+0000 7f4556000700 1 -- 172.21.15.28:0/1610184143 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558007d50 con 0x56250ccb82b0 2024-06-06T08:43:56.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.261+0000 7f4572582b80 1 -- 172.21.15.28:0/1610184143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250ccb82b0 msgr2=0x56250ccba6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:56.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.261+0000 7f4572582b80 1 --2- 172.21.15.28:0/1610184143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250ccb82b0 0x56250ccba6a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4558003e80 tx=0x7f4558009ba0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.261+0000 7f4572582b80 1 -- 172.21.15.28:0/1610184143 shutdown_connections 2024-06-06T08:43:56.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.261+0000 7f4572582b80 1 --2- 172.21.15.28:0/1610184143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250ccb82b0 0x56250ccba6a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.261+0000 7f4572582b80 1 --2- 172.21.15.28:0/1610184143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250cc29df0 0x56250ccad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.261+0000 7f4572582b80 1 --2- 172.21.15.28:0/1610184143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccad560 0x56250ccad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.261+0000 7f4572582b80 1 -- 172.21.15.28:0/1610184143 >> 172.21.15.28:0/1610184143 conn(0x56250cbda120 msgr2=0x56250cca9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:56.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.261+0000 7f4572582b80 1 -- 172.21.15.28:0/1610184143 shutdown_connections 2024-06-06T08:43:56.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.261+0000 7f4572582b80 1 -- 172.21.15.28:0/1610184143 wait complete. 2024-06-06T08:43:56.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.262+0000 7f4572582b80 1 -- start start 2024-06-06T08:43:56.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.262+0000 7f4572582b80 1 Processor -- start 2024-06-06T08:43:56.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.262+0000 7f4572582b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 0x56250ccb7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.262+0000 7f4572582b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccb4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.262+0000 7f4572582b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccb82b0 0x56250ccb5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.262+0000 7f4572582b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x56250cb9bf10 con 0x56250ccb82b0 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.262+0000 7f4572582b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56250cbfba70 con 0x56250cc29df0 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4572582b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56250ccbaf70 con 0x56250ccad560 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4572582b80 10 client.0 _ll_register_callbacks cb 0x56250cb996d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4565c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccb82b0 0x56250ccb5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4565200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 0x56250ccb7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4565200700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 0x56250ccb7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:51906/0 (socket says 172.21.15.28:51906) 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4565c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccb82b0 0x56250ccb5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51048/0 (socket says 172.21.15.28:51048) 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4565200700 1 -- 172.21.15.28:0/3503010821 learned_addr learned my addr 172.21.15.28:0/3503010821 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4557e00700 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccb4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4565200700 1 -- 172.21.15.28:0/3503010821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 msgr2=0x56250ccb4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4565200700 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccb4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4565200700 1 -- 172.21.15.28:0/3503010821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccb82b0 msgr2=0x56250ccb5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4565200700 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccb82b0 0x56250ccb5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4565200700 1 -- 172.21.15.28:0/3503010821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56250cb4e880 con 0x56250cc29df0 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.263+0000 7f4565c00700 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccb82b0 0x56250ccb5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.264+0000 7f4565200700 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 0x56250ccb7a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4550009990 tx=0x7f455001a050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b57a8cffab968958 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.264+0000 7f454ea00700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.264+0000 7f454ea00700 1 -- 172.21.15.28:0/3503010821 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4550034060 con 0x56250cc29df0 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.264+0000 7f454ea00700 1 -- 172.21.15.28:0/3503010821 <== mon.2 v2:172.21.15.37:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f4550019d50 con 0x56250cc29df0 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.264+0000 7f4572582b80 1 -- 172.21.15.28:0/3503010821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4558004850 con 0x56250cc29df0 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.264+0000 7f454ea00700 1 -- 172.21.15.28:0/3503010821 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f455000f460 con 0x56250cc29df0 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.264+0000 7f4572582b80 10 client.25070 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.264+0000 7f4572582b80 1 -- 172.21.15.28:0/3503010821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56250ccc5670 con 0x56250cc29df0 2024-06-06T08:43:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.265+0000 7f454ea00700 1 -- 172.21.15.28:0/3503010821 <== mon.2 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4558004850 con 0x56250cc29df0 2024-06-06T08:43:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.265+0000 7f454ea00700 1 -- 172.21.15.28:0/3503010821 <== mon.2 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4550039410 con 0x56250cc29df0 2024-06-06T08:43:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.265+0000 7f4572582b80 10 client.25070 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.265+0000 7f4572582b80 10 client.25070 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T08:43:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.265+0000 7f4572582b80 20 client.25070 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.265+0000 7f4572582b80 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x56250ccc7cf0 0x56250ccc9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.265+0000 7f4572582b80 4 client.25070 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T08:43:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.265+0000 7f4572582b80 1 -- 172.21.15.28:0/3503010821 --> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56250cc0cfb0 con 0x56250ccc7cf0 2024-06-06T08:43:56.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.266+0000 7f4557e00700 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x56250ccc7cf0 0x56250ccc9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.266+0000 7f4557e00700 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x56250ccc7cf0 0x56250ccc9160 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8db09cebd55c7d1a server_cookie=8ee52c2c13dba6d6 in_seq=0 out_seq=0 2024-06-06T08:43:56.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.266+0000 7f454ea00700 10 client.25070 ms_handle_connect on v2:172.21.15.59:6838/771325139 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f454ea00700 1 -- 172.21.15.28:0/3503010821 <== mds.2 v2:172.21.15.59:6838/771325139 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56250cc0cfb0 con 0x56250ccc7cf0 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f454ea00700 10 client.25070 handle_command_reply: tid=0 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f4572582b80 1 client.25070 shutdown 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f4572582b80 1 -- 172.21.15.28:0/3503010821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 msgr2=0x56250ccb7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f4572582b80 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 0x56250ccb7a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4550009990 tx=0x7f455001a050 comp rx=0 tx=0).stop 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f4572582b80 1 -- 172.21.15.28:0/3503010821 shutdown_connections 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f4572582b80 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250ccb82b0 0x56250ccb5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f4572582b80 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x56250ccc7cf0 0x56250ccc9160 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f4572582b80 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 0x56250ccb7a00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f4572582b80 1 --2- 172.21.15.28:0/3503010821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccb4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f454ea00700 0 client.25070 ms_handle_reset on v2:172.21.15.59:6838/771325139 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f4572582b80 1 -- 172.21.15.28:0/3503010821 >> 172.21.15.28:0/3503010821 conn(0x56250cbda120 msgr2=0x56250cca86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f4572582b80 1 -- 172.21.15.28:0/3503010821 shutdown_connections 2024-06-06T08:43:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.267+0000 7f4572582b80 1 -- 172.21.15.28:0/3503010821 wait complete. 2024-06-06T08:43:56.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.268+0000 7f4572582b80 20 client.25070 trim_cache size 0 max 16384 2024-06-06T08:43:56.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.292+0000 7f4572582b80 1 Processor -- start 2024-06-06T08:43:56.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.292+0000 7f4572582b80 1 -- start start 2024-06-06T08:43:56.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.292+0000 7f4572582b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cbda120 0x56250ccb5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.292+0000 7f4572582b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cc29df0 0x56250ccb96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.292+0000 7f4572582b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccb0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.292+0000 7f4572582b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x56250ccc74a0 con 0x56250cc29df0 2024-06-06T08:43:56.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.292+0000 7f4572582b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56250ccc7b70 con 0x56250cbda120 2024-06-06T08:43:56.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.292+0000 7f4572582b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56250ccc8240 con 0x56250ccad560 2024-06-06T08:43:56.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.292+0000 7f4557e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cc29df0 0x56250ccb96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4557e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cc29df0 0x56250ccb96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51064/0 (socket says 172.21.15.28:51064) 2024-06-06T08:43:56.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4557e00700 1 -- 172.21.15.28:0/1022026903 learned_addr learned my addr 172.21.15.28:0/1022026903 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:56.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4565c00700 1 --2- 172.21.15.28:0/1022026903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccb0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4565200700 1 --2- 172.21.15.28:0/1022026903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cbda120 0x56250ccb5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4557e00700 1 -- 172.21.15.28:0/1022026903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 msgr2=0x56250ccb0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:56.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4557e00700 1 --2- 172.21.15.28:0/1022026903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccb0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4557e00700 1 -- 172.21.15.28:0/1022026903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cbda120 msgr2=0x56250ccb5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:56.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4557e00700 1 --2- 172.21.15.28:0/1022026903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cbda120 0x56250ccb5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4557e00700 1 -- 172.21.15.28:0/1022026903 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56250ccaa030 con 0x56250cc29df0 2024-06-06T08:43:56.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4565c00700 1 --2- 172.21.15.28:0/1022026903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccb0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4565200700 1 --2- 172.21.15.28:0/1022026903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cbda120 0x56250ccb5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.293+0000 7f4557e00700 1 --2- 172.21.15.28:0/1022026903 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cc29df0 0x56250ccb96a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45480977b0 tx=0x7f45480ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d641c6df97cb475e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.294+0000 7f4555600700 1 -- 172.21.15.28:0/1022026903 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548020040 con 0x56250cc29df0 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.294+0000 7f4555600700 1 -- 172.21.15.28:0/1022026903 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45480a3fc0 con 0x56250cc29df0 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.294+0000 7f4555600700 1 -- 172.21.15.28:0/1022026903 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45480a3b30 con 0x56250cc29df0 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.294+0000 7f4572582b80 1 -- 172.21.15.28:0/1022026903 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cc29df0 msgr2=0x56250ccb96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.294+0000 7f4572582b80 1 --2- 172.21.15.28:0/1022026903 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cc29df0 0x56250ccb96a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45480977b0 tx=0x7f45480ce040 comp rx=0 tx=0).stop 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.294+0000 7f4572582b80 1 -- 172.21.15.28:0/1022026903 shutdown_connections 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.294+0000 7f4572582b80 1 --2- 172.21.15.28:0/1022026903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccb0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.294+0000 7f4572582b80 1 --2- 172.21.15.28:0/1022026903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cbda120 0x56250ccb5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.294+0000 7f4572582b80 1 --2- 172.21.15.28:0/1022026903 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cc29df0 0x56250ccb96a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.294+0000 7f4572582b80 1 -- 172.21.15.28:0/1022026903 >> 172.21.15.28:0/1022026903 conn(0x56250cca54b0 msgr2=0x56250ccb35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.294+0000 7f4572582b80 1 -- 172.21.15.28:0/1022026903 shutdown_connections 2024-06-06T08:43:56.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.295+0000 7f4572582b80 1 -- 172.21.15.28:0/1022026903 wait complete. 2024-06-06T08:43:56.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.295+0000 7f4572582b80 1 -- start start 2024-06-06T08:43:56.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.295+0000 7f4572582b80 1 Processor -- start 2024-06-06T08:43:56.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4572582b80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cbda120 0x56250ccb9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4572582b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 0x56250ccb9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4572582b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4572582b80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x56250ccc8fe0 con 0x56250cbda120 2024-06-06T08:43:56.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4572582b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56250ccc8910 con 0x56250cc29df0 2024-06-06T08:43:56.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4572582b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56250ccc96b0 con 0x56250ccad560 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4572582b80 10 client.0 _ll_register_callbacks cb 0x56250cb996d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4565200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cbda120 0x56250ccb9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4565200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cbda120 0x56250ccb9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51070/0 (socket says 172.21.15.28:51070) 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4565200700 1 -- 172.21.15.28:0/2145823954 learned_addr learned my addr 172.21.15.28:0/2145823954 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4565c00700 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4557e00700 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 0x56250ccb9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4565200700 1 -- 172.21.15.28:0/2145823954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 msgr2=0x56250ccba410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4565200700 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccba410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4565200700 1 -- 172.21.15.28:0/2145823954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 msgr2=0x56250ccb9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4565200700 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 0x56250ccb9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4565200700 1 -- 172.21.15.28:0/2145823954 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56250ccceae0 con 0x56250cbda120 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.296+0000 7f4565c00700 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccba410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:43:56.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.297+0000 7f4565200700 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cbda120 0x56250ccb9990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4550039830 tx=0x7f455000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d09c472045ad70b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.297+0000 7f454ea00700 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.297+0000 7f454ea00700 1 -- 172.21.15.28:0/2145823954 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4550046060 con 0x56250cbda120 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.297+0000 7f454ea00700 1 -- 172.21.15.28:0/2145823954 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f4550019bd0 con 0x56250cbda120 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.297+0000 7f4572582b80 1 -- 172.21.15.28:0/2145823954 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45480a3fc0 con 0x56250cbda120 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.297+0000 7f454ea00700 1 -- 172.21.15.28:0/2145823954 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f455003ae60 con 0x56250cbda120 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.297+0000 7f4572582b80 10 client.14940 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.297+0000 7f4572582b80 1 -- 172.21.15.28:0/2145823954 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56250cd33820 con 0x56250cbda120 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.298+0000 7f454ea00700 1 -- 172.21.15.28:0/2145823954 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45480a3fc0 con 0x56250cbda120 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.298+0000 7f454ea00700 1 -- 172.21.15.28:0/2145823954 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4550041420 con 0x56250cbda120 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.298+0000 7f4572582b80 10 client.14940 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.298+0000 7f4572582b80 10 client.14940 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.298+0000 7f4572582b80 20 client.14940 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.298+0000 7f4572582b80 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x56250ccb82b0 0x56250cd37140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:56.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.298+0000 7f4572582b80 4 client.14940 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T08:43:56.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.298+0000 7f4572582b80 1 -- 172.21.15.28:0/2145823954 --> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] -- command(tid 0: {"prefix": "status"}) -- 0x56250cc07530 con 0x56250ccb82b0 2024-06-06T08:43:56.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.298+0000 7f4557e00700 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x56250ccb82b0 0x56250cd37140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:56.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f4557e00700 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x56250ccb82b0 0x56250cd37140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3d06d450a29f9450 server_cookie=ebdfcbfc3416aeed in_seq=0 out_seq=0 2024-06-06T08:43:56.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f454ea00700 10 client.14940 ms_handle_connect on v2:172.21.15.59:6838/771325139 2024-06-06T08:43:56.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f454ea00700 1 -- 172.21.15.28:0/2145823954 <== mds.2 v2:172.21.15.59:6838/771325139 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x56250cc07530 con 0x56250ccb82b0 2024-06-06T08:43:56.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f454ea00700 10 client.14940 handle_command_reply: tid=0 2024-06-06T08:43:56.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f4572582b80 1 client.14940 shutdown 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f4572582b80 1 -- 172.21.15.28:0/2145823954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cbda120 msgr2=0x56250ccb9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f4572582b80 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cbda120 0x56250ccb9990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4550039830 tx=0x7f455000b670 comp rx=0 tx=0).stop 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f4572582b80 1 -- 172.21.15.28:0/2145823954 shutdown_connections 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f4572582b80 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56250ccad560 0x56250ccba410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f4572582b80 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56250cbda120 0x56250ccb9990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f4572582b80 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.59:6838/771325139,v1:172.21.15.59:6839/771325139] conn(0x56250ccb82b0 0x56250cd37140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f4572582b80 1 --2- 172.21.15.28:0/2145823954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56250cc29df0 0x56250ccb9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f454ea00700 0 client.14940 ms_handle_reset on v2:172.21.15.59:6838/771325139 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.299+0000 7f4572582b80 1 -- 172.21.15.28:0/2145823954 >> 172.21.15.28:0/2145823954 conn(0x56250cca54b0 msgr2=0x56250ccb6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.300+0000 7f4572582b80 1 -- 172.21.15.28:0/2145823954 shutdown_connections 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.300+0000 7f4572582b80 1 -- 172.21.15.28:0/2145823954 wait complete. 2024-06-06T08:43:56.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.300+0000 7f4572582b80 20 client.14940 trim_cache size 0 max 16384 2024-06-06T08:43:56.302 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:43:56.302 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:43:56.302 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 2, 2024-06-06T08:43:56.302 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24499, 2024-06-06T08:43:56.302 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-06-06T08:43:56.302 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-06-06T08:43:56.302 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-06-06T08:43:56.302 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 213.67667320000001, 2024-06-06T08:43:56.302 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 28, 2024-06-06T08:43:56.302 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 92, 2024-06-06T08:43:56.302 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 88, 2024-06-06T08:43:56.303 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 267.06778197 2024-06-06T08:43:56.303 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:43:56.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.300+0000 7f4567c00700 1 -- 172.21.15.28:0/2682806310 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f45440a2c20 msgr2=0x7f45440a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:56.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.300+0000 7f4567c00700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f45440a2c20 0x7f45440a50e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4550006010 tx=0x7f455000b540 comp rx=0 tx=0).stop 2024-06-06T08:43:56.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.300+0000 7f4567c00700 1 -- 172.21.15.28:0/2682806310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4560105090 msgr2=0x7f456019b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:56.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.300+0000 7f4567c00700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4560105090 0x7f456019b410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f454800d950 tx=0x7f454800dc60 comp rx=0 tx=0).stop 2024-06-06T08:43:56.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.301+0000 7f4567c00700 1 -- 172.21.15.28:0/2682806310 shutdown_connections 2024-06-06T08:43:56.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.301+0000 7f4567c00700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f45440a2c20 0x7f45440a50e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.301+0000 7f4567c00700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f456010a6d0 0x7f456019f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.301+0000 7f4567c00700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45601046d0 0x7f456019aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.301+0000 7f4567c00700 1 --2- 172.21.15.28:0/2682806310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4560105090 0x7f456019b410 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:56.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.301+0000 7f4567c00700 1 -- 172.21.15.28:0/2682806310 >> 172.21.15.28:0/2682806310 conn(0x7f45601001c0 msgr2=0x7f45601007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:56.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.301+0000 7f4567c00700 1 -- 172.21.15.28:0/2682806310 shutdown_connections 2024-06-06T08:43:56.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:56.301+0000 7f4567c00700 1 -- 172.21.15.28:0/2682806310 wait complete. 2024-06-06T08:43:56.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:55 smithi037 ceph-mon[36609]: pgmap v449: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:43:57.103 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell mds.h status 2024-06-06T08:43:57.574 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:43:58.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:57 smithi028 ceph-mon[31564]: pgmap v450: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:58.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:57 smithi037 ceph-mon[36609]: pgmap v450: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:58.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:57 smithi059 ceph-mon[36684]: pgmap v450: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:43:59.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.716+0000 7f85d0400700 1 -- 172.21.15.28:0/1070020613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c81030f0 msgr2=0x7f85c8107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:59.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.716+0000 7f85d0400700 1 --2- 172.21.15.28:0/1070020613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c81030f0 0x7f85c8107110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f85b40099c0 tx=0x7f85b4009cd0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.716+0000 7f85d0400700 1 -- 172.21.15.28:0/1070020613 shutdown_connections 2024-06-06T08:43:59.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.716+0000 7f85d0400700 1 --2- 172.21.15.28:0/1070020613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c8107840 0x7f85c810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.716+0000 7f85d0400700 1 --2- 172.21.15.28:0/1070020613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c8102740 0x7f85c8102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.716+0000 7f85d0400700 1 --2- 172.21.15.28:0/1070020613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c81030f0 0x7f85c8107110 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.716+0000 7f85d0400700 1 -- 172.21.15.28:0/1070020613 >> 172.21.15.28:0/1070020613 conn(0x7f85c80795f0 msgr2=0x7f85c8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:59.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.716+0000 7f85d0400700 1 -- 172.21.15.28:0/1070020613 shutdown_connections 2024-06-06T08:43:59.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.716+0000 7f85d0400700 1 -- 172.21.15.28:0/1070020613 wait complete. 2024-06-06T08:43:59.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.717+0000 7f85d0400700 1 Processor -- start 2024-06-06T08:43:59.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.717+0000 7f85d0400700 1 -- start start 2024-06-06T08:43:59.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.717+0000 7f85d0400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c8102740 0x7f85c819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.717+0000 7f85d0400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c81030f0 0x7f85c819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.717+0000 7f85d0400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c8107840 0x7f85c819f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.717+0000 7f85d0400700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8112770 con 0x7f85c8102740 2024-06-06T08:43:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85d0400700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f85c81125f0 con 0x7f85c81030f0 2024-06-06T08:43:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85d0400700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f85c81128f0 con 0x7f85c8107840 2024-06-06T08:43:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85cda00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c8102740 0x7f85c819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85cda00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c8102740 0x7f85c819ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51092/0 (socket says 172.21.15.28:51092) 2024-06-06T08:43:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85cda00700 1 -- 172.21.15.28:0/1089976867 learned_addr learned my addr 172.21.15.28:0/1089976867 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85cd000700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c81030f0 0x7f85c819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85ce400700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c8107840 0x7f85c819f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85cda00700 1 -- 172.21.15.28:0/1089976867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c8107840 msgr2=0x7f85c819f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85cda00700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c8107840 0x7f85c819f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85cda00700 1 -- 172.21.15.28:0/1089976867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c81030f0 msgr2=0x7f85c819b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85cda00700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c81030f0 0x7f85c819b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.718+0000 7f85cda00700 1 -- 172.21.15.28:0/1089976867 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c819fdb0 con 0x7f85c8102740 2024-06-06T08:43:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.719+0000 7f85cda00700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c8102740 0x7f85c819ada0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00d980 tx=0x7f85bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.719+0000 7f85c6000700 1 -- 172.21.15.28:0/1089976867 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc017070 con 0x7f85c8102740 2024-06-06T08:43:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.719+0000 7f85c6000700 1 -- 172.21.15.28:0/1089976867 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85bc005020 con 0x7f85c8102740 2024-06-06T08:43:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.719+0000 7f85c6000700 1 -- 172.21.15.28:0/1089976867 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc00fbf0 con 0x7f85c8102740 2024-06-06T08:43:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.719+0000 7f85d0400700 1 -- 172.21.15.28:0/1089976867 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c81a00a0 con 0x7f85c8102740 2024-06-06T08:43:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.719+0000 7f85d0400700 1 -- 172.21.15.28:0/1089976867 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c81a7920 con 0x7f85c8102740 2024-06-06T08:43:59.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.723+0000 7f85c6000700 1 -- 172.21.15.28:0/1089976867 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f85bc0051d0 con 0x7f85c8102740 2024-06-06T08:43:59.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.724+0000 7f85dacdab80 1 Processor -- start 2024-06-06T08:43:59.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.724+0000 7f85dacdab80 1 -- start start 2024-06-06T08:43:59.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f45020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f45560 0x55afb4f459e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 0x55afb4f526a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85dacdab80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55afb4e549c0 con 0x55afb4f45560 2024-06-06T08:43:59.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85dacdab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55afb4e97ab0 con 0x55afb4ec1df0 2024-06-06T08:43:59.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85dacdab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55afb4e528a0 con 0x55afb4f502b0 2024-06-06T08:43:59.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85cd000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 0x55afb4f526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85cda00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f45560 0x55afb4f459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85cd000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 0x55afb4f526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:36388/0 (socket says 172.21.15.28:36388) 2024-06-06T08:43:59.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85ce400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f45020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85cd000700 1 -- 172.21.15.28:0/1386578357 learned_addr learned my addr 172.21.15.28:0/1386578357 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:59.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.725+0000 7f85c6000700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f85b00a2ca0 0x7f85b00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.726+0000 7f85cd000700 1 -- 172.21.15.28:0/1386578357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 msgr2=0x55afb4f45020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.726+0000 7f85cd000700 1 --2- 172.21.15.28:0/1386578357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f45020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.726+0000 7f85cd000700 1 -- 172.21.15.28:0/1386578357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f45560 msgr2=0x55afb4f459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.726+0000 7f85c6000700 1 -- 172.21.15.28:0/1089976867 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f85bc0ceee0 con 0x7f85c8102740 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.726+0000 7f85cd000700 1 --2- 172.21.15.28:0/1386578357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f45560 0x55afb4f459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.726+0000 7f85cd000700 1 -- 172.21.15.28:0/1386578357 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afb4e3ff40 con 0x55afb4f502b0 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.726+0000 7f85ce400700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f85b00a2ca0 0x7f85b00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.726+0000 7f85cda00700 1 --2- 172.21.15.28:0/1386578357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f45560 0x55afb4f459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.726+0000 7f85cd000700 1 --2- 172.21.15.28:0/1386578357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 0x55afb4f526a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85b40099c0 tx=0x7f85b4009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=879add3371f7a207 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.727+0000 7f85baa00700 1 -- 172.21.15.28:0/1386578357 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4028070 con 0x55afb4f502b0 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.727+0000 7f85ce400700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f85b00a2ca0 0x7f85b00a5160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55afb4f42360 tx=0x7f85c0009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.727+0000 7f85baa00700 1 -- 172.21.15.28:0/1386578357 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85b4003780 con 0x55afb4f502b0 2024-06-06T08:43:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.727+0000 7f85baa00700 1 -- 172.21.15.28:0/1386578357 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b400bb50 con 0x55afb4f502b0 2024-06-06T08:43:59.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.728+0000 7f85dacdab80 1 -- 172.21.15.28:0/1386578357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 msgr2=0x55afb4f526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:59.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.728+0000 7f85dacdab80 1 --2- 172.21.15.28:0/1386578357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 0x55afb4f526a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85b40099c0 tx=0x7f85b4009700 comp rx=0 tx=0).stop 2024-06-06T08:43:59.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.728+0000 7f85dacdab80 1 -- 172.21.15.28:0/1386578357 shutdown_connections 2024-06-06T08:43:59.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.728+0000 7f85dacdab80 1 --2- 172.21.15.28:0/1386578357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 0x55afb4f526a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.728+0000 7f85dacdab80 1 --2- 172.21.15.28:0/1386578357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f45020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.728+0000 7f85dacdab80 1 --2- 172.21.15.28:0/1386578357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f45560 0x55afb4f459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.728+0000 7f85dacdab80 1 -- 172.21.15.28:0/1386578357 >> 172.21.15.28:0/1386578357 conn(0x55afb4e72120 msgr2=0x55afb4f41460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:59.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.728+0000 7f85dacdab80 1 -- 172.21.15.28:0/1386578357 shutdown_connections 2024-06-06T08:43:59.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.728+0000 7f85dacdab80 1 -- 172.21.15.28:0/1386578357 wait complete. 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.728+0000 7f85dacdab80 1 -- start start 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.729+0000 7f85dacdab80 1 Processor -- start 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.729+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4ec1df0 0x55afb4f4fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.729+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4f45560 0x55afb4f4cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.729+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f502b0 0x55afb4f4d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.729+0000 7f85dacdab80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55afb4e33f10 con 0x55afb4f502b0 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.729+0000 7f85dacdab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55afb4e93a70 con 0x55afb4f45560 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.729+0000 7f85dacdab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55afb4f52f10 con 0x55afb4ec1df0 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.729+0000 7f85dacdab80 10 client.0 _ll_register_callbacks cb 0x55afb4e316d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85ce400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f502b0 0x55afb4f4d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85cda00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4ec1df0 0x55afb4f4fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85cda00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4ec1df0 0x55afb4f4fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:36394/0 (socket says 172.21.15.28:36394) 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85cda00700 1 -- 172.21.15.28:0/1111947934 learned_addr learned my addr 172.21.15.28:0/1111947934 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85cd000700 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4f45560 0x55afb4f4cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85cda00700 1 -- 172.21.15.28:0/1111947934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4f45560 msgr2=0x55afb4f4cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85cda00700 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4f45560 0x55afb4f4cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85cda00700 1 -- 172.21.15.28:0/1111947934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f502b0 msgr2=0x55afb4f4d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85cda00700 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f502b0 0x55afb4f4d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85cda00700 1 -- 172.21.15.28:0/1111947934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afb4de6880 con 0x55afb4ec1df0 2024-06-06T08:43:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85cda00700 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4ec1df0 0x55afb4f4fa00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00be80 tx=0x7f85bc09b0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae68aa9979909cf6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.730+0000 7f85af400700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-06-06T08:43:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.731+0000 7f85af400700 1 -- 172.21.15.28:0/1111947934 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc086070 con 0x55afb4ec1df0 2024-06-06T08:43:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.731+0000 7f85af400700 1 -- 172.21.15.28:0/1111947934 <== mon.1 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f85bc005540 con 0x55afb4ec1df0 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.731+0000 7f85dacdab80 1 -- 172.21.15.28:0/1111947934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85b4003780 con 0x55afb4ec1df0 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.731+0000 7f85af400700 1 -- 172.21.15.28:0/1111947934 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f85bc09fa10 con 0x55afb4ec1df0 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.731+0000 7f85dacdab80 10 client.25081 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.731+0000 7f85dacdab80 1 -- 172.21.15.28:0/1111947934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55afb4f5d690 con 0x55afb4ec1df0 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.731+0000 7f85af400700 1 -- 172.21.15.28:0/1111947934 <== mon.1 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85b4003780 con 0x55afb4ec1df0 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.731+0000 7f85af400700 1 -- 172.21.15.28:0/1111947934 <== mon.1 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f85bc0a3e40 con 0x55afb4ec1df0 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.732+0000 7f85dacdab80 10 client.25081 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.732+0000 7f85dacdab80 10 client.25081 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.732+0000 7f85dacdab80 20 client.25081 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.732+0000 7f85dacdab80 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55afb4f5fcf0 0x55afb4f61160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.732+0000 7f85dacdab80 4 client.25081 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T08:43:59.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.732+0000 7f85dacdab80 1 -- 172.21.15.28:0/1111947934 --> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afb4ea4fb0 con 0x55afb4f5fcf0 2024-06-06T08:43:59.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.733+0000 7f85cd000700 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55afb4f5fcf0 0x55afb4f61160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.733+0000 7f85cd000700 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55afb4f5fcf0 0x55afb4f61160 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2258cc655e436ab9 server_cookie=f7d4edfc19588f31 in_seq=0 out_seq=0 2024-06-06T08:43:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.733+0000 7f85af400700 10 client.25081 ms_handle_connect on v2:172.21.15.37:6836/1443905946 2024-06-06T08:43:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85af400700 1 -- 172.21.15.28:0/1111947934 <== mds.1 v2:172.21.15.37:6836/1443905946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55afb4ea4fb0 con 0x55afb4f5fcf0 2024-06-06T08:43:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85af400700 10 client.25081 handle_command_reply: tid=0 2024-06-06T08:43:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85dacdab80 1 client.25081 shutdown 2024-06-06T08:43:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85dacdab80 1 -- 172.21.15.28:0/1111947934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4ec1df0 msgr2=0x55afb4f4fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85dacdab80 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4ec1df0 0x55afb4f4fa00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00be80 tx=0x7f85bc09b0b0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85dacdab80 1 -- 172.21.15.28:0/1111947934 shutdown_connections 2024-06-06T08:43:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85dacdab80 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f502b0 0x55afb4f4d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85dacdab80 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55afb4f5fcf0 0x55afb4f61160 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85dacdab80 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4ec1df0 0x55afb4f4fa00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85dacdab80 1 --2- 172.21.15.28:0/1111947934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4f45560 0x55afb4f4cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85af400700 0 client.25081 ms_handle_reset on v2:172.21.15.37:6836/1443905946 2024-06-06T08:43:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.734+0000 7f85dacdab80 1 -- 172.21.15.28:0/1111947934 >> 172.21.15.28:0/1111947934 conn(0x55afb4e72120 msgr2=0x55afb4f406f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.735+0000 7f85dacdab80 1 -- 172.21.15.28:0/1111947934 shutdown_connections 2024-06-06T08:43:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.735+0000 7f85dacdab80 1 -- 172.21.15.28:0/1111947934 wait complete. 2024-06-06T08:43:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.735+0000 7f85dacdab80 20 client.25081 trim_cache size 0 max 16384 2024-06-06T08:43:59.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.760+0000 7f85dacdab80 1 Processor -- start 2024-06-06T08:43:59.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.760+0000 7f85dacdab80 1 -- start start 2024-06-06T08:43:59.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.760+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f4d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.760+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f45560 0x55afb4f516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.760+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 0x55afb4f40f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.760+0000 7f85dacdab80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55afb4f5f4a0 con 0x55afb4f45560 2024-06-06T08:43:59.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.760+0000 7f85dacdab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55afb4f5fb70 con 0x55afb4ec1df0 2024-06-06T08:43:59.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.760+0000 7f85dacdab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55afb4f60240 con 0x55afb4f502b0 2024-06-06T08:43:59.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.761+0000 7f85cda00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f4d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.761+0000 7f85cda00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f4d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:51972/0 (socket says 172.21.15.28:51972) 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.761+0000 7f85cda00700 1 -- 172.21.15.28:0/2888467211 learned_addr learned my addr 172.21.15.28:0/2888467211 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.761+0000 7f85cd000700 1 --2- 172.21.15.28:0/2888467211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f45560 0x55afb4f516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.761+0000 7f85ce400700 1 --2- 172.21.15.28:0/2888467211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 0x55afb4f40f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.761+0000 7f85cda00700 1 -- 172.21.15.28:0/2888467211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 msgr2=0x55afb4f40f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.761+0000 7f85cda00700 1 --2- 172.21.15.28:0/2888467211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 0x55afb4f40f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.761+0000 7f85cda00700 1 -- 172.21.15.28:0/2888467211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f45560 msgr2=0x55afb4f516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.761+0000 7f85cda00700 1 --2- 172.21.15.28:0/2888467211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f45560 0x55afb4f516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.761+0000 7f85cda00700 1 -- 172.21.15.28:0/2888467211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afb4f4b270 con 0x55afb4ec1df0 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.761+0000 7f85cda00700 1 --2- 172.21.15.28:0/2888467211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f4d270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f85bc099910 tx=0x7f85bc09afc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3822b944fed899d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.762+0000 7f85ba000700 1 -- 172.21.15.28:0/2888467211 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc086070 con 0x55afb4ec1df0 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.762+0000 7f85ba000700 1 -- 172.21.15.28:0/2888467211 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85bc0b4070 con 0x55afb4ec1df0 2024-06-06T08:43:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.762+0000 7f85ba000700 1 -- 172.21.15.28:0/2888467211 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0afe30 con 0x55afb4ec1df0 2024-06-06T08:43:59.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.762+0000 7f85dacdab80 1 -- 172.21.15.28:0/2888467211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 msgr2=0x55afb4f4d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:59.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.762+0000 7f85dacdab80 1 --2- 172.21.15.28:0/2888467211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f4d270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f85bc099910 tx=0x7f85bc09afc0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.763+0000 7f85dacdab80 1 -- 172.21.15.28:0/2888467211 shutdown_connections 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.763+0000 7f85dacdab80 1 --2- 172.21.15.28:0/2888467211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f502b0 0x55afb4f40f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.763+0000 7f85dacdab80 1 --2- 172.21.15.28:0/2888467211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f4d270 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.763+0000 7f85dacdab80 1 --2- 172.21.15.28:0/2888467211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f45560 0x55afb4f516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.763+0000 7f85dacdab80 1 -- 172.21.15.28:0/2888467211 >> 172.21.15.28:0/2888467211 conn(0x55afb4e72120 msgr2=0x55afb4f520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.763+0000 7f85dacdab80 1 -- 172.21.15.28:0/2888467211 shutdown_connections 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.763+0000 7f85dacdab80 1 -- 172.21.15.28:0/2888467211 wait complete. 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.763+0000 7f85dacdab80 1 -- start start 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.763+0000 7f85dacdab80 1 Processor -- start 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f67c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f45560 0x55afb4f681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85dacdab80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f502b0 0x55afb4f686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85dacdab80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55afb4f60fe0 con 0x55afb4f502b0 2024-06-06T08:43:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85dacdab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55afb4f60910 con 0x55afb4ec1df0 2024-06-06T08:43:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85dacdab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55afb4f616b0 con 0x55afb4f45560 2024-06-06T08:43:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85dacdab80 10 client.0 _ll_register_callbacks cb 0x55afb4e316d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:43:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85cd000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f45560 0x55afb4f681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85cd000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f45560 0x55afb4f681a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:36422/0 (socket says 172.21.15.28:36422) 2024-06-06T08:43:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85cd000700 1 -- 172.21.15.28:0/2900451682 learned_addr learned my addr 172.21.15.28:0/2900451682 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:43:59.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85ce400700 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f502b0 0x55afb4f686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.764+0000 7f85cda00700 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f67c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85cd000700 1 -- 172.21.15.28:0/2900451682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 msgr2=0x55afb4f67c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:59.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85cd000700 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f67c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85cd000700 1 -- 172.21.15.28:0/2900451682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f502b0 msgr2=0x55afb4f686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:43:59.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85cd000700 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f502b0 0x55afb4f686e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85cd000700 1 -- 172.21.15.28:0/2900451682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afb4f51ab0 con 0x55afb4f45560 2024-06-06T08:43:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85cda00700 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f67c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:43:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85cd000700 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f45560 0x55afb4f681a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f85b4003ed0 tx=0x7f85b4003e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6087768838d18692 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:43:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85af400700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-06-06T08:43:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85af400700 1 -- 172.21.15.28:0/2900451682 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4028040 con 0x55afb4f45560 2024-06-06T08:43:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85af400700 1 -- 172.21.15.28:0/2900451682 <== mon.1 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f85b40052c0 con 0x55afb4f45560 2024-06-06T08:43:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85dacdab80 1 -- 172.21.15.28:0/2900451682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85bc0b4070 con 0x55afb4f45560 2024-06-06T08:43:59.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.765+0000 7f85af400700 1 -- 172.21.15.28:0/2900451682 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f85b40054c0 con 0x55afb4f45560 2024-06-06T08:43:59.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.766+0000 7f85dacdab80 10 client.25087 fetch_fsmap learned FSMap version 28 2024-06-06T08:43:59.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.766+0000 7f85dacdab80 1 -- 172.21.15.28:0/2900451682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55afb4fcb810 con 0x55afb4f45560 2024-06-06T08:43:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.766+0000 7f85af400700 1 -- 172.21.15.28:0/2900451682 <== mon.1 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85bc0b4070 con 0x55afb4f45560 2024-06-06T08:43:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.766+0000 7f85af400700 1 -- 172.21.15.28:0/2900451682 <== mon.1 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f85b40426c0 con 0x55afb4f45560 2024-06-06T08:43:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.766+0000 7f85dacdab80 10 client.25087 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:43:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.766+0000 7f85dacdab80 10 client.25087 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-06T08:43:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.766+0000 7f85dacdab80 20 client.25087 populate_metadata read hostname 'smithi028' 2024-06-06T08:43:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.766+0000 7f85dacdab80 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55afb4fcfed0 0x55afb4fcebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:43:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.766+0000 7f85dacdab80 4 client.25087 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T08:43:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.766+0000 7f85dacdab80 1 -- 172.21.15.28:0/2900451682 --> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] -- command(tid 0: {"prefix": "status"}) -- 0x55afb4e9f530 con 0x55afb4fcfed0 2024-06-06T08:43:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.767+0000 7f85cda00700 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55afb4fcfed0 0x55afb4fcebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:43:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.767+0000 7f85af400700 10 client.25087 ms_handle_connect on v2:172.21.15.37:6836/1443905946 2024-06-06T08:43:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.767+0000 7f85cda00700 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55afb4fcfed0 0x55afb4fcebe0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=615fbef0246a9b server_cookie=b25de44a9af8e12f in_seq=0 out_seq=0 2024-06-06T08:43:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85af400700 1 -- 172.21.15.28:0/2900451682 <== mds.1 v2:172.21.15.37:6836/1443905946 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55afb4e9f530 con 0x55afb4fcfed0 2024-06-06T08:43:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85af400700 10 client.25087 handle_command_reply: tid=0 2024-06-06T08:43:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 1 client.25087 shutdown 2024-06-06T08:43:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 1 -- 172.21.15.28:0/2900451682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f45560 msgr2=0x55afb4f681a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f45560 0x55afb4f681a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f85b4003ed0 tx=0x7f85b4003e60 comp rx=0 tx=0).stop 2024-06-06T08:43:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 1 -- 172.21.15.28:0/2900451682 shutdown_connections 2024-06-06T08:43:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55afb4f502b0 0x55afb4f686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afb4ec1df0 0x55afb4f67c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.37:6836/1443905946,v1:172.21.15.37:6837/1443905946] conn(0x55afb4fcfed0 0x55afb4fcebe0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 1 --2- 172.21.15.28:0/2900451682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55afb4f45560 0x55afb4f681a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 1 -- 172.21.15.28:0/2900451682 >> 172.21.15.28:0/2900451682 conn(0x55afb4e72120 msgr2=0x55afb4f4b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:59.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85af400700 0 client.25087 ms_handle_reset on v2:172.21.15.37:6836/1443905946 2024-06-06T08:43:59.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 1 -- 172.21.15.28:0/2900451682 shutdown_connections 2024-06-06T08:43:59.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 1 -- 172.21.15.28:0/2900451682 wait complete. 2024-06-06T08:43:59.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.768+0000 7f85dacdab80 20 client.25087 trim_cache size 0 max 16384 2024-06-06T08:43:59.774 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 1, 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24503, 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 218.16704139300001, 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 28, 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 92, 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 88, 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 273.59571210199999 2024-06-06T08:43:59.775 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:43:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.769+0000 7f85d0400700 1 -- 172.21.15.28:0/1089976867 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f85b00a2ca0 msgr2=0x7f85b00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.769+0000 7f85d0400700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f85b00a2ca0 0x7f85b00a5160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55afb4f42360 tx=0x7f85c0009040 comp rx=0 tx=0).stop 2024-06-06T08:43:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.769+0000 7f85d0400700 1 -- 172.21.15.28:0/1089976867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c8102740 msgr2=0x7f85c819ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:43:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.769+0000 7f85d0400700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c8102740 0x7f85c819ada0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00d980 tx=0x7f85bc00dc90 comp rx=0 tx=0).stop 2024-06-06T08:43:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.770+0000 7f85d0400700 1 -- 172.21.15.28:0/1089976867 shutdown_connections 2024-06-06T08:43:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.770+0000 7f85d0400700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f85b00a2ca0 0x7f85b00a5160 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.770+0000 7f85d0400700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85c8107840 0x7f85c819f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.770+0000 7f85d0400700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c8102740 0x7f85c819ada0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.770+0000 7f85d0400700 1 --2- 172.21.15.28:0/1089976867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85c81030f0 0x7f85c819b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:43:59.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.770+0000 7f85d0400700 1 -- 172.21.15.28:0/1089976867 >> 172.21.15.28:0/1089976867 conn(0x7f85c80795f0 msgr2=0x7f85c8101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:43:59.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.770+0000 7f85d0400700 1 -- 172.21.15.28:0/1089976867 shutdown_connections 2024-06-06T08:43:59.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:43:59.770+0000 7f85d0400700 1 -- 172.21.15.28:0/1089976867 wait complete. 2024-06-06T08:44:00.217 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:43:59 smithi028 ceph-mon[31564]: pgmap v451: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:00.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:43:59 smithi037 ceph-mon[36609]: pgmap v451: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:00.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:43:59 smithi059 ceph-mon[36684]: pgmap v451: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:00.735 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-06-06T08:44:01.203 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:44:02.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:01 smithi028 ceph-mon[31564]: pgmap v452: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:02.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:01 smithi037 ceph-mon[36609]: pgmap v452: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:02.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:01 smithi059 ceph-mon[36684]: pgmap v452: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:03.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.601+0000 7f3069a00700 1 -- 172.21.15.28:0/1756932976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3064105070 msgr2=0x7f3064111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:03.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.601+0000 7f3069a00700 1 --2- 172.21.15.28:0/1756932976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3064105070 0x7f3064111580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f305c00b0a0 tx=0x7f305c00b3b0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.601+0000 7f3069a00700 1 -- 172.21.15.28:0/1756932976 shutdown_connections 2024-06-06T08:44:03.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.601+0000 7f3069a00700 1 --2- 172.21.15.28:0/1756932976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3064105070 0x7f3064111580 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.601+0000 7f3069a00700 1 --2- 172.21.15.28:0/1756932976 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f306410a6b0 0x7f306410aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.601+0000 7f3069a00700 1 --2- 172.21.15.28:0/1756932976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30641046b0 0x7f3064104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.601+0000 7f3069a00700 1 -- 172.21.15.28:0/1756932976 >> 172.21.15.28:0/1756932976 conn(0x7f30641001a0 msgr2=0x7f30641025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:44:03.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.601+0000 7f3069a00700 1 -- 172.21.15.28:0/1756932976 shutdown_connections 2024-06-06T08:44:03.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.601+0000 7f3069a00700 1 -- 172.21.15.28:0/1756932976 wait complete. 2024-06-06T08:44:03.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.602+0000 7f3069a00700 1 Processor -- start 2024-06-06T08:44:03.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3069a00700 1 -- start start 2024-06-06T08:44:03.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3069a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30641046b0 0x7f306419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3069a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3064105070 0x7f306419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3069a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f306410a6b0 0x7f306419f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3069a00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f30641149e0 con 0x7f306410a6b0 2024-06-06T08:44:03.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3069a00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3064114860 con 0x7f30641046b0 2024-06-06T08:44:03.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3069a00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3064114b60 con 0x7f3064105070 2024-06-06T08:44:03.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3063400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f306410a6b0 0x7f306419f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3063400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f306410a6b0 0x7f306419f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51144/0 (socket says 172.21.15.28:51144) 2024-06-06T08:44:03.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3063400700 1 -- 172.21.15.28:0/249798156 learned_addr learned my addr 172.21.15.28:0/249798156 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:44:03.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3062000700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3064105070 0x7f306419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.603+0000 7f3062a00700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30641046b0 0x7f306419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.604+0000 7f3063400700 1 -- 172.21.15.28:0/249798156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3064105070 msgr2=0x7f306419b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:03.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.604+0000 7f3063400700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3064105070 0x7f306419b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.604+0000 7f3063400700 1 -- 172.21.15.28:0/249798156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30641046b0 msgr2=0x7f306419adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:03.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.604+0000 7f3063400700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30641046b0 0x7f306419adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.604+0000 7f3063400700 1 -- 172.21.15.28:0/249798156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306419fdc0 con 0x7f306410a6b0 2024-06-06T08:44:03.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.604+0000 7f3063400700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f306410a6b0 0x7f306419f680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f305c00b780 tx=0x7f305c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:44:03.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.605+0000 7f305b400700 1 -- 172.21.15.28:0/249798156 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c021070 con 0x7f306410a6b0 2024-06-06T08:44:03.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.605+0000 7f3069a00700 1 -- 172.21.15.28:0/249798156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30641a0050 con 0x7f306410a6b0 2024-06-06T08:44:03.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.605+0000 7f305b400700 1 -- 172.21.15.28:0/249798156 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f305c007b80 con 0x7f306410a6b0 2024-06-06T08:44:03.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.605+0000 7f305b400700 1 -- 172.21.15.28:0/249798156 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0052a0 con 0x7f306410a6b0 2024-06-06T08:44:03.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.605+0000 7f3069a00700 1 -- 172.21.15.28:0/249798156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30641a7930 con 0x7f306410a6b0 2024-06-06T08:44:03.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.608+0000 7f305b400700 1 -- 172.21.15.28:0/249798156 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f305c024070 con 0x7f306410a6b0 2024-06-06T08:44:03.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.609+0000 7f305b400700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f30480a2ca0 0x7f30480a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.609+0000 7f30742bfb80 1 Processor -- start 2024-06-06T08:44:03.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.610+0000 7f305b400700 1 -- 172.21.15.28:0/249798156 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f305c0cfff0 con 0x7f306410a6b0 2024-06-06T08:44:03.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.610+0000 7f30742bfb80 1 -- start start 2024-06-06T08:44:03.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.610+0000 7f3062a00700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f30480a2ca0 0x7f30480a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.610+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605afa8df0 0x55605b02c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.610+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b02c560 0x55605b02c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.610+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b0372b0 0x55605b0396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.610+0000 7f30742bfb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55605af3b9c0 con 0x55605afa8df0 2024-06-06T08:44:03.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.610+0000 7f30742bfb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55605af7eab0 con 0x55605b02c560 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.610+0000 7f30742bfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55605af398a0 con 0x55605b0372b0 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3062000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b02c560 0x55605b02c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3062a00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605afa8df0 0x55605b02c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3062000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b02c560 0x55605b02c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:52002/0 (socket says 172.21.15.28:52002) 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3062000700 1 -- 172.21.15.28:0/2487536631 learned_addr learned my addr 172.21.15.28:0/2487536631 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3063400700 1 --2- 172.21.15.28:0/2487536631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b0372b0 0x55605b0396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3062a00700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f30480a2ca0 0x7f30480a5160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3054009c30 tx=0x7f3054011440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3062000700 1 -- 172.21.15.28:0/2487536631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b0372b0 msgr2=0x55605b0396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3062000700 1 --2- 172.21.15.28:0/2487536631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b0372b0 0x55605b0396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3062000700 1 -- 172.21.15.28:0/2487536631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605afa8df0 msgr2=0x55605b02c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3062000700 1 --2- 172.21.15.28:0/2487536631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605afa8df0 0x55605b02c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3062000700 1 -- 172.21.15.28:0/2487536631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55605af26f40 con 0x55605b02c560 2024-06-06T08:44:03.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3063400700 1 --2- 172.21.15.28:0/2487536631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b0372b0 0x55605b0396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.611+0000 7f3062000700 1 --2- 172.21.15.28:0/2487536631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b02c560 0x55605b02c9e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3050009d20 tx=0x7f3050011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7deeaaea087530b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.612+0000 7f304fe00700 1 -- 172.21.15.28:0/2487536631 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305001e070 con 0x55605b02c560 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.612+0000 7f304fe00700 1 -- 172.21.15.28:0/2487536631 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3050019b10 con 0x55605b02c560 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.612+0000 7f304fe00700 1 -- 172.21.15.28:0/2487536631 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305000ec00 con 0x55605b02c560 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.613+0000 7f30742bfb80 1 -- 172.21.15.28:0/2487536631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b02c560 msgr2=0x55605b02c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.613+0000 7f30742bfb80 1 --2- 172.21.15.28:0/2487536631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b02c560 0x55605b02c9e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3050009d20 tx=0x7f3050011720 comp rx=0 tx=0).stop 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.613+0000 7f30742bfb80 1 -- 172.21.15.28:0/2487536631 shutdown_connections 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.613+0000 7f30742bfb80 1 --2- 172.21.15.28:0/2487536631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b0372b0 0x55605b0396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.613+0000 7f30742bfb80 1 --2- 172.21.15.28:0/2487536631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605afa8df0 0x55605b02c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.613+0000 7f30742bfb80 1 --2- 172.21.15.28:0/2487536631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b02c560 0x55605b02c9e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.613+0000 7f30742bfb80 1 -- 172.21.15.28:0/2487536631 >> 172.21.15.28:0/2487536631 conn(0x55605af59120 msgr2=0x55605b028460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.613+0000 7f30742bfb80 1 -- 172.21.15.28:0/2487536631 shutdown_connections 2024-06-06T08:44:03.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.613+0000 7f30742bfb80 1 -- 172.21.15.28:0/2487536631 wait complete. 2024-06-06T08:44:03.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.613+0000 7f30742bfb80 1 -- start start 2024-06-06T08:44:03.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.614+0000 7f30742bfb80 1 Processor -- start 2024-06-06T08:44:03.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.614+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605afa8df0 0x55605b0369e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.614+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b02c560 0x55605b033ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.614+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b0372b0 0x55605b034220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.614+0000 7f30742bfb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55605af1af10 con 0x55605b02c560 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.614+0000 7f30742bfb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55605af7aa70 con 0x55605b0372b0 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.614+0000 7f30742bfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55605b039f70 con 0x55605afa8df0 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.614+0000 7f30742bfb80 10 client.0 _ll_register_callbacks cb 0x55605af186d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3062000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b02c560 0x55605b033ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3062a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605afa8df0 0x55605b0369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3063400700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b0372b0 0x55605b034220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3062000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b02c560 0x55605b033ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51160/0 (socket says 172.21.15.28:51160) 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3062000700 1 -- 172.21.15.28:0/10888916 learned_addr learned my addr 172.21.15.28:0/10888916 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3062a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605afa8df0 0x55605b0369e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:36460/0 (socket says 172.21.15.28:36460) 2024-06-06T08:44:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3062a00700 1 -- 172.21.15.28:0/10888916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b0372b0 msgr2=0x55605b034220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:44:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3062a00700 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b0372b0 0x55605b034220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3062a00700 1 -- 172.21.15.28:0/10888916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b02c560 msgr2=0x55605b033ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:44:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3062a00700 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b02c560 0x55605b033ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3062a00700 1 -- 172.21.15.28:0/10888916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55605aecd880 con 0x55605afa8df0 2024-06-06T08:44:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3063400700 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b0372b0 0x55605b034220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:44:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.615+0000 7f3062a00700 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605afa8df0 0x55605b0369e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55605b029360 tx=0x7f30540047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc58cfa483efd04 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:44:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.616+0000 7f304cc00700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-06-06T08:44:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.616+0000 7f304cc00700 1 -- 172.21.15.28:0/10888916 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3054017040 con 0x55605afa8df0 2024-06-06T08:44:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.616+0000 7f304cc00700 1 -- 172.21.15.28:0/10888916 <== mon.1 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f305400f7d0 con 0x55605afa8df0 2024-06-06T08:44:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.616+0000 7f30742bfb80 1 -- 172.21.15.28:0/10888916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3050019b10 con 0x55605afa8df0 2024-06-06T08:44:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.616+0000 7f304cc00700 1 -- 172.21.15.28:0/10888916 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f305400fa10 con 0x55605afa8df0 2024-06-06T08:44:03.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.616+0000 7f30742bfb80 10 client.25099 fetch_fsmap learned FSMap version 28 2024-06-06T08:44:03.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.616+0000 7f30742bfb80 1 -- 172.21.15.28:0/10888916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55605b0446b0 con 0x55605afa8df0 2024-06-06T08:44:03.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.616+0000 7f304cc00700 1 -- 172.21.15.28:0/10888916 <== mon.1 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3050019b10 con 0x55605afa8df0 2024-06-06T08:44:03.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.617+0000 7f304cc00700 1 -- 172.21.15.28:0/10888916 <== mon.1 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3054005020 con 0x55605afa8df0 2024-06-06T08:44:03.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.617+0000 7f30742bfb80 10 client.25099 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:44:03.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.617+0000 7f30742bfb80 10 client.25099 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-06T08:44:03.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.617+0000 7f30742bfb80 20 client.25099 populate_metadata read hostname 'smithi028' 2024-06-06T08:44:03.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.617+0000 7f30742bfb80 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x55605b046d30 0x55605b0481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.617+0000 7f30742bfb80 4 client.25099 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T08:44:03.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.617+0000 7f30742bfb80 1 -- 172.21.15.28:0/10888916 --> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55605af8bfb0 con 0x55605b046d30 2024-06-06T08:44:03.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.617+0000 7f3062000700 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x55605b046d30 0x55605b0481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.618+0000 7f3062000700 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x55605b046d30 0x55605b0481a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=704e9dcd317b3fb3 server_cookie=7a2025d740a9fc4f in_seq=0 out_seq=0 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.618+0000 7f304cc00700 10 client.25099 ms_handle_connect on v2:172.21.15.37:6838/527311102 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f304cc00700 1 -- 172.21.15.28:0/10888916 <== mds.0 v2:172.21.15.37:6838/527311102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55605af8bfb0 con 0x55605b046d30 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f304cc00700 10 client.25099 handle_command_reply: tid=0 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f30742bfb80 1 client.25099 shutdown 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f30742bfb80 1 -- 172.21.15.28:0/10888916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605afa8df0 msgr2=0x55605b0369e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f30742bfb80 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605afa8df0 0x55605b0369e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55605b029360 tx=0x7f30540047c0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f30742bfb80 1 -- 172.21.15.28:0/10888916 shutdown_connections 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f30742bfb80 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605b0372b0 0x55605b034220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f30742bfb80 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x55605b046d30 0x55605b0481a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f30742bfb80 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605afa8df0 0x55605b0369e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f30742bfb80 1 --2- 172.21.15.28:0/10888916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b02c560 0x55605b033ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f304cc00700 0 client.25099 ms_handle_reset on v2:172.21.15.37:6838/527311102 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f30742bfb80 1 -- 172.21.15.28:0/10888916 >> 172.21.15.28:0/10888916 conn(0x55605af59120 msgr2=0x55605b0276f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f30742bfb80 1 -- 172.21.15.28:0/10888916 shutdown_connections 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.619+0000 7f30742bfb80 1 -- 172.21.15.28:0/10888916 wait complete. 2024-06-06T08:44:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.620+0000 7f30742bfb80 20 client.25099 trim_cache size 0 max 16384 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.643+0000 7f30742bfb80 1 Processor -- start 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.643+0000 7f30742bfb80 1 -- start start 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 0x55605b032e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b02c560 0x55605b0386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b036520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f30742bfb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55605b0464e0 con 0x55605b0372b0 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f30742bfb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55605b046bb0 con 0x55605afa8df0 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f30742bfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55605b047280 con 0x55605b02c560 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f3063400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b036520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f3062a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 0x55605b032e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f3062a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 0x55605b032e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:52026/0 (socket says 172.21.15.28:52026) 2024-06-06T08:44:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f3062a00700 1 -- 172.21.15.28:0/2944895884 learned_addr learned my addr 172.21.15.28:0/2944895884 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:44:03.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f3063400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b036520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51168/0 (socket says 172.21.15.28:51168) 2024-06-06T08:44:03.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.644+0000 7f3062000700 1 --2- 172.21.15.28:0/2944895884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b02c560 0x55605b0386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.645+0000 7f3063400700 1 -- 172.21.15.28:0/2944895884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b02c560 msgr2=0x55605b0386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:44:03.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.645+0000 7f3063400700 1 --2- 172.21.15.28:0/2944895884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b02c560 0x55605b0386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.645+0000 7f3063400700 1 -- 172.21.15.28:0/2944895884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 msgr2=0x55605b032e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:44:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.645+0000 7f3063400700 1 --2- 172.21.15.28:0/2944895884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 0x55605b032e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.645+0000 7f3063400700 1 -- 172.21.15.28:0/2944895884 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55605b02d210 con 0x55605b0372b0 2024-06-06T08:44:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.645+0000 7f3062a00700 1 --2- 172.21.15.28:0/2944895884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 0x55605b032e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:44:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.645+0000 7f3062000700 1 --2- 172.21.15.28:0/2944895884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b02c560 0x55605b0386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:44:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.645+0000 7f3063400700 1 --2- 172.21.15.28:0/2944895884 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b036520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f305c0062a0 tx=0x7f305c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613f5c8488aa37cc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:44:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.645+0000 7f304f400700 1 -- 172.21.15.28:0/2944895884 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c02b040 con 0x55605b0372b0 2024-06-06T08:44:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.646+0000 7f304f400700 1 -- 172.21.15.28:0/2944895884 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f305c007d30 con 0x55605b0372b0 2024-06-06T08:44:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.646+0000 7f304f400700 1 -- 172.21.15.28:0/2944895884 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0074e0 con 0x55605b0372b0 2024-06-06T08:44:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.646+0000 7f30742bfb80 1 -- 172.21.15.28:0/2944895884 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 msgr2=0x55605b036520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.646+0000 7f30742bfb80 1 --2- 172.21.15.28:0/2944895884 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b036520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f305c0062a0 tx=0x7f305c009040 comp rx=0 tx=0).stop 2024-06-06T08:44:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.647+0000 7f30742bfb80 1 -- 172.21.15.28:0/2944895884 shutdown_connections 2024-06-06T08:44:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.647+0000 7f30742bfb80 1 --2- 172.21.15.28:0/2944895884 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b036520 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.647+0000 7f30742bfb80 1 --2- 172.21.15.28:0/2944895884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 0x55605b032e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.647+0000 7f30742bfb80 1 --2- 172.21.15.28:0/2944895884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b02c560 0x55605b0386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.647+0000 7f30742bfb80 1 -- 172.21.15.28:0/2944895884 >> 172.21.15.28:0/2944895884 conn(0x55605af59120 msgr2=0x55605b02e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:44:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.647+0000 7f30742bfb80 1 -- 172.21.15.28:0/2944895884 shutdown_connections 2024-06-06T08:44:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.647+0000 7f30742bfb80 1 -- 172.21.15.28:0/2944895884 wait complete. 2024-06-06T08:44:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.647+0000 7f30742bfb80 1 -- start start 2024-06-06T08:44:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.648+0000 7f30742bfb80 1 Processor -- start 2024-06-06T08:44:03.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.648+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 0x55605b051620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.648+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b02c560 0x55605b051b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.648+0000 7f30742bfb80 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b04a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.648+0000 7f30742bfb80 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55605b048020 con 0x55605b0372b0 2024-06-06T08:44:03.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.648+0000 7f30742bfb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55605b047950 con 0x55605afa8df0 2024-06-06T08:44:03.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.648+0000 7f30742bfb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55605b0486f0 con 0x55605b02c560 2024-06-06T08:44:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.648+0000 7f30742bfb80 10 client.0 _ll_register_callbacks cb 0x55605af186d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T08:44:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3063400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b04a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3062a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 0x55605b051620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3063400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b04a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51172/0 (socket says 172.21.15.28:51172) 2024-06-06T08:44:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3063400700 1 -- 172.21.15.28:0/1609402753 learned_addr learned my addr 172.21.15.28:0/1609402753 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:44:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3062000700 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b02c560 0x55605b051b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3063400700 1 -- 172.21.15.28:0/1609402753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b02c560 msgr2=0x55605b051b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:44:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3063400700 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b02c560 0x55605b051b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3063400700 1 -- 172.21.15.28:0/1609402753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 msgr2=0x55605b051620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T08:44:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3063400700 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 0x55605b051620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3063400700 1 -- 172.21.15.28:0/1609402753 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55605b052270 con 0x55605b0372b0 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3062a00700 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 0x55605b051620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f3063400700 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b04a5c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f305c0991f0 tx=0x7f305c09c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e622092bf42132 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.649+0000 7f304cc00700 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f304cc00700 1 -- 172.21.15.28:0/1609402753 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c02b070 con 0x55605b0372b0 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f304cc00700 1 -- 172.21.15.28:0/1609402753 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f305c09ab20 con 0x55605b0372b0 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f30742bfb80 1 -- 172.21.15.28:0/1609402753 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f305c007d30 con 0x55605b0372b0 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f304cc00700 1 -- 172.21.15.28:0/1609402753 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f305c0b5030 con 0x55605b0372b0 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f30742bfb80 10 client.14976 fetch_fsmap learned FSMap version 28 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f30742bfb80 1 -- 172.21.15.28:0/1609402753 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55605b0b2c20 con 0x55605b0372b0 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f304cc00700 1 -- 172.21.15.28:0/1609402753 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f305c007d30 con 0x55605b0372b0 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f304cc00700 1 -- 172.21.15.28:0/1609402753 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f305c011070 con 0x55605b0372b0 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f30742bfb80 10 client.14976 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f30742bfb80 10 client.14976 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-06T08:44:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f30742bfb80 20 client.14976 populate_metadata read hostname 'smithi028' 2024-06-06T08:44:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f30742bfb80 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x55605b0b7600 0x55605b0b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f30742bfb80 4 client.14976 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T08:44:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.650+0000 7f30742bfb80 1 -- 172.21.15.28:0/1609402753 --> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] -- command(tid 0: {"prefix": "status"}) -- 0x55605af86530 con 0x55605b0b7600 2024-06-06T08:44:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.651+0000 7f3062a00700 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x55605b0b7600 0x55605b0b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:03.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.651+0000 7f3062a00700 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x55605b0b7600 0x55605b0b6310 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de0a6181fee929d3 server_cookie=49cbe90c2d33d3c3 in_seq=0 out_seq=0 2024-06-06T08:44:03.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.651+0000 7f304cc00700 10 client.14976 ms_handle_connect on v2:172.21.15.37:6838/527311102 2024-06-06T08:44:03.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.651+0000 7f304cc00700 1 -- 172.21.15.28:0/1609402753 <== mds.0 v2:172.21.15.37:6838/527311102 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55605af86530 con 0x55605b0b7600 2024-06-06T08:44:03.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.651+0000 7f304cc00700 10 client.14976 handle_command_reply: tid=0 2024-06-06T08:44:03.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.651+0000 7f30742bfb80 1 client.14976 shutdown 2024-06-06T08:44:03.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f30742bfb80 1 -- 172.21.15.28:0/1609402753 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 msgr2=0x55605b04a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:03.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f30742bfb80 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b04a5c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f305c0991f0 tx=0x7f305c09c8a0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f30742bfb80 1 -- 172.21.15.28:0/1609402753 shutdown_connections 2024-06-06T08:44:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f30742bfb80 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55605b0372b0 0x55605b04a5c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f30742bfb80 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55605afa8df0 0x55605b051620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f30742bfb80 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.37:6838/527311102,v1:172.21.15.37:6839/527311102] conn(0x55605b0b7600 0x55605b0b6310 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f30742bfb80 1 --2- 172.21.15.28:0/1609402753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55605b02c560 0x55605b051b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f30742bfb80 1 -- 172.21.15.28:0/1609402753 >> 172.21.15.28:0/1609402753 conn(0x55605af59120 msgr2=0x55605b032ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:44:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f304cc00700 0 client.14976 ms_handle_reset on v2:172.21.15.37:6838/527311102 2024-06-06T08:44:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f30742bfb80 1 -- 172.21.15.28:0/1609402753 shutdown_connections 2024-06-06T08:44:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f30742bfb80 1 -- 172.21.15.28:0/1609402753 wait complete. 2024-06-06T08:44:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.652+0000 7f30742bfb80 20 client.14976 trim_cache size 0 max 16384 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "e34a6934-23de-11ef-bc9b-c7b262605968", 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 24542, 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 238.141646245, 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 28, 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 92, 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 88, 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 262.207410165 2024-06-06T08:44:03.655 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:44:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.653+0000 7f3069a00700 1 -- 172.21.15.28:0/249798156 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f30480a2ca0 msgr2=0x7f30480a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.653+0000 7f3069a00700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f30480a2ca0 0x7f30480a5160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3054009c30 tx=0x7f3054011440 comp rx=0 tx=0).stop 2024-06-06T08:44:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.653+0000 7f3069a00700 1 -- 172.21.15.28:0/249798156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f306410a6b0 msgr2=0x7f306419f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.653+0000 7f3069a00700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f306410a6b0 0x7f306419f680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f305c00b780 tx=0x7f305c004d00 comp rx=0 tx=0).stop 2024-06-06T08:44:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.653+0000 7f3069a00700 1 -- 172.21.15.28:0/249798156 shutdown_connections 2024-06-06T08:44:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.653+0000 7f3069a00700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f30480a2ca0 0x7f30480a5160 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.653+0000 7f3069a00700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f306410a6b0 0x7f306419f680 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.653+0000 7f3069a00700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30641046b0 0x7f306419adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.653+0000 7f3069a00700 1 --2- 172.21.15.28:0/249798156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3064105070 0x7f306419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.653+0000 7f3069a00700 1 -- 172.21.15.28:0/249798156 >> 172.21.15.28:0/249798156 conn(0x7f30641001a0 msgr2=0x7f3064100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:44:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.653+0000 7f3069a00700 1 -- 172.21.15.28:0/249798156 shutdown_connections 2024-06-06T08:44:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:03.654+0000 7f3069a00700 1 -- 172.21.15.28:0/249798156 wait complete. 2024-06-06T08:44:04.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:03 smithi028 ceph-mon[31564]: pgmap v453: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:04.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:03 smithi037 ceph-mon[36609]: pgmap v453: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:04.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:03 smithi059 ceph-mon[36684]: pgmap v453: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:04.495 INFO:teuthology.run_tasks:Running task sequential... 2024-06-06T08:44:04.507 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-06T08:44:04.507 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-06T08:44:04.507 INFO:teuthology.task.print:Enabling mgr modules 2024-06-06T08:44:04.508 INFO:teuthology.run_tasks:Running task kclient... 2024-06-06T08:44:04.533 INFO:tasks.kclient:Mounting kernel clients... 2024-06-06T08:44:04.533 INFO:tasks.kclient:config is {'client.0': {}} 2024-06-06T08:44:04.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:44:04.533 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-06-06T08:44:04.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:44:04.597 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link delete ceph-brx 2024-06-06T08:44:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:Cannot find device "ceph-brx" 2024-06-06T08:44:04.700 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:44:04.701 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-06-06T08:44:04.701 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-06T08:44:04.701 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-06T08:44:04.701 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-06T08:44:05.166 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:44:06.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:05 smithi028 ceph-mon[31564]: pgmap v454: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:06.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:05 smithi037 ceph-mon[36609]: pgmap v454: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:06.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:05 smithi059 ceph-mon[36684]: pgmap v454: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:07.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.451+0000 7fcdafe00700 1 -- 172.21.15.28:0/437359314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcdb010d8a0 msgr2=0x7fcdb010dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:07.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.451+0000 7fcdafe00700 1 --2- 172.21.15.28:0/437359314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcdb010d8a0 0x7fcdb010dc80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009990 tx=0x7fcda0009ca0 comp rx=0 tx=0).stop 2024-06-06T08:44:07.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.451+0000 7fcdafe00700 1 -- 172.21.15.28:0/437359314 shutdown_connections 2024-06-06T08:44:07.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.452+0000 7fcdafe00700 1 --2- 172.21.15.28:0/437359314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdb0109390 0x7fcdb0115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:07.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.452+0000 7fcdafe00700 1 --2- 172.21.15.28:0/437359314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcdb010d8a0 0x7fcdb010dc80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:07.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.452+0000 7fcdafe00700 1 --2- 172.21.15.28:0/437359314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb01089d0 0x7fcdb0108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:07.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.452+0000 7fcdafe00700 1 -- 172.21.15.28:0/437359314 >> 172.21.15.28:0/437359314 conn(0x7fcdb0078220 msgr2=0x7fcdb01072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:44:07.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.452+0000 7fcdafe00700 1 -- 172.21.15.28:0/437359314 shutdown_connections 2024-06-06T08:44:07.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.452+0000 7fcdafe00700 1 -- 172.21.15.28:0/437359314 wait complete. 2024-06-06T08:44:07.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.453+0000 7fcdafe00700 1 Processor -- start 2024-06-06T08:44:07.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.453+0000 7fcdafe00700 1 -- start start 2024-06-06T08:44:07.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.453+0000 7fcdafe00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdb01089d0 0x7fcdb019f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:07.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.453+0000 7fcdafe00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcdb0109390 0x7fcdb019f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:07.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.453+0000 7fcdafe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb010d8a0 0x7fcdb01a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:07.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.453+0000 7fcdafe00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb0118d10 con 0x7fcdb0109390 2024-06-06T08:44:07.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.453+0000 7fcdafe00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb0118b90 con 0x7fcdb01089d0 2024-06-06T08:44:07.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.453+0000 7fcdafe00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb0118e90 con 0x7fcdb010d8a0 2024-06-06T08:44:07.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcda6000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcdb0109390 0x7fcdb019f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:07.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcdaea00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdb01089d0 0x7fcdb019f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:07.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcda6000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcdb0109390 0x7fcdb019f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51032/0 (socket says 172.21.15.28:51032) 2024-06-06T08:44:07.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcda6000700 1 -- 172.21.15.28:0/1844168910 learned_addr learned my addr 172.21.15.28:0/1844168910 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:44:07.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcdaf400700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb010d8a0 0x7fcdb01a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:07.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcda6000700 1 -- 172.21.15.28:0/1844168910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb010d8a0 msgr2=0x7fcdb01a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:07.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcda6000700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb010d8a0 0x7fcdb01a3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:07.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcda6000700 1 -- 172.21.15.28:0/1844168910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdb01089d0 msgr2=0x7fcdb019f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:07.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcda6000700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdb01089d0 0x7fcdb019f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:07.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcda6000700 1 -- 172.21.15.28:0/1844168910 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb01a41b0 con 0x7fcdb0109390 2024-06-06T08:44:07.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcdaea00700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdb01089d0 0x7fcdb019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:44:07.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.454+0000 7fcda6000700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcdb0109390 0x7fcdb019f6e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800eb30 tx=0x7fcd9800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:44:07.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.455+0000 7fcda7e00700 1 -- 172.21.15.28:0/1844168910 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800cbd0 con 0x7fcdb0109390 2024-06-06T08:44:07.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.455+0000 7fcda7e00700 1 -- 172.21.15.28:0/1844168910 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd98004500 con 0x7fcdb0109390 2024-06-06T08:44:07.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.455+0000 7fcda7e00700 1 -- 172.21.15.28:0/1844168910 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98010430 con 0x7fcdb0109390 2024-06-06T08:44:07.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.455+0000 7fcdafe00700 1 -- 172.21.15.28:0/1844168910 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb01a44a0 con 0x7fcdb0109390 2024-06-06T08:44:07.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.455+0000 7fcdafe00700 1 -- 172.21.15.28:0/1844168910 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb01abd20 con 0x7fcdb0109390 2024-06-06T08:44:07.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.456+0000 7fcdafe00700 1 -- 172.21.15.28:0/1844168910 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb0069180 con 0x7fcdb0109390 2024-06-06T08:44:07.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.458+0000 7fcda7e00700 1 -- 172.21.15.28:0/1844168910 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcd98003f00 con 0x7fcdb0109390 2024-06-06T08:44:07.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.459+0000 7fcda7e00700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd940a2ca0 0x7fcd940a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:07.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.460+0000 7fcda7e00700 1 -- 172.21.15.28:0/1844168910 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fcd980cf2b0 con 0x7fcdb0109390 2024-06-06T08:44:07.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.460+0000 7fcdaea00700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd940a2ca0 0x7fcd940a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:07.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.460+0000 7fcdaea00700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd940a2ca0 0x7fcd940a5160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006010 tx=0x7fcda000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:44:07.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.464+0000 7fcda7e00700 1 -- 172.21.15.28:0/1844168910 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcd9809c130 con 0x7fcdb0109390 2024-06-06T08:44:07.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.746+0000 7fcdafe00700 1 -- 172.21.15.28:0/1844168910 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcdb01a0500 con 0x7fcdb0109390 2024-06-06T08:44:07.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.747+0000 7fcda7e00700 1 -- 172.21.15.28:0/1844168910 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7fcd9809ba30 con 0x7fcdb0109390 2024-06-06T08:44:07.746 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-06T08:44:07.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 -- 172.21.15.28:0/1844168910 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd940a2ca0 msgr2=0x7fcd940a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:07.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd940a2ca0 0x7fcd940a5160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006010 tx=0x7fcda000b260 comp rx=0 tx=0).stop 2024-06-06T08:44:07.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 -- 172.21.15.28:0/1844168910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcdb0109390 msgr2=0x7fcdb019f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:07.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcdb0109390 0x7fcdb019f6e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800eb30 tx=0x7fcd9800ee40 comp rx=0 tx=0).stop 2024-06-06T08:44:07.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 -- 172.21.15.28:0/1844168910 shutdown_connections 2024-06-06T08:44:07.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fcd940a2ca0 0x7fcd940a5160 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:07.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb010d8a0 0x7fcdb01a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:07.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdb01089d0 0x7fcdb019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:07.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 --2- 172.21.15.28:0/1844168910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcdb0109390 0x7fcdb019f6e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:07.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 -- 172.21.15.28:0/1844168910 >> 172.21.15.28:0/1844168910 conn(0x7fcdb0078220 msgr2=0x7fcdb00787e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:44:07.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 -- 172.21.15.28:0/1844168910 shutdown_connections 2024-06-06T08:44:07.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:07.750+0000 7fcdafe00700 1 -- 172.21.15.28:0/1844168910 wait complete. 2024-06-06T08:44:08.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:07 smithi028 ceph-mon[31564]: pgmap v455: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:08.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:07 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1844168910' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T08:44:08.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:07 smithi037 ceph-mon[36609]: pgmap v455: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:08.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:07 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1844168910' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T08:44:08.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:07 smithi059 ceph-mon[36684]: pgmap v455: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:08.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:07 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1844168910' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T08:44:08.667 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-06T08:44:08.667 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-06T08:44:08.667 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-06-06T08:44:08.667 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-06T08:44:08.667 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-06T08:44:08.667 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-06T08:44:08.667 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-06T08:44:08.667 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-06T08:44:08.667 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-06T08:44:08.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:44:08.668 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-06-06T08:44:08.726 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-06T08:44:08.726 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-06T08:44:08.726 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-06-06T08:44:08.726 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-06-06T08:44:08.727 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-06-06T08:44:08.727 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-06-06T08:44:08.727 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T08:44:08.727 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-06-06T08:44:08.727 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-06-06T08:44:08.727 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T08:44:08.727 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-06-06T08:44:08.727 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-06-06T08:44:08.727 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-06T08:44:08.727 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-06-06T08:44:08.728 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-06-06T08:44:08.728 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-06-06T08:44:08.728 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 41823sec preferred_lft 41823sec 2024-06-06T08:44:08.728 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link noprefixroute 2024-06-06T08:44:08.728 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-06-06T08:44:08.728 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T08:44:08.728 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-06-06T08:44:08.728 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-06-06T08:44:08.729 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-06T08:44:08.729 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T08:44:08.729 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-06-06T08:44:08.730 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add name ceph-brx type bridge 2024-06-06T08:44:08.730 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr flush dev ceph-brx 2024-06-06T08:44:08.730 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set ceph-brx up 2024-06-06T08:44:08.730 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-06T08:44:08.730 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-06-06T08:44:08.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T08:44:09.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T08:44:09.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:44:09.237 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-06T08:44:09.307 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-06-06T08:44:09.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:44:09.311 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-06-06T08:44:09.365 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-06-06T08:44:09.365 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-06T08:44:09.365 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-06T08:44:09.365 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-06T08:44:09.365 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-06T08:44:09.365 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T08:44:09.366 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-06-06T08:44:09.366 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-06T08:44:09.366 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-06T08:44:09.366 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-06T08:44:09.366 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-06-06T08:44:09.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T08:44:10.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:09 smithi028 ceph-mon[31564]: pgmap v456: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:10.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T08:44:10.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:44:10.148 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-06-06T08:44:10.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:44:10.203 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list-id 2024-06-06T08:44:10.264 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T08:44:10.264 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-06-06T08:44:10.264 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-06T08:44:10.264 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-06T08:44:10.264 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-06-06T08:44:10.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:09 smithi037 ceph-mon[36609]: pgmap v456: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:10.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:09 smithi059 ceph-mon[36684]: pgmap v456: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:10.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T08:44:10.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T08:44:10.470 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-06T08:44:10.470 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T08:44:10.470 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-06-06T08:44:10.470 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-06T08:44:10.470 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-06T08:44:10.470 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-06T08:44:10.470 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-06T08:44:10.470 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-06T08:44:10.470 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-06-06T08:44:10.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T08:44:10.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T08:44:10.786 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T08:44:10.786 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-06-06T08:44:10.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2024-06-06T08:44:10.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set dev brx.0 master ceph-brx 2024-06-06T08:44:10.787 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-06-06T08:44:10.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T08:44:10.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T08:44:11.003 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-06T08:44:11.003 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-06T08:44:11.053 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-06T08:44:11.053 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-06T08:44:11.053 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-06T08:44:11.104 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-06-06T08:44:11.104 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-06-06T08:44:11.105 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/fe5454d2-b0dd-4679-8348-9b7b133b61ff 2024-06-06T08:44:11.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:44:11.105 DEBUG:teuthology.orchestra.run.smithi028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/fe5454d2-b0dd-4679-8348-9b7b133b61ff /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-06-06T08:44:11.250 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-06-06T08:44:11.250 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2024-06-06T08:44:11.250 INFO:teuthology.orchestra.run.smithi028.stdout:invalid new device string format 2024-06-06T08:44:11.962 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-06-06T08:44:11.962 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2024-06-06T08:44:11.962 INFO:teuthology.orchestra.run.smithi028.stdout:invalid new device string format 2024-06-06T08:44:11.962 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: resolved to: "172.21.15.28:6789,172.21.15.37:6789,172.21.15.59:6789" 2024-06-06T08:44:11.962 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.28:6789,172.21.15.37:6789,172.21.15.59:6789:/volumes/qa/sv_1/fe5454d2-b0dd-4679-8348-9b7b133b61ff 2024-06-06T08:44:11.962 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,key=0,fsid=e34a6934-23de-11ef-bc9b-c7b262605968" will pass to kernel 2024-06-06T08:44:11.968 INFO:teuthology.orchestra.run.smithi028.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-06-06T08:44:11.969 INFO:teuthology.orchestra.run.smithi028.stdout: You just mounted a file system that supports labels which does not 2024-06-06T08:44:11.969 INFO:teuthology.orchestra.run.smithi028.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-06T08:44:11.969 INFO:teuthology.orchestra.run.smithi028.stdout: applications will generate AVC messages and not be allowed access to 2024-06-06T08:44:11.969 INFO:teuthology.orchestra.run.smithi028.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-06T08:44:11.974 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-06T08:44:11.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:44:11.974 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-06T08:44:12.070 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-06T08:44:12.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-06T08:44:12.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T08:44:12.203 INFO:teuthology.orchestra.run.smithi028.stdout:client14985 2024-06-06T08:44:12.203 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:44:12.204 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-06T08:44:12.260 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-06T08:44:12.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:11 smithi028 ceph-mon[31564]: pgmap v457: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:12.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:11 smithi037 ceph-mon[36609]: pgmap v457: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:12.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:11 smithi059 ceph-mon[36684]: pgmap v457: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:12.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-06T08:44:12.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T08:44:12.386 INFO:teuthology.orchestra.run.smithi028.stdout:client14985 2024-06-06T08:44:12.386 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-06T08:44:12.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-06T08:44:12.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T08:44:12.555 INFO:teuthology.orchestra.run.smithi028.stdout:client14985 2024-06-06T08:44:12.556 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e34a6934-23de-11ef-bc9b-c7b262605968.client14985/status') 2024-06-06T08:44:12.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T08:44:12.695 INFO:teuthology.orchestra.run.smithi028.stdout:instance: client.14985 (3)192.168.0.1:0/3211431378 2024-06-06T08:44:12.695 INFO:teuthology.orchestra.run.smithi028.stdout:blocklisted: false 2024-06-06T08:44:12.695 INFO:teuthology.orchestra.run.smithi028.stderr:0+1 records in 2024-06-06T08:44:12.695 INFO:teuthology.orchestra.run.smithi028.stderr:0+1 records out 2024-06-06T08:44:12.695 INFO:teuthology.orchestra.run.smithi028.stderr:70 bytes copied, 8.6134e-05 s, 813 kB/s 2024-06-06T08:44:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T08:44:12.709 INFO:teuthology.run_tasks:Running task exec... 2024-06-06T08:44:12.723 INFO:teuthology.task.exec:Executing custom commands... 2024-06-06T08:44:12.723 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi028.front.sepia.ceph.com 2024-06-06T08:44:12.724 DEBUG:teuthology.orchestra.run.smithi028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-06-06T08:44:12.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.936+0000 7fdc87e00640 1 -- 172.21.15.28:0/1268352930 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc88107590 msgr2=0x7fdc88109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:12.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.936+0000 7fdc87e00640 1 --2- 172.21.15.28:0/1268352930 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc88107590 0x7fdc88109980 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009ca0 tx=0x7fdc8002a8b0 comp rx=0 tx=0).stop 2024-06-06T08:44:12.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.936+0000 7fdc87e00640 1 -- 172.21.15.28:0/1268352930 shutdown_connections 2024-06-06T08:44:12.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.936+0000 7fdc87e00640 1 --2- 172.21.15.28:0/1268352930 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc88107590 0x7fdc88109980 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:12.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.936+0000 7fdc87e00640 1 --2- 172.21.15.28:0/1268352930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88104c60 0x7fdc88107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:12.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.936+0000 7fdc87e00640 1 --2- 172.21.15.28:0/1268352930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc88102330 0x7fdc88104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:12.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.936+0000 7fdc87e00640 1 -- 172.21.15.28:0/1268352930 >> 172.21.15.28:0/1268352930 conn(0x7fdc880fbc80 msgr2=0x7fdc880fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:44:12.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.936+0000 7fdc87e00640 1 -- 172.21.15.28:0/1268352930 shutdown_connections 2024-06-06T08:44:12.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.936+0000 7fdc87e00640 1 -- 172.21.15.28:0/1268352930 wait complete. 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.937+0000 7fdc87e00640 1 Processor -- start 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.937+0000 7fdc87e00640 1 -- start start 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.937+0000 7fdc87e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc88102330 0x7fdc88199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc87e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88104c60 0x7fdc8819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc87e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc88107590 0x7fdc881a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc87e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8810d520 con 0x7fdc88102330 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc87e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8810d3a0 con 0x7fdc88104c60 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc87e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8810d6a0 con 0x7fdc88107590 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc86a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc88102330 0x7fdc88199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc86000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88104c60 0x7fdc8819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc86000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88104c60 0x7fdc8819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:54180/0 (socket says 172.21.15.28:54180) 2024-06-06T08:44:12.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc86000640 1 -- 172.21.15.28:0/3905099764 learned_addr learned my addr 172.21.15.28:0/3905099764 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc86a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc88102330 0x7fdc88199d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51060/0 (socket says 172.21.15.28:51060) 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc87400640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc88107590 0x7fdc881a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc86000640 1 -- 172.21.15.28:0/3905099764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc88107590 msgr2=0x7fdc881a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc86000640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc88107590 0x7fdc881a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc86000640 1 -- 172.21.15.28:0/3905099764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc88102330 msgr2=0x7fdc88199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc86000640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc88102330 0x7fdc88199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc86000640 1 -- 172.21.15.28:0/3905099764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc881a1940 con 0x7fdc88104c60 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.938+0000 7fdc86a00640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc88102330 0x7fdc88199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.939+0000 7fdc86000640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88104c60 0x7fdc8819a270 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400e9c0 tx=0x7fdc7400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.939+0000 7fdc8ca00640 1 -- 172.21.15.28:0/3905099764 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400cd80 con 0x7fdc88104c60 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.939+0000 7fdc87e00640 1 -- 172.21.15.28:0/3905099764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc881a1c30 con 0x7fdc88104c60 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.939+0000 7fdc8ca00640 1 -- 172.21.15.28:0/3905099764 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc74005500 con 0x7fdc88104c60 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.939+0000 7fdc8ca00640 1 -- 172.21.15.28:0/3905099764 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74010690 con 0x7fdc88104c60 2024-06-06T08:44:12.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.939+0000 7fdc87e00640 1 -- 172.21.15.28:0/3905099764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc881a2180 con 0x7fdc88104c60 2024-06-06T08:44:12.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.941+0000 7fdc87e00640 1 -- 172.21.15.28:0/3905099764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc88109080 con 0x7fdc88104c60 2024-06-06T08:44:12.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.942+0000 7fdc8ca00640 1 -- 172.21.15.28:0/3905099764 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdc740046c0 con 0x7fdc88104c60 2024-06-06T08:44:12.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.943+0000 7fdc8ca00640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdc6c0a2b70 0x7fdc6c0a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:44:12.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.944+0000 7fdc8ca00640 1 -- 172.21.15.28:0/3905099764 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fdc740cf550 con 0x7fdc88104c60 2024-06-06T08:44:12.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.944+0000 7fdc86a00640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdc6c0a2b70 0x7fdc6c0a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:44:12.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.945+0000 7fdc86a00640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdc6c0a2b70 0x7fdc6c0a5030 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdc8819b200 tx=0x7fdc78005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:44:12.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:12.948+0000 7fdc8ca00640 1 -- 172.21.15.28:0/3905099764 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdc7409c3d0 con 0x7fdc88104c60 2024-06-06T08:44:13.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.199+0000 7fdc87e00640 1 -- 172.21.15.28:0/3905099764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fdc880625a0 con 0x7fdc88104c60 2024-06-06T08:44:13.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.936+0000 7fdc8ca00640 1 -- 172.21.15.28:0/3905099764 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7fdc7409bcd0 con 0x7fdc88104c60 2024-06-06T08:44:13.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.941+0000 7fdc87e00640 1 -- 172.21.15.28:0/3905099764 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdc6c0a2b70 msgr2=0x7fdc6c0a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:13.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.941+0000 7fdc87e00640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdc6c0a2b70 0x7fdc6c0a5030 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdc8819b200 tx=0x7fdc78005f90 comp rx=0 tx=0).stop 2024-06-06T08:44:13.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.941+0000 7fdc87e00640 1 -- 172.21.15.28:0/3905099764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88104c60 msgr2=0x7fdc8819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:44:13.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.941+0000 7fdc87e00640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88104c60 0x7fdc8819a270 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400e9c0 tx=0x7fdc7400ee80 comp rx=0 tx=0).stop 2024-06-06T08:44:13.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.941+0000 7fdc87e00640 1 -- 172.21.15.28:0/3905099764 shutdown_connections 2024-06-06T08:44:13.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.941+0000 7fdc87e00640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc88107590 0x7fdc881a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:13.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.941+0000 7fdc87e00640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fdc6c0a2b70 0x7fdc6c0a5030 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:13.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.941+0000 7fdc87e00640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88104c60 0x7fdc8819a270 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:13.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.941+0000 7fdc87e00640 1 --2- 172.21.15.28:0/3905099764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdc88102330 0x7fdc88199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:44:13.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.941+0000 7fdc87e00640 1 -- 172.21.15.28:0/3905099764 >> 172.21.15.28:0/3905099764 conn(0x7fdc880fbc80 msgr2=0x7fdc88101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:44:13.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.941+0000 7fdc87e00640 1 -- 172.21.15.28:0/3905099764 shutdown_connections 2024-06-06T08:44:13.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:44:13.942+0000 7fdc87e00640 1 -- 172.21.15.28:0/3905099764 wait complete. 2024-06-06T08:44:13.965 INFO:teuthology.run_tasks:Running task check-counter... 2024-06-06T08:44:13.976 INFO:teuthology.run_tasks:Running task workunit... 2024-06-06T08:44:13.988 INFO:tasks.workunit:Pulling workunits from ref 3d746ca5346f34eef7e826a1eb71e59e02b682ae 2024-06-06T08:44:13.989 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-06T08:44:13.989 INFO:tasks.workunit:timeout=3h 2024-06-06T08:44:13.989 INFO:tasks.workunit:cleanup=True 2024-06-06T08:44:13.989 DEBUG:teuthology.orchestra.run.smithi028:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-06T08:44:14.042 INFO:teuthology.orchestra.run.smithi028.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-06-06T08:44:14.042 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-06-06T08:44:14.042 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-06-06T08:44:14.043 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T08:44:14.043 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-06-06T08:44:14.043 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-06-06 08:40:45.094035615 +0000 2024-06-06T08:44:14.043 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-06-06 08:40:45.094035615 +0000 2024-06-06T08:44:14.043 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-06-06 08:44:12.059835770 +0000 2024-06-06T08:44:14.043 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-06-06 08:40:45.094035615 +0000 2024-06-06T08:44:14.043 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-06-06T08:44:14.043 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-06-06T08:44:14.134 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3d746ca5346f34eef7e826a1eb71e59e02b682ae 2024-06-06T08:44:14.191 INFO:tasks.workunit.client.0.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-06T08:44:14.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:13 smithi028 ceph-mon[31564]: pgmap v458: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:14.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:13 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/3905099764' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-06T08:44:14.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:13 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-06T08:44:14.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:13 smithi037 ceph-mon[36609]: pgmap v458: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:14.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:13 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/3905099764' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-06T08:44:14.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:13 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-06T08:44:14.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:13 smithi059 ceph-mon[36684]: pgmap v458: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:14.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:13 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/3905099764' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-06T08:44:14.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:13 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-06T08:44:15.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:14 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-06T08:44:15.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:14 smithi028 ceph-mon[31564]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:44:15.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:14 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-06T08:44:15.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:14 smithi037 ceph-mon[36609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:44:15.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:14 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-06T08:44:15.350 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:14 smithi059 ceph-mon[36684]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:44:16.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:15 smithi028 ceph-mon[31564]: pgmap v459: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-06T08:44:16.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:15 smithi037 ceph-mon[36609]: pgmap v459: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-06T08:44:16.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:15 smithi059 ceph-mon[36684]: pgmap v459: 97 pgs: 97 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-06T08:44:18.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:17 smithi028 ceph-mon[31564]: pgmap v460: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-06-06T08:44:18.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:17 smithi037 ceph-mon[36609]: pgmap v460: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-06-06T08:44:18.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:17 smithi059 ceph-mon[36684]: pgmap v460: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-06-06T08:44:20.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:19 smithi028 ceph-mon[31564]: pgmap v461: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-06-06T08:44:20.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:19 smithi037 ceph-mon[36609]: pgmap v461: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-06-06T08:44:20.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:19 smithi059 ceph-mon[36684]: pgmap v461: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-06-06T08:44:22.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:21 smithi028 ceph-mon[31564]: pgmap v462: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-06-06T08:44:22.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:21 smithi037 ceph-mon[36609]: pgmap v462: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-06-06T08:44:22.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:21 smithi059 ceph-mon[36684]: pgmap v462: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-06-06T08:44:24.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:23 smithi028 ceph-mon[31564]: pgmap v463: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-06-06T08:44:24.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:23 smithi037 ceph-mon[36609]: pgmap v463: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-06-06T08:44:24.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:23 smithi059 ceph-mon[36684]: pgmap v463: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-06-06T08:44:26.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:25 smithi028 ceph-mon[31564]: pgmap v464: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-06-06T08:44:26.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:25 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:44:26.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:25 smithi037 ceph-mon[36609]: pgmap v464: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-06-06T08:44:26.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:25 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:44:26.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:25 smithi059 ceph-mon[36684]: pgmap v464: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-06-06T08:44:26.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:25 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:44:27.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:44:27.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:44:27.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:26 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:44:27.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:44:27.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:44:27.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:26 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:44:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:44:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:44:27.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:26 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:44:28.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:27 smithi028 ceph-mon[31564]: pgmap v465: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-06-06T08:44:28.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:27 smithi037 ceph-mon[36609]: pgmap v465: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-06-06T08:44:28.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:27 smithi059 ceph-mon[36684]: pgmap v465: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-06-06T08:44:30.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:30 smithi028 ceph-mon[31564]: pgmap v466: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-06T08:44:30.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:30 smithi037 ceph-mon[36609]: pgmap v466: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-06T08:44:30.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:30 smithi059 ceph-mon[36684]: pgmap v466: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-06T08:44:32.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:32 smithi028 ceph-mon[31564]: pgmap v467: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-06-06T08:44:32.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:32 smithi037 ceph-mon[36609]: pgmap v467: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-06-06T08:44:32.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:32 smithi059 ceph-mon[36684]: pgmap v467: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-06-06T08:44:33.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:33 smithi028 ceph-mon[31564]: pgmap v468: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:33.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:33 smithi037 ceph-mon[36609]: pgmap v468: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:33.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:33 smithi059 ceph-mon[36684]: pgmap v468: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:35.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:35 smithi028 ceph-mon[31564]: pgmap v469: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:35.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:35 smithi037 ceph-mon[36609]: pgmap v469: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:35.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:35 smithi059 ceph-mon[36684]: pgmap v469: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:37.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:37 smithi028 ceph-mon[31564]: pgmap v470: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:37.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:37 smithi037 ceph-mon[36609]: pgmap v470: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:37.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:37 smithi059 ceph-mon[36684]: pgmap v470: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:39.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:39 smithi028 ceph-mon[31564]: pgmap v471: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:39 smithi037 ceph-mon[36609]: pgmap v471: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:39.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:39 smithi059 ceph-mon[36684]: pgmap v471: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:41.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:41 smithi028 ceph-mon[31564]: pgmap v472: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:41.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:41 smithi037 ceph-mon[36609]: pgmap v472: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:41.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:41 smithi059 ceph-mon[36684]: pgmap v472: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:43.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:43 smithi028 ceph-mon[31564]: pgmap v473: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:43.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:43 smithi037 ceph-mon[36609]: pgmap v473: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:43.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:43 smithi059 ceph-mon[36684]: pgmap v473: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:45.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:45 smithi028 ceph-mon[31564]: pgmap v474: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:45.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:45 smithi037 ceph-mon[36609]: pgmap v474: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:45.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:45 smithi059 ceph-mon[36684]: pgmap v474: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:47.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:47 smithi028 ceph-mon[31564]: pgmap v475: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:47.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:47 smithi037 ceph-mon[36609]: pgmap v475: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:47.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:47 smithi059 ceph-mon[36684]: pgmap v475: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:44:49.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:49 smithi028 ceph-mon[31564]: pgmap v476: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:49.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:49 smithi037 ceph-mon[36609]: pgmap v476: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:49.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:49 smithi059 ceph-mon[36684]: pgmap v476: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:44:51.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:51 smithi028 ceph-mon[31564]: pgmap v477: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:44:51.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:51 smithi037 ceph-mon[36609]: pgmap v477: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:44:51.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:51 smithi059 ceph-mon[36684]: pgmap v477: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:44:53.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:53 smithi028 ceph-mon[31564]: pgmap v478: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:53.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:53 smithi037 ceph-mon[36609]: pgmap v478: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:53.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:53 smithi059 ceph-mon[36684]: pgmap v478: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:44:55.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:55 smithi028 ceph-mon[31564]: pgmap v479: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-06T08:44:55.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:55 smithi037 ceph-mon[36609]: pgmap v479: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-06T08:44:55.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:55 smithi059 ceph-mon[36684]: pgmap v479: 97 pgs: 97 active+clean; 654 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-06T08:44:57.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:57 smithi028 ceph-mon[31564]: pgmap v480: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-06-06T08:44:57.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:57 smithi037 ceph-mon[36609]: pgmap v480: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-06-06T08:44:57.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:57 smithi059 ceph-mon[36684]: pgmap v480: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-06-06T08:44:59.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:44:59 smithi028 ceph-mon[31564]: pgmap v481: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-06T08:44:59.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:44:59 smithi037 ceph-mon[36609]: pgmap v481: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-06T08:44:59.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:44:59 smithi059 ceph-mon[36684]: pgmap v481: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-06T08:45:01.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:01 smithi028 ceph-mon[31564]: pgmap v482: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-06-06T08:45:01.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:01 smithi037 ceph-mon[36609]: pgmap v482: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-06-06T08:45:01.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:01 smithi059 ceph-mon[36684]: pgmap v482: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-06-06T08:45:03.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:03 smithi028 ceph-mon[31564]: pgmap v483: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-06T08:45:03.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:03 smithi037 ceph-mon[36609]: pgmap v483: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-06T08:45:03.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:03 smithi059 ceph-mon[36684]: pgmap v483: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-06T08:45:05.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:05 smithi028 ceph-mon[31564]: pgmap v484: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-06T08:45:05.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:05 smithi037 ceph-mon[36609]: pgmap v484: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-06T08:45:05.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:05 smithi059 ceph-mon[36684]: pgmap v484: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-06T08:45:07.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:07 smithi028 ceph-mon[31564]: pgmap v485: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-06-06T08:45:07.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:07 smithi037 ceph-mon[36609]: pgmap v485: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-06-06T08:45:07.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:07 smithi059 ceph-mon[36684]: pgmap v485: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-06-06T08:45:09.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:09 smithi028 ceph-mon[31564]: pgmap v486: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:09.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:09 smithi037 ceph-mon[36609]: pgmap v486: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:09.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:09 smithi059 ceph-mon[36684]: pgmap v486: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:11.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:11 smithi028 ceph-mon[31564]: pgmap v487: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:45:11.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:11 smithi037 ceph-mon[36609]: pgmap v487: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:45:11.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:11 smithi059 ceph-mon[36684]: pgmap v487: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:45:13.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:13 smithi028 ceph-mon[31564]: pgmap v488: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:13.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:13 smithi037 ceph-mon[36609]: pgmap v488: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:13.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:13 smithi059 ceph-mon[36684]: pgmap v488: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:15.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:15 smithi028 ceph-mon[31564]: pgmap v489: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:45:15.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:15 smithi037 ceph-mon[36609]: pgmap v489: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:45:15.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:15 smithi059 ceph-mon[36684]: pgmap v489: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:45:17.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:17 smithi028 ceph-mon[31564]: pgmap v490: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:45:17.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:17 smithi037 ceph-mon[36609]: pgmap v490: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:45:17.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:17 smithi059 ceph-mon[36684]: pgmap v490: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:45:19.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:19 smithi028 ceph-mon[31564]: pgmap v491: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:19.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:19 smithi037 ceph-mon[36609]: pgmap v491: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:19.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:19 smithi059 ceph-mon[36684]: pgmap v491: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:21.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:21 smithi028 ceph-mon[31564]: pgmap v492: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:45:21.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:21 smithi037 ceph-mon[36609]: pgmap v492: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:45:21.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:21 smithi059 ceph-mon[36684]: pgmap v492: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:45:23.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:23 smithi028 ceph-mon[31564]: pgmap v493: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:23.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:23 smithi037 ceph-mon[36609]: pgmap v493: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:23.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:23 smithi059 ceph-mon[36684]: pgmap v493: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:25.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:25 smithi028 ceph-mon[31564]: pgmap v494: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:45:25.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:25 smithi037 ceph-mon[36609]: pgmap v494: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:45:25.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:25 smithi059 ceph-mon[36684]: pgmap v494: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:45:27.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:27 smithi028 ceph-mon[31564]: pgmap v495: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:45:27.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:27 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:45:27.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:27 smithi037 ceph-mon[36609]: pgmap v495: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:45:27.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:27 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:45:27.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:27 smithi059 ceph-mon[36684]: pgmap v495: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:45:27.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:27 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:45:28.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:45:28.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:45:28.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:45:28.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:28 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:45:28.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:28 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:45:28.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:28 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:45:28.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:28 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:45:28.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:28 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:45:28.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:28 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:45:29.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:29 smithi028 ceph-mon[31564]: pgmap v496: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:29.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:29 smithi037 ceph-mon[36609]: pgmap v496: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:29.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:29 smithi059 ceph-mon[36684]: pgmap v496: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:31.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:31 smithi028 ceph-mon[31564]: pgmap v497: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:45:31.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:31 smithi037 ceph-mon[36609]: pgmap v497: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:45:31.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:31 smithi059 ceph-mon[36684]: pgmap v497: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-06-06T08:45:33.793 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:33 smithi028 ceph-mon[31564]: pgmap v498: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:33.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:33 smithi037 ceph-mon[36609]: pgmap v498: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:33.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:33 smithi059 ceph-mon[36684]: pgmap v498: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:33.936 INFO:tasks.workunit.client.0.smithi028.stderr:Updating files: 59% (7520/12568) Updating files: 60% (7541/12568) Updating files: 61% (7667/12568) Updating files: 62% (7793/12568) Updating files: 63% (7918/12568) Updating files: 64% (8044/12568) Updating files: 65% (8170/12568) Updating files: 66% (8295/12568) Updating files: 67% (8421/12568) Updating files: 68% (8547/12568) Updating files: 69% (8672/12568) Updating files: 70% (8798/12568) Updating files: 71% (8924/12568) Updating files: 72% (9049/12568) Updating files: 73% (9175/12568) Updating files: 74% (9301/12568) Updating files: 75% (9426/12568) Updating files: 76% (9552/12568) Updating files: 77% (9678/12568) Updating files: 78% (9804/12568) Updating files: 79% (9929/12568) Updating files: 80% (10055/12568) Updating files: 81% (10181/12568) Updating files: 82% (10306/12568) Updating files: 83% (10432/12568) Updating files: 84% (10558/12568) Updating files: 85% (10683/12568) Updating files: 86% (10809/12568) Updating files: 87% (10935/12568) Updating files: 88% (11060/12568) Updating files: 89% (11186/12568) Updating files: 90% (11312/12568) Updating files: 91% (11437/12568) Updating files: 92% (11563/12568) Updating files: 93% (11689/12568) Updating files: 94% (11814/12568) Updating files: 94% (11919/12568) Updating files: 95% (11940/12568) Updating files: 96% (12066/12568) Updating files: 97% (12191/12568) Updating files: 98% (12317/12568) Updating files: 99% (12443/12568) Updating files: 100% (12568/12568) Updating files: 100% (12568/12568), done. 2024-06-06T08:45:34.869 INFO:tasks.workunit.client.0.smithi028.stderr:Note: switching to '3d746ca5346f34eef7e826a1eb71e59e02b682ae'. 2024-06-06T08:45:34.869 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:45:34.869 INFO:tasks.workunit.client.0.smithi028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:state without impacting any branches by switching back to a branch. 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr: git switch -c 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:Or undo this operation with: 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr: git switch - 2024-06-06T08:45:34.870 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:45:34.871 INFO:tasks.workunit.client.0.smithi028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-06T08:45:34.871 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:45:34.871 INFO:tasks.workunit.client.0.smithi028.stderr:HEAD is now at 3d746ca5346 Merge pull request #57870 from zdover23/wip-doc-2024-06-05-backport-57867-to-squid 2024-06-06T08:45:34.881 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-06T08:45:34.947 INFO:tasks.workunit.client.0.smithi028.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-06T08:45:34.955 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-06T08:45:34.956 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-06T08:45:35.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:35 smithi028 ceph-mon[31564]: pgmap v499: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:45:35.807 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-06T08:45:35.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:35 smithi037 ceph-mon[36609]: pgmap v499: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:45:35.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:35 smithi059 ceph-mon[36684]: pgmap v499: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-06T08:45:35.924 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-06T08:45:36.016 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-06T08:45:36.022 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-06T08:45:36.022 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-06T08:45:36.109 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-06T08:45:36.119 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:45:36.119 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-06T08:45:36.170 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-06-06T08:45:36.172 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-06-06T08:45:36.173 DEBUG:teuthology.orchestra.run.smithi028:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d746ca5346f34eef7e826a1eb71e59e02b682ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-06-06T08:45:36.248 INFO:tasks.workunit.client.0.smithi028.stderr:+ set -e 2024-06-06T08:45:36.248 INFO:tasks.workunit.client.0.smithi028.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-06-06T08:45:36.254 INFO:tasks.workunit.client.0.smithi028.stderr:Cloning into 'xfstests-dev'... 2024-06-06T08:45:37.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:37 smithi028 ceph-mon[31564]: pgmap v500: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:45:37.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:37 smithi037 ceph-mon[36609]: pgmap v500: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:45:37.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:37 smithi059 ceph-mon[36684]: pgmap v500: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-06T08:45:39.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:39 smithi028 ceph-mon[31564]: pgmap v501: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:39 smithi037 ceph-mon[36609]: pgmap v501: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:39.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:39 smithi059 ceph-mon[36684]: pgmap v501: 97 pgs: 97 active+clean; 659 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-06T08:45:41.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:41 smithi028 ceph-mon[31564]: pgmap v502: 97 pgs: 97 active+clean; 945 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-06-06T08:45:41.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:41 smithi037 ceph-mon[36609]: pgmap v502: 97 pgs: 97 active+clean; 945 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-06-06T08:45:41.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:41 smithi059 ceph-mon[36684]: pgmap v502: 97 pgs: 97 active+clean; 945 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-06-06T08:45:43.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:43 smithi028 ceph-mon[31564]: pgmap v503: 97 pgs: 97 active+clean; 14 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.1 MiB/s wr, 13 op/s 2024-06-06T08:45:43.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:43 smithi037 ceph-mon[36609]: pgmap v503: 97 pgs: 97 active+clean; 14 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.1 MiB/s wr, 13 op/s 2024-06-06T08:45:43.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:43 smithi059 ceph-mon[36684]: pgmap v503: 97 pgs: 97 active+clean; 14 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.1 MiB/s wr, 13 op/s 2024-06-06T08:45:45.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:45 smithi037 ceph-mon[36609]: pgmap v504: 97 pgs: 97 active+clean; 14 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2024-06-06T08:45:45.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:45 smithi059 ceph-mon[36684]: pgmap v504: 97 pgs: 97 active+clean; 14 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2024-06-06T08:45:46.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:45 smithi028 ceph-mon[31564]: pgmap v504: 97 pgs: 97 active+clean; 14 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2024-06-06T08:45:47.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:47 smithi037 ceph-mon[36609]: pgmap v505: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-06T08:45:47.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:47 smithi059 ceph-mon[36684]: pgmap v505: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-06T08:45:48.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:47 smithi028 ceph-mon[31564]: pgmap v505: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-06T08:45:49.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:49 smithi037 ceph-mon[36609]: pgmap v506: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-06T08:45:49.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:49 smithi059 ceph-mon[36684]: pgmap v506: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-06T08:45:50.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:49 smithi028 ceph-mon[31564]: pgmap v506: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-06T08:45:51.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:51 smithi037 ceph-mon[36609]: pgmap v507: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 20 op/s 2024-06-06T08:45:51.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:51 smithi059 ceph-mon[36684]: pgmap v507: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 20 op/s 2024-06-06T08:45:52.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:51 smithi028 ceph-mon[31564]: pgmap v507: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 20 op/s 2024-06-06T08:45:53.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:53 smithi037 ceph-mon[36609]: pgmap v508: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-06T08:45:53.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:53 smithi059 ceph-mon[36684]: pgmap v508: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-06T08:45:54.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:53 smithi028 ceph-mon[31564]: pgmap v508: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-06T08:45:55.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:55 smithi059 ceph-mon[36684]: pgmap v509: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 127 KiB/s wr, 16 op/s 2024-06-06T08:45:56.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:55 smithi028 ceph-mon[31564]: pgmap v509: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 127 KiB/s wr, 16 op/s 2024-06-06T08:45:56.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:55 smithi037 ceph-mon[36609]: pgmap v509: 97 pgs: 97 active+clean; 15 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 127 KiB/s wr, 16 op/s 2024-06-06T08:45:57.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:57 smithi059 ceph-mon[36684]: pgmap v510: 97 pgs: 97 active+clean; 18 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 377 KiB/s wr, 24 op/s 2024-06-06T08:45:58.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:57 smithi028 ceph-mon[31564]: pgmap v510: 97 pgs: 97 active+clean; 18 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 377 KiB/s wr, 24 op/s 2024-06-06T08:45:58.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:57 smithi037 ceph-mon[36609]: pgmap v510: 97 pgs: 97 active+clean; 18 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 377 KiB/s wr, 24 op/s 2024-06-06T08:45:59.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:45:59 smithi059 ceph-mon[36684]: pgmap v511: 97 pgs: 97 active+clean; 20 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 542 KiB/s wr, 31 op/s 2024-06-06T08:46:00.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:45:59 smithi028 ceph-mon[31564]: pgmap v511: 97 pgs: 97 active+clean; 20 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 542 KiB/s wr, 31 op/s 2024-06-06T08:46:00.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:45:59 smithi037 ceph-mon[36609]: pgmap v511: 97 pgs: 97 active+clean; 20 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 542 KiB/s wr, 31 op/s 2024-06-06T08:46:01.845 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:01 smithi028 ceph-mon[31564]: pgmap v512: 97 pgs: 97 active+clean; 20 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 556 KiB/s wr, 34 op/s 2024-06-06T08:46:01.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:01 smithi059 ceph-mon[36684]: pgmap v512: 97 pgs: 97 active+clean; 20 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 556 KiB/s wr, 34 op/s 2024-06-06T08:46:02.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:01 smithi037 ceph-mon[36609]: pgmap v512: 97 pgs: 97 active+clean; 20 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 556 KiB/s wr, 34 op/s 2024-06-06T08:46:02.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:02 smithi059 ceph-mon[36684]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:03.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:02 smithi028 ceph-mon[31564]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:03.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:02 smithi037 ceph-mon[36609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:04.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:03 smithi028 ceph-mon[31564]: pgmap v513: 97 pgs: 97 active+clean; 21 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 600 KiB/s wr, 33 op/s 2024-06-06T08:46:04.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:03 smithi037 ceph-mon[36609]: pgmap v513: 97 pgs: 97 active+clean; 21 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 600 KiB/s wr, 33 op/s 2024-06-06T08:46:04.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:03 smithi059 ceph-mon[36684]: pgmap v513: 97 pgs: 97 active+clean; 21 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 600 KiB/s wr, 33 op/s 2024-06-06T08:46:04.972 INFO:tasks.workunit.client.0.smithi028.stderr:Updating files: 7% (321/4296) Updating files: 8% (344/4296) Updating files: 9% (387/4296) Updating files: 10% (430/4296) Updating files: 11% (473/4296) Updating files: 11% (490/4296) Updating files: 12% (516/4296) Updating files: 13% (559/4296) Updating files: 14% (602/4296) Updating files: 15% (645/4296) Updating files: 16% (688/4296) Updating files: 17% (731/4296) Updating files: 18% (774/4296) Updating files: 19% (817/4296) Updating files: 20% (860/4296) Updating files: 20% (901/4296) Updating files: 21% (903/4296) Updating files: 22% (946/4296) Updating files: 23% (989/4296) Updating files: 24% (1032/4296) Updating files: 25% (1074/4296) Updating files: 26% (1117/4296) Updating files: 27% (1160/4296) Updating files: 28% (1203/4296) Updating files: 29% (1246/4296) Updating files: 29% (1288/4296) Updating files: 30% (1289/4296) Updating files: 31% (1332/4296) Updating files: 32% (1375/4296) Updating files: 33% (1418/4296) Updating files: 34% (1461/4296) Updating files: 35% (1504/4296) Updating files: 36% (1547/4296) Updating files: 37% (1590/4296) Updating files: 37% (1595/4296) Updating files: 38% (1633/4296) Updating files: 39% (1676/4296) Updating files: 40% (1719/4296) Updating files: 41% (1762/4296) Updating files: 42% (1805/4296) Updating files: 43% (1848/4296) Updating files: 44% (1891/4296) Updating files: 45% (1934/4296) Updating files: 46% (1977/4296) Updating files: 47% (2020/4296) Updating files: 48% (2063/4296) Updating files: 48% (2088/4296) Updating files: 49% (2106/4296) Updating files: 50% (2148/4296) Updating files: 51% (2191/4296) Updating files: 52% (2234/4296) Updating files: 53% (2277/4296) Updating files: 54% (2320/4296) Updating files: 55% (2363/4296) Updating files: 56% (2406/4296) Updating files: 57% (2449/4296) Updating files: 58% (2492/4296) Updating files: 58% (2504/4296) Updating files: 59% (2535/4296) Updating files: 60% (2578/4296) Updating files: 61% (2621/4296) Updating files: 62% (2664/4296) Updating files: 63% (2707/4296) Updating files: 64% (2750/4296) Updating files: 65% (2793/4296) Updating files: 65% (2794/4296) Updating files: 66% (2836/4296) Updating files: 67% (2879/4296) Updating files: 68% (2922/4296) Updating files: 69% (2965/4296) Updating files: 70% (3008/4296) Updating files: 70% (3025/4296) Updating files: 71% (3051/4296) Updating files: 72% (3094/4296) Updating files: 73% (3137/4296) Updating files: 74% (3180/4296) Updating files: 75% (3222/4296) Updating files: 75% (3230/4296) Updating files: 76% (3265/4296) Updating files: 77% (3308/4296) Updating files: 78% (3351/4296) Updating files: 79% (3394/4296) Updating files: 80% (3437/4296) Updating files: 81% (3480/4296) Updating files: 82% (3523/4296) Updating files: 83% (3566/4296) Updating files: 84% (3609/4296) Updating files: 85% (3652/4296) Updating files: 86% (3695/4296) Updating files: 86% (3711/4296) Updating files: 87% (3738/4296) Updating files: 88% (3781/4296) Updating files: 89% (3824/4296) Updating files: 90% (3867/4296) Updating files: 91% (3910/4296) Updating files: 92% (3953/4296) Updating files: 93% (3996/4296) Updating files: 94% (4039/4296) Updating files: 94% (4043/4296) Updating files: 95% (4082/4296) Updating files: 96% (4125/4296) Updating files: 97% (4168/4296) Updating files: 98% (4211/4296) Updating files: 99% (4254/4296) Updating files: 100% (4296/4296) Updating files: 100% (4296/4296), done. 2024-06-06T08:46:04.993 INFO:tasks.workunit.client.0.smithi028.stderr:+ cd xfstests-dev 2024-06-06T08:46:04.993 INFO:tasks.workunit.client.0.smithi028.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2024-06-06T08:46:06.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:05 smithi028 ceph-mon[31564]: pgmap v514: 97 pgs: 97 active+clean; 22 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 754 KiB/s wr, 66 op/s 2024-06-06T08:46:06.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:05 smithi037 ceph-mon[36609]: pgmap v514: 97 pgs: 97 active+clean; 22 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 754 KiB/s wr, 66 op/s 2024-06-06T08:46:06.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:05 smithi059 ceph-mon[36684]: pgmap v514: 97 pgs: 97 active+clean; 22 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 754 KiB/s wr, 66 op/s 2024-06-06T08:46:08.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:07 smithi028 ceph-mon[31564]: pgmap v515: 97 pgs: 97 active+clean; 23 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 870 KiB/s wr, 95 op/s 2024-06-06T08:46:08.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:07 smithi028 ceph-mon[31564]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:08.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:07 smithi037 ceph-mon[36609]: pgmap v515: 97 pgs: 97 active+clean; 23 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 870 KiB/s wr, 95 op/s 2024-06-06T08:46:08.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:07 smithi037 ceph-mon[36609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:08.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:07 smithi059 ceph-mon[36684]: pgmap v515: 97 pgs: 97 active+clean; 23 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 870 KiB/s wr, 95 op/s 2024-06-06T08:46:08.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:07 smithi059 ceph-mon[36684]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:10.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:09 smithi028 ceph-mon[31564]: pgmap v516: 97 pgs: 97 active+clean; 31 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 1.4 MiB/s wr, 174 op/s 2024-06-06T08:46:10.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:09 smithi037 ceph-mon[36609]: pgmap v516: 97 pgs: 97 active+clean; 31 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 1.4 MiB/s wr, 174 op/s 2024-06-06T08:46:10.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:09 smithi059 ceph-mon[36684]: pgmap v516: 97 pgs: 97 active+clean; 31 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 1.4 MiB/s wr, 174 op/s 2024-06-06T08:46:12.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:11 smithi028 ceph-mon[31564]: pgmap v517: 97 pgs: 97 active+clean; 32 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 1.3 MiB/s wr, 242 op/s 2024-06-06T08:46:12.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:11 smithi037 ceph-mon[36609]: pgmap v517: 97 pgs: 97 active+clean; 32 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 1.3 MiB/s wr, 242 op/s 2024-06-06T08:46:12.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:11 smithi059 ceph-mon[36684]: pgmap v517: 97 pgs: 97 active+clean; 32 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 1.3 MiB/s wr, 242 op/s 2024-06-06T08:46:13.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:12 smithi028 ceph-mon[31564]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:13.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:12 smithi037 ceph-mon[36609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:13.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:12 smithi059 ceph-mon[36684]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:13.942 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:13 smithi028 ceph-mon[31564]: pgmap v518: 97 pgs: 97 active+clean; 35 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 1.6 MiB/s wr, 353 op/s 2024-06-06T08:46:14.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:13 smithi037 ceph-mon[36609]: pgmap v518: 97 pgs: 97 active+clean; 35 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 1.6 MiB/s wr, 353 op/s 2024-06-06T08:46:14.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:13 smithi059 ceph-mon[36684]: pgmap v518: 97 pgs: 97 active+clean; 35 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 1.6 MiB/s wr, 353 op/s 2024-06-06T08:46:16.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:15 smithi028 ceph-mon[31564]: pgmap v519: 97 pgs: 97 active+clean; 38 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 369 op/s 2024-06-06T08:46:16.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:15 smithi037 ceph-mon[36609]: pgmap v519: 97 pgs: 97 active+clean; 38 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 369 op/s 2024-06-06T08:46:16.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:15 smithi059 ceph-mon[36684]: pgmap v519: 97 pgs: 97 active+clean; 38 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 369 op/s 2024-06-06T08:46:18.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:17 smithi028 ceph-mon[31564]: pgmap v520: 97 pgs: 97 active+clean; 42 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 352 op/s 2024-06-06T08:46:18.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:17 smithi028 ceph-mon[31564]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:18.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:17 smithi037 ceph-mon[36609]: pgmap v520: 97 pgs: 97 active+clean; 42 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 352 op/s 2024-06-06T08:46:18.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:17 smithi037 ceph-mon[36609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:18.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:17 smithi059 ceph-mon[36684]: pgmap v520: 97 pgs: 97 active+clean; 42 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 352 op/s 2024-06-06T08:46:18.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:17 smithi059 ceph-mon[36684]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:46:20.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:19 smithi028 ceph-mon[31564]: pgmap v521: 97 pgs: 97 active+clean; 44 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 350 op/s 2024-06-06T08:46:20.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:19 smithi037 ceph-mon[36609]: pgmap v521: 97 pgs: 97 active+clean; 44 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 350 op/s 2024-06-06T08:46:20.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:19 smithi059 ceph-mon[36684]: pgmap v521: 97 pgs: 97 active+clean; 44 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 350 op/s 2024-06-06T08:46:20.536 INFO:tasks.workunit.client.0.smithi028.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr:state without impacting any branches by switching back to a branch. 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr: git switch -c 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr:Or undo this operation with: 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:46:20.537 INFO:tasks.workunit.client.0.smithi028.stderr: git switch - 2024-06-06T08:46:20.538 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:46:20.538 INFO:tasks.workunit.client.0.smithi028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-06T08:46:20.538 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-06-06T08:46:20.538 INFO:tasks.workunit.client.0.smithi028.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2024-06-06T08:46:20.550 INFO:tasks.workunit.client.0.smithi028.stderr:+ make -j4 2024-06-06T08:46:20.577 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize -cfi 2024-06-06T08:46:21.340 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: putting auxiliary files in '.'. 2024-06-06T08:46:21.340 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: copying file './config.guess' 2024-06-06T08:46:21.357 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: copying file './config.sub' 2024-06-06T08:46:21.376 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: copying file './install-sh' 2024-06-06T08:46:21.394 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: copying file './ltmain.sh' 2024-06-06T08:46:21.487 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-06-06T08:46:21.488 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-06-06T08:46:21.507 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-06-06T08:46:21.528 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-06-06T08:46:21.549 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-06-06T08:46:21.569 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-06-06T08:46:21.595 INFO:tasks.workunit.client.0.smithi028.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-06-06T08:46:21.599 INFO:tasks.workunit.client.0.smithi028.stdout:cp include/install-sh . 2024-06-06T08:46:21.613 INFO:tasks.workunit.client.0.smithi028.stdout:aclocal -I m4 2024-06-06T08:46:22.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:21 smithi028 ceph-mon[31564]: pgmap v522: 97 pgs: 97 active+clean; 45 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 295 op/s 2024-06-06T08:46:22.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:21 smithi037 ceph-mon[36609]: pgmap v522: 97 pgs: 97 active+clean; 45 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 295 op/s 2024-06-06T08:46:22.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:21 smithi059 ceph-mon[36684]: pgmap v522: 97 pgs: 97 active+clean; 45 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 295 op/s 2024-06-06T08:46:23.136 INFO:tasks.workunit.client.0.smithi028.stdout:autoheader 2024-06-06T08:46:23.603 INFO:tasks.workunit.client.0.smithi028.stdout:autoconf 2024-06-06T08:46:23.917 INFO:tasks.workunit.client.0.smithi028.stdout:./configure \ 2024-06-06T08:46:23.917 INFO:tasks.workunit.client.0.smithi028.stdout: --libexecdir=/usr/lib \ 2024-06-06T08:46:23.917 INFO:tasks.workunit.client.0.smithi028.stdout: --exec_prefix=/var/lib 2024-06-06T08:46:24.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:23 smithi028 ceph-mon[31564]: pgmap v523: 97 pgs: 97 active+clean; 46 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 255 op/s 2024-06-06T08:46:24.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:23 smithi037 ceph-mon[36609]: pgmap v523: 97 pgs: 97 active+clean; 46 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 255 op/s 2024-06-06T08:46:24.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:23 smithi059 ceph-mon[36684]: pgmap v523: 97 pgs: 97 active+clean; 46 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 255 op/s 2024-06-06T08:46:24.402 INFO:tasks.workunit.client.0.smithi028.stdout:checking build system type... x86_64-pc-linux-gnu 2024-06-06T08:46:24.402 INFO:tasks.workunit.client.0.smithi028.stdout:checking host system type... x86_64-pc-linux-gnu 2024-06-06T08:46:24.407 INFO:tasks.workunit.client.0.smithi028.stdout:checking how to print strings... printf 2024-06-06T08:46:24.407 INFO:tasks.workunit.client.0.smithi028.stdout:checking for gcc... gcc 2024-06-06T08:46:24.603 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether the C compiler works... yes 2024-06-06T08:46:24.603 INFO:tasks.workunit.client.0.smithi028.stdout:checking for C compiler default output file name... a.out 2024-06-06T08:46:24.687 INFO:tasks.workunit.client.0.smithi028.stdout:checking for suffix of executables... 2024-06-06T08:46:24.780 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether we are cross compiling... no 2024-06-06T08:46:24.860 INFO:tasks.workunit.client.0.smithi028.stdout:checking for suffix of object files... o 2024-06-06T08:46:24.920 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether we are using the GNU C compiler... yes 2024-06-06T08:46:24.981 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether gcc accepts -g... yes 2024-06-06T08:46:25.121 INFO:tasks.workunit.client.0.smithi028.stdout:checking for gcc option to accept ISO C89... none needed 2024-06-06T08:46:25.136 INFO:tasks.workunit.client.0.smithi028.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-06-06T08:46:25.149 INFO:tasks.workunit.client.0.smithi028.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-06-06T08:46:25.155 INFO:tasks.workunit.client.0.smithi028.stdout:checking for egrep... /usr/bin/grep -E 2024-06-06T08:46:25.162 INFO:tasks.workunit.client.0.smithi028.stdout:checking for fgrep... /usr/bin/grep -F 2024-06-06T08:46:25.177 INFO:tasks.workunit.client.0.smithi028.stdout:checking for ld used by gcc... /usr/bin/ld 2024-06-06T08:46:25.184 INFO:tasks.workunit.client.0.smithi028.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-06-06T08:46:25.203 INFO:tasks.workunit.client.0.smithi028.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-06-06T08:46:26.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:25 smithi028 ceph-mon[31564]: pgmap v524: 97 pgs: 97 active+clean; 49 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 157 op/s 2024-06-06T08:46:26.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:25 smithi037 ceph-mon[36609]: pgmap v524: 97 pgs: 97 active+clean; 49 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 157 op/s 2024-06-06T08:46:26.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:25 smithi059 ceph-mon[36684]: pgmap v524: 97 pgs: 97 active+clean; 49 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 157 op/s 2024-06-06T08:46:26.287 INFO:tasks.workunit.client.0.smithi028.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-06-06T08:46:26.287 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether ln -s works... yes 2024-06-06T08:46:26.309 INFO:tasks.workunit.client.0.smithi028.stdout:checking the maximum length of command line arguments... 1572864 2024-06-06T08:46:26.319 INFO:tasks.workunit.client.0.smithi028.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-06-06T08:46:26.320 INFO:tasks.workunit.client.0.smithi028.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-06-06T08:46:26.320 INFO:tasks.workunit.client.0.smithi028.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-06-06T08:46:26.321 INFO:tasks.workunit.client.0.smithi028.stdout:checking for objdump... objdump 2024-06-06T08:46:26.322 INFO:tasks.workunit.client.0.smithi028.stdout:checking how to recognize dependent libraries... pass_all 2024-06-06T08:46:26.324 INFO:tasks.workunit.client.0.smithi028.stdout:checking for dlltool... no 2024-06-06T08:46:26.324 INFO:tasks.workunit.client.0.smithi028.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-06-06T08:46:26.325 INFO:tasks.workunit.client.0.smithi028.stdout:checking for ar... ar 2024-06-06T08:46:26.517 INFO:tasks.workunit.client.0.smithi028.stdout:checking for archiver @FILE support... @ 2024-06-06T08:46:26.518 INFO:tasks.workunit.client.0.smithi028.stdout:checking for strip... strip 2024-06-06T08:46:26.519 INFO:tasks.workunit.client.0.smithi028.stdout:checking for ranlib... ranlib 2024-06-06T08:46:26.521 INFO:tasks.workunit.client.0.smithi028.stdout:checking for gawk... gawk 2024-06-06T08:46:26.813 INFO:tasks.workunit.client.0.smithi028.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-06-06T08:46:26.818 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sysroot... no 2024-06-06T08:46:26.838 INFO:tasks.workunit.client.0.smithi028.stdout:checking for a working dd... /usr/bin/dd 2024-06-06T08:46:26.857 INFO:tasks.workunit.client.0.smithi028.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-06-06T08:46:26.923 INFO:tasks.workunit.client.0.smithi028.stdout:checking for mt... no 2024-06-06T08:46:26.946 INFO:tasks.workunit.client.0.smithi028.stdout:checking if : is a manifest tool... no 2024-06-06T08:46:27.096 INFO:tasks.workunit.client.0.smithi028.stdout:checking how to run the C preprocessor... gcc -E 2024-06-06T08:46:27.529 INFO:tasks.workunit.client.0.smithi028.stdout:checking for ANSI C header files... yes 2024-06-06T08:46:27.611 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/types.h... yes 2024-06-06T08:46:27.706 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/stat.h... yes 2024-06-06T08:46:27.800 INFO:tasks.workunit.client.0.smithi028.stdout:checking for stdlib.h... yes 2024-06-06T08:46:27.898 INFO:tasks.workunit.client.0.smithi028.stdout:checking for string.h... yes 2024-06-06T08:46:27.998 INFO:tasks.workunit.client.0.smithi028.stdout:checking for memory.h... yes 2024-06-06T08:46:28.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:27 smithi028 ceph-mon[31564]: pgmap v525: 97 pgs: 97 active+clean; 49 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 146 op/s 2024-06-06T08:46:28.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:27 smithi037 ceph-mon[36609]: pgmap v525: 97 pgs: 97 active+clean; 49 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 146 op/s 2024-06-06T08:46:28.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:27 smithi059 ceph-mon[36684]: pgmap v525: 97 pgs: 97 active+clean; 49 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 146 op/s 2024-06-06T08:46:28.105 INFO:tasks.workunit.client.0.smithi028.stdout:checking for strings.h... yes 2024-06-06T08:46:29.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:28 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:46:29.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:28 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:46:29.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:28 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:46:29.141 INFO:tasks.workunit.client.0.smithi028.stdout:checking for inttypes.h... yes 2024-06-06T08:46:29.402 INFO:tasks.workunit.client.0.smithi028.stdout:checking for stdint.h... yes 2024-06-06T08:46:29.485 INFO:tasks.workunit.client.0.smithi028.stdout:checking for unistd.h... yes 2024-06-06T08:46:29.576 INFO:tasks.workunit.client.0.smithi028.stdout:checking for dlfcn.h... yes 2024-06-06T08:46:29.589 INFO:tasks.workunit.client.0.smithi028.stdout:checking for objdir... .libs 2024-06-06T08:46:29.933 INFO:tasks.workunit.client.0.smithi028.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-06-06T08:46:29.934 INFO:tasks.workunit.client.0.smithi028.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-06-06T08:46:30.035 INFO:tasks.workunit.client.0.smithi028.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-06-06T08:46:30.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:29 smithi028 ceph-mon[31564]: pgmap v526: 97 pgs: 97 active+clean; 51 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.0 MiB/s wr, 154 op/s 2024-06-06T08:46:30.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:29 smithi037 ceph-mon[36609]: pgmap v526: 97 pgs: 97 active+clean; 51 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.0 MiB/s wr, 154 op/s 2024-06-06T08:46:30.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:29 smithi059 ceph-mon[36684]: pgmap v526: 97 pgs: 97 active+clean; 51 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.0 MiB/s wr, 154 op/s 2024-06-06T08:46:30.103 INFO:tasks.workunit.client.0.smithi028.stdout:checking if gcc static flag -static works... no 2024-06-06T08:46:30.212 INFO:tasks.workunit.client.0.smithi028.stdout:checking if gcc supports -c -o file.o... yes 2024-06-06T08:46:30.213 INFO:tasks.workunit.client.0.smithi028.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-06-06T08:46:30.236 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-06-06T08:46:30.331 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether -lc should be explicitly linked in... no 2024-06-06T08:46:30.490 INFO:tasks.workunit.client.0.smithi028.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-06-06T08:46:30.490 INFO:tasks.workunit.client.0.smithi028.stdout:checking how to hardcode library paths into programs... immediate 2024-06-06T08:46:30.494 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether stripping libraries is possible... yes 2024-06-06T08:46:30.494 INFO:tasks.workunit.client.0.smithi028.stdout:checking if libtool supports shared libraries... yes 2024-06-06T08:46:30.495 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether to build shared libraries... yes 2024-06-06T08:46:30.495 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether to build static libraries... yes 2024-06-06T08:46:30.515 INFO:tasks.workunit.client.0.smithi028.stdout:checking for gcc... (cached) gcc 2024-06-06T08:46:30.598 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-06-06T08:46:30.598 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether gcc accepts -g... (cached) yes 2024-06-06T08:46:30.601 INFO:tasks.workunit.client.0.smithi028.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-06-06T08:46:30.602 INFO:tasks.workunit.client.0.smithi028.stdout:checking for gmake... /usr/bin/gmake 2024-06-06T08:46:30.603 INFO:tasks.workunit.client.0.smithi028.stderr:./configure: line 11968: test: $(SHELL): binary operator expected 2024-06-06T08:46:30.603 INFO:tasks.workunit.client.0.smithi028.stdout:checking for tar... /bin/tar 2024-06-06T08:46:30.604 INFO:tasks.workunit.client.0.smithi028.stdout:checking for gzip... /bin/gzip 2024-06-06T08:46:30.659 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether gcc -MM is supported... yes 2024-06-06T08:46:30.659 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sort... /bin/sort 2024-06-06T08:46:30.659 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether ln -s works... yes 2024-06-06T08:46:30.659 INFO:tasks.workunit.client.0.smithi028.stdout:checking for rpm... /bin/rpm 2024-06-06T08:46:30.672 INFO:tasks.workunit.client.0.smithi028.stdout:checking for rpmbuild... no 2024-06-06T08:46:30.672 INFO:tasks.workunit.client.0.smithi028.stdout:checking for ANSI C header files... (cached) yes 2024-06-06T08:46:30.859 INFO:tasks.workunit.client.0.smithi028.stdout:checking assert.h usability... yes 2024-06-06T08:46:30.903 INFO:tasks.workunit.client.0.smithi028.stdout:checking assert.h presence... yes 2024-06-06T08:46:30.903 INFO:tasks.workunit.client.0.smithi028.stdout:checking for assert.h... yes 2024-06-06T08:46:31.021 INFO:tasks.workunit.client.0.smithi028.stdout:checking bstring.h usability... no 2024-06-06T08:46:31.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:46:31.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:46:31.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:30 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:46:31.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:46:31.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:46:31.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:30 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:46:31.091 INFO:tasks.workunit.client.0.smithi028.stdout:checking bstring.h presence... no 2024-06-06T08:46:31.091 INFO:tasks.workunit.client.0.smithi028.stdout:checking for bstring.h... no 2024-06-06T08:46:31.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:46:31.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:46:31.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:30 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:46:31.192 INFO:tasks.workunit.client.0.smithi028.stdout:checking libgen.h usability... yes 2024-06-06T08:46:31.231 INFO:tasks.workunit.client.0.smithi028.stdout:checking libgen.h presence... yes 2024-06-06T08:46:31.231 INFO:tasks.workunit.client.0.smithi028.stdout:checking for libgen.h... yes 2024-06-06T08:46:31.357 INFO:tasks.workunit.client.0.smithi028.stdout:checking dirent.h usability... yes 2024-06-06T08:46:31.400 INFO:tasks.workunit.client.0.smithi028.stdout:checking dirent.h presence... yes 2024-06-06T08:46:31.400 INFO:tasks.workunit.client.0.smithi028.stdout:checking for dirent.h... yes 2024-06-06T08:46:31.508 INFO:tasks.workunit.client.0.smithi028.stdout:checking errno.h usability... yes 2024-06-06T08:46:31.548 INFO:tasks.workunit.client.0.smithi028.stdout:checking errno.h presence... yes 2024-06-06T08:46:31.549 INFO:tasks.workunit.client.0.smithi028.stdout:checking for errno.h... yes 2024-06-06T08:46:31.657 INFO:tasks.workunit.client.0.smithi028.stdout:checking malloc.h usability... yes 2024-06-06T08:46:31.700 INFO:tasks.workunit.client.0.smithi028.stdout:checking malloc.h presence... yes 2024-06-06T08:46:31.700 INFO:tasks.workunit.client.0.smithi028.stdout:checking for malloc.h... yes 2024-06-06T08:46:31.811 INFO:tasks.workunit.client.0.smithi028.stdout:checking uuid.h usability... no 2024-06-06T08:46:31.875 INFO:tasks.workunit.client.0.smithi028.stdout:checking uuid.h presence... no 2024-06-06T08:46:31.875 INFO:tasks.workunit.client.0.smithi028.stdout:checking for uuid.h... no 2024-06-06T08:46:31.973 INFO:tasks.workunit.client.0.smithi028.stdout:checking uuid/uuid.h usability... yes 2024-06-06T08:46:32.016 INFO:tasks.workunit.client.0.smithi028.stdout:checking uuid/uuid.h presence... yes 2024-06-06T08:46:32.016 INFO:tasks.workunit.client.0.smithi028.stdout:checking for uuid/uuid.h... yes 2024-06-06T08:46:32.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:31 smithi059 ceph-mon[36684]: pgmap v527: 97 pgs: 97 active+clean; 54 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 1.2 MiB/s wr, 224 op/s 2024-06-06T08:46:32.129 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/uuid.h usability... no 2024-06-06T08:46:32.195 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/uuid.h presence... no 2024-06-06T08:46:32.196 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/uuid.h... no 2024-06-06T08:46:32.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:31 smithi028 ceph-mon[31564]: pgmap v527: 97 pgs: 97 active+clean; 54 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 1.2 MiB/s wr, 224 op/s 2024-06-06T08:46:32.310 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/file.h usability... yes 2024-06-06T08:46:32.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:31 smithi037 ceph-mon[36609]: pgmap v527: 97 pgs: 97 active+clean; 54 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 1.2 MiB/s wr, 224 op/s 2024-06-06T08:46:32.355 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/file.h presence... yes 2024-06-06T08:46:32.355 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/file.h... yes 2024-06-06T08:46:32.473 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/fcntl.h usability... yes 2024-06-06T08:46:32.514 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/fcntl.h presence... yes 2024-06-06T08:46:32.514 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/fcntl.h... yes 2024-06-06T08:46:32.630 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/syssgi.h usability... no 2024-06-06T08:46:32.695 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/syssgi.h presence... no 2024-06-06T08:46:32.695 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/syssgi.h... no 2024-06-06T08:46:32.828 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/param.h usability... yes 2024-06-06T08:46:32.875 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/param.h presence... yes 2024-06-06T08:46:32.875 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/param.h... yes 2024-06-06T08:46:32.909 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/stat.h... (cached) yes 2024-06-06T08:46:33.005 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/statvfs.h usability... yes 2024-06-06T08:46:33.046 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/statvfs.h presence... yes 2024-06-06T08:46:33.046 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/statvfs.h... yes 2024-06-06T08:46:33.163 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/time.h usability... yes 2024-06-06T08:46:33.209 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/time.h presence... yes 2024-06-06T08:46:33.209 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/time.h... yes 2024-06-06T08:46:33.325 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/ioctl.h usability... yes 2024-06-06T08:46:33.373 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/ioctl.h presence... yes 2024-06-06T08:46:33.374 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/ioctl.h... yes 2024-06-06T08:46:33.500 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/wait.h usability... yes 2024-06-06T08:46:33.543 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/wait.h presence... yes 2024-06-06T08:46:33.543 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/wait.h... yes 2024-06-06T08:46:33.577 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/types.h... (cached) yes 2024-06-06T08:46:33.597 INFO:tasks.workunit.client.0.smithi028.stdout:checking for strings.h... (cached) yes 2024-06-06T08:46:33.710 INFO:tasks.workunit.client.0.smithi028.stdout:checking err.h usability... yes 2024-06-06T08:46:33.751 INFO:tasks.workunit.client.0.smithi028.stdout:checking err.h presence... yes 2024-06-06T08:46:33.751 INFO:tasks.workunit.client.0.smithi028.stdout:checking for err.h... yes 2024-06-06T08:46:33.856 INFO:tasks.workunit.client.0.smithi028.stdout:checking linux/falloc.h usability... yes 2024-06-06T08:46:33.892 INFO:tasks.workunit.client.0.smithi028.stdout:checking linux/falloc.h presence... yes 2024-06-06T08:46:33.892 INFO:tasks.workunit.client.0.smithi028.stdout:checking for linux/falloc.h... yes 2024-06-06T08:46:34.012 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-06-06T08:46:34.083 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-06-06T08:46:34.083 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/fs/xfs_fsops.h... no 2024-06-06T08:46:34.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:33 smithi059 ceph-mon[36684]: pgmap v528: 97 pgs: 97 active+clean; 61 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 1.6 MiB/s wr, 353 op/s 2024-06-06T08:46:34.185 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/fs/xfs_itable.h usability... no 2024-06-06T08:46:34.254 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/fs/xfs_itable.h presence... no 2024-06-06T08:46:34.255 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/fs/xfs_itable.h... no 2024-06-06T08:46:34.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:33 smithi028 ceph-mon[31564]: pgmap v528: 97 pgs: 97 active+clean; 61 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 1.6 MiB/s wr, 353 op/s 2024-06-06T08:46:34.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:33 smithi037 ceph-mon[36609]: pgmap v528: 97 pgs: 97 active+clean; 61 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 1.6 MiB/s wr, 353 op/s 2024-06-06T08:46:34.353 INFO:tasks.workunit.client.0.smithi028.stdout:checking xfs/platform_defs.h usability... no 2024-06-06T08:46:34.420 INFO:tasks.workunit.client.0.smithi028.stdout:checking xfs/platform_defs.h presence... no 2024-06-06T08:46:34.420 INFO:tasks.workunit.client.0.smithi028.stdout:checking for xfs/platform_defs.h... no 2024-06-06T08:46:34.522 INFO:tasks.workunit.client.0.smithi028.stdout:checking btrfs/ioctl.h usability... no 2024-06-06T08:46:34.587 INFO:tasks.workunit.client.0.smithi028.stdout:checking btrfs/ioctl.h presence... no 2024-06-06T08:46:34.587 INFO:tasks.workunit.client.0.smithi028.stdout:checking for btrfs/ioctl.h... no 2024-06-06T08:46:34.686 INFO:tasks.workunit.client.0.smithi028.stdout:checking cifs/ioctl.h usability... no 2024-06-06T08:46:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:checking cifs/ioctl.h presence... no 2024-06-06T08:46:34.750 INFO:tasks.workunit.client.0.smithi028.stdout:checking for cifs/ioctl.h... no 2024-06-06T08:46:34.865 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/mman.h usability... yes 2024-06-06T08:46:34.913 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/mman.h presence... yes 2024-06-06T08:46:34.913 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/mman.h... yes 2024-06-06T08:46:35.005 INFO:tasks.workunit.client.0.smithi028.stdout:checking for xfs/xfs_log_format.h... no 2024-06-06T08:46:35.135 INFO:tasks.workunit.client.0.smithi028.stdout:checking for uuid_compare... no 2024-06-06T08:46:35.235 INFO:tasks.workunit.client.0.smithi028.stdout:checking for uuid_compare in -luuid... yes 2024-06-06T08:46:35.370 INFO:tasks.workunit.client.0.smithi028.stdout:checking for xfs/xfs.h... yes 2024-06-06T08:46:35.455 INFO:tasks.workunit.client.0.smithi028.stdout:checking for xfs/libxfs.h... no 2024-06-06T08:46:35.540 INFO:tasks.workunit.client.0.smithi028.stdout:checking whether xlog_assign_lsn is declared... no 2024-06-06T08:46:35.640 INFO:tasks.workunit.client.0.smithi028.stdout:checking for xfs/xqm.h... yes 2024-06-06T08:46:35.769 INFO:tasks.workunit.client.0.smithi028.stdout:checking xfsctl from xfs/xfs.h... ok 2024-06-06T08:46:35.868 INFO:tasks.workunit.client.0.smithi028.stdout:checking xfs/handle.h usability... yes 2024-06-06T08:46:35.913 INFO:tasks.workunit.client.0.smithi028.stdout:checking xfs/handle.h presence... yes 2024-06-06T08:46:35.913 INFO:tasks.workunit.client.0.smithi028.stdout:checking for xfs/handle.h... yes 2024-06-06T08:46:36.039 INFO:tasks.workunit.client.0.smithi028.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-06-06T08:46:36.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:35 smithi059 ceph-mon[36684]: pgmap v529: 97 pgs: 97 active+clean; 66 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 2.0 MiB/s wr, 390 op/s 2024-06-06T08:46:36.174 INFO:tasks.workunit.client.0.smithi028.stdout:checking attr/attributes.h usability... yes 2024-06-06T08:46:36.220 INFO:tasks.workunit.client.0.smithi028.stdout:checking attr/attributes.h presence... yes 2024-06-06T08:46:36.220 INFO:tasks.workunit.client.0.smithi028.stdout:checking for attr/attributes.h... yes 2024-06-06T08:46:36.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:35 smithi028 ceph-mon[31564]: pgmap v529: 97 pgs: 97 active+clean; 66 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 2.0 MiB/s wr, 390 op/s 2024-06-06T08:46:36.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:35 smithi037 ceph-mon[36609]: pgmap v529: 97 pgs: 97 active+clean; 66 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 2.0 MiB/s wr, 390 op/s 2024-06-06T08:46:36.377 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/attributes.h usability... no 2024-06-06T08:46:36.449 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/attributes.h presence... no 2024-06-06T08:46:36.449 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/attributes.h... no 2024-06-06T08:46:36.558 INFO:tasks.workunit.client.0.smithi028.stdout:checking for attr_list in -lattr... yes 2024-06-06T08:46:36.713 INFO:tasks.workunit.client.0.smithi028.stdout:checking for attr_set in -lattr... yes 2024-06-06T08:46:36.802 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/acl.h usability... yes 2024-06-06T08:46:36.841 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/acl.h presence... yes 2024-06-06T08:46:36.842 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/acl.h... yes 2024-06-06T08:46:36.934 INFO:tasks.workunit.client.0.smithi028.stdout:checking acl/libacl.h usability... yes 2024-06-06T08:46:36.976 INFO:tasks.workunit.client.0.smithi028.stdout:checking acl/libacl.h presence... yes 2024-06-06T08:46:36.976 INFO:tasks.workunit.client.0.smithi028.stdout:checking for acl/libacl.h... yes 2024-06-06T08:46:37.076 INFO:tasks.workunit.client.0.smithi028.stdout:checking for acl_init in -lacl... yes 2024-06-06T08:46:37.183 INFO:tasks.workunit.client.0.smithi028.stdout:checking gdbm-ndbm.h usability... no 2024-06-06T08:46:37.249 INFO:tasks.workunit.client.0.smithi028.stdout:checking gdbm-ndbm.h presence... no 2024-06-06T08:46:37.249 INFO:tasks.workunit.client.0.smithi028.stdout:checking for gdbm-ndbm.h... no 2024-06-06T08:46:37.338 INFO:tasks.workunit.client.0.smithi028.stdout:checking gdbm/ndbm.h usability... no 2024-06-06T08:46:37.405 INFO:tasks.workunit.client.0.smithi028.stdout:checking gdbm/ndbm.h presence... no 2024-06-06T08:46:37.405 INFO:tasks.workunit.client.0.smithi028.stdout:checking for gdbm/ndbm.h... no 2024-06-06T08:46:37.494 INFO:tasks.workunit.client.0.smithi028.stdout:checking ndbm.h usability... no 2024-06-06T08:46:37.559 INFO:tasks.workunit.client.0.smithi028.stdout:checking ndbm.h presence... no 2024-06-06T08:46:37.559 INFO:tasks.workunit.client.0.smithi028.stdout:checking for ndbm.h... no 2024-06-06T08:46:37.642 INFO:tasks.workunit.client.0.smithi028.stdout:checking libaio.h usability... yes 2024-06-06T08:46:37.689 INFO:tasks.workunit.client.0.smithi028.stdout:checking libaio.h presence... yes 2024-06-06T08:46:37.689 INFO:tasks.workunit.client.0.smithi028.stdout:checking for libaio.h... yes 2024-06-06T08:46:37.809 INFO:tasks.workunit.client.0.smithi028.stdout:checking for dm_make_handle in -ldm... no 2024-06-06T08:46:37.810 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-06-06T08:46:37.810 INFO:tasks.workunit.client.0.smithi028.stdout:WARNING: could not find a valid DMAPI base library. 2024-06-06T08:46:37.810 INFO:tasks.workunit.client.0.smithi028.stdout:If you want DMAPI support please install the data migration 2024-06-06T08:46:37.810 INFO:tasks.workunit.client.0.smithi028.stdout:API (dmapi) library package. Alternatively, run "make install" 2024-06-06T08:46:37.810 INFO:tasks.workunit.client.0.smithi028.stdout:from the dmapi source. 2024-06-06T08:46:37.810 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-06-06T08:46:37.887 INFO:tasks.workunit.client.0.smithi028.stdout:checking linux/fiemap.h usability... yes 2024-06-06T08:46:37.926 INFO:tasks.workunit.client.0.smithi028.stdout:checking linux/fiemap.h presence... yes 2024-06-06T08:46:37.927 INFO:tasks.workunit.client.0.smithi028.stdout:checking for linux/fiemap.h... yes 2024-06-06T08:46:38.030 INFO:tasks.workunit.client.0.smithi028.stdout:checking for fallocate... yes 2024-06-06T08:46:38.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:37 smithi059 ceph-mon[36684]: pgmap v530: 97 pgs: 97 active+clean; 66 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 1.8 MiB/s wr, 375 op/s 2024-06-06T08:46:38.115 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:37 smithi037 ceph-mon[36609]: pgmap v530: 97 pgs: 97 active+clean; 66 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 1.8 MiB/s wr, 375 op/s 2024-06-06T08:46:38.141 INFO:tasks.workunit.client.0.smithi028.stdout:checking for open_by_handle_at... yes 2024-06-06T08:46:38.233 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/prctl.h usability... yes 2024-06-06T08:46:38.275 INFO:tasks.workunit.client.0.smithi028.stdout:checking sys/prctl.h presence... yes 2024-06-06T08:46:38.275 INFO:tasks.workunit.client.0.smithi028.stdout:checking for sys/prctl.h... yes 2024-06-06T08:46:38.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:37 smithi028 ceph-mon[31564]: pgmap v530: 97 pgs: 97 active+clean; 66 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 1.8 MiB/s wr, 375 op/s 2024-06-06T08:46:38.358 INFO:tasks.workunit.client.0.smithi028.stdout:checking linux/fs.h usability... yes 2024-06-06T08:46:38.399 INFO:tasks.workunit.client.0.smithi028.stdout:checking linux/fs.h presence... yes 2024-06-06T08:46:38.400 INFO:tasks.workunit.client.0.smithi028.stdout:checking for linux/fs.h... yes 2024-06-06T08:46:38.541 INFO:tasks.workunit.client.0.smithi028.stdout:checking btrfsutil.h usability... no 2024-06-06T08:46:38.614 INFO:tasks.workunit.client.0.smithi028.stdout:checking btrfsutil.h presence... no 2024-06-06T08:46:38.614 INFO:tasks.workunit.client.0.smithi028.stdout:checking for btrfsutil.h... no 2024-06-06T08:46:38.721 INFO:tasks.workunit.client.0.smithi028.stdout:checking for copy_file_range... yes 2024-06-06T08:46:38.828 INFO:tasks.workunit.client.0.smithi028.stdout:checking for renameat2... yes 2024-06-06T08:46:38.875 INFO:tasks.workunit.client.0.smithi028.stdout:configure: creating ./config.status 2024-06-06T08:46:40.101 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:39 smithi059 ceph-mon[36684]: pgmap v531: 97 pgs: 97 active+clean; 68 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.9 MiB/s wr, 376 op/s 2024-06-06T08:46:40.203 INFO:tasks.workunit.client.0.smithi028.stdout:config.status: creating include/builddefs 2024-06-06T08:46:40.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:39 smithi028 ceph-mon[31564]: pgmap v531: 97 pgs: 97 active+clean; 68 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.9 MiB/s wr, 376 op/s 2024-06-06T08:46:40.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:39 smithi037 ceph-mon[36609]: pgmap v531: 97 pgs: 97 active+clean; 68 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.9 MiB/s wr, 376 op/s 2024-06-06T08:46:41.480 INFO:tasks.workunit.client.0.smithi028.stdout:config.status: creating include/config.h 2024-06-06T08:46:42.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:41 smithi028 ceph-mon[31564]: pgmap v532: 97 pgs: 97 active+clean; 68 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.7 MiB/s wr, 353 op/s 2024-06-06T08:46:42.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:41 smithi037 ceph-mon[36609]: pgmap v532: 97 pgs: 97 active+clean; 68 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.7 MiB/s wr, 353 op/s 2024-06-06T08:46:42.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:41 smithi059 ceph-mon[36684]: pgmap v532: 97 pgs: 97 active+clean; 68 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.7 MiB/s wr, 353 op/s 2024-06-06T08:46:44.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:43 smithi028 ceph-mon[31564]: pgmap v533: 97 pgs: 97 active+clean; 68 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.4 MiB/s wr, 259 op/s 2024-06-06T08:46:44.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:43 smithi037 ceph-mon[36609]: pgmap v533: 97 pgs: 97 active+clean; 68 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.4 MiB/s wr, 259 op/s 2024-06-06T08:46:44.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:43 smithi059 ceph-mon[36684]: pgmap v533: 97 pgs: 97 active+clean; 68 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.4 MiB/s wr, 259 op/s 2024-06-06T08:46:46.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:45 smithi028 ceph-mon[31564]: pgmap v534: 97 pgs: 97 active+clean; 69 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 783 KiB/s wr, 100 op/s 2024-06-06T08:46:46.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:45 smithi037 ceph-mon[36609]: pgmap v534: 97 pgs: 97 active+clean; 69 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 783 KiB/s wr, 100 op/s 2024-06-06T08:46:46.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:45 smithi059 ceph-mon[36684]: pgmap v534: 97 pgs: 97 active+clean; 69 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 783 KiB/s wr, 100 op/s 2024-06-06T08:46:46.471 INFO:tasks.workunit.client.0.smithi028.stdout:config.status: executing libtool commands 2024-06-06T08:46:46.658 INFO:tasks.workunit.client.0.smithi028.stdout:Building include 2024-06-06T08:46:46.659 INFO:tasks.workunit.client.0.smithi028.stdout:Building lib 2024-06-06T08:46:46.659 INFO:tasks.workunit.client.0.smithi028.stdout:Building tests 2024-06-06T08:46:46.671 INFO:tasks.workunit.client.0.smithi028.stdout: [LTDEP] 2024-06-06T08:46:47.086 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] dataascii.lo 2024-06-06T08:46:47.087 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] databin.lo 2024-06-06T08:46:47.088 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] datapid.lo 2024-06-06T08:46:47.089 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] file_lock.lo 2024-06-06T08:46:47.334 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] forker.lo 2024-06-06T08:46:47.347 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] pattern.lo 2024-06-06T08:46:47.386 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] open_flags.lo 2024-06-06T08:46:47.418 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] random_range.lo 2024-06-06T08:46:47.608 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] string_to_tokens.lo 2024-06-06T08:46:47.618 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] str_to_bytes.lo 2024-06-06T08:46:47.678 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] tlibio.lo 2024-06-06T08:46:47.804 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] write_log.lo 2024-06-06T08:46:47.834 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] random.lo 2024-06-06T08:46:48.183 INFO:tasks.workunit.client.0.smithi028.stdout: [LD] 2024-06-06T08:46:48.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:47 smithi028 ceph-mon[31564]: pgmap v535: 97 pgs: 97 active+clean; 69 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 228 KiB/s wr, 26 op/s 2024-06-06T08:46:48.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:47 smithi037 ceph-mon[36609]: pgmap v535: 97 pgs: 97 active+clean; 69 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 228 KiB/s wr, 26 op/s 2024-06-06T08:46:48.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:47 smithi059 ceph-mon[36684]: pgmap v535: 97 pgs: 97 active+clean; 69 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 228 KiB/s wr, 26 op/s 2024-06-06T08:46:48.454 INFO:tasks.workunit.client.0.smithi028.stdout:Building ltp 2024-06-06T08:46:48.454 INFO:tasks.workunit.client.0.smithi028.stdout:Building src 2024-06-06T08:46:48.456 INFO:tasks.workunit.client.0.smithi028.stdout:Building common 2024-06-06T08:46:48.457 INFO:tasks.workunit.client.0.smithi028.stdout:Building m4 2024-06-06T08:46:48.472 INFO:tasks.workunit.client.0.smithi028.stdout: [DEP] 2024-06-06T08:46:48.560 INFO:tasks.workunit.client.0.smithi028.stdout: [DEP] 2024-06-06T08:46:48.983 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] doio 2024-06-06T08:46:48.983 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] fsstress 2024-06-06T08:46:48.984 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] fsx 2024-06-06T08:46:49.533 INFO:tasks.workunit.client.0.smithi028.stderr:fsstress.c: In function 'attr_list_path': 2024-06-06T08:46:49.534 INFO:tasks.workunit.client.0.smithi028.stderr:fsstress.c:859:9: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2024-06-06T08:46:49.534 INFO:tasks.workunit.client.0.smithi028.stderr: 859 | rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2024-06-06T08:46:49.534 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~ 2024-06-06T08:46:49.534 INFO:tasks.workunit.client.0.smithi028.stderr:In file included from ../src/global.h:25, 2024-06-06T08:46:49.534 INFO:tasks.workunit.client.0.smithi028.stderr: from fsstress.c:12: 2024-06-06T08:46:49.534 INFO:tasks.workunit.client.0.smithi028.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2024-06-06T08:46:49.534 INFO:tasks.workunit.client.0.smithi028.stderr: 165 | extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2024-06-06T08:46:49.534 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~~ 2024-06-06T08:46:49.534 INFO:tasks.workunit.client.0.smithi028.stderr:fsstress.c: In function 'attr_remove_path': 2024-06-06T08:46:49.534 INFO:tasks.workunit.client.0.smithi028.stderr:fsstress.c:878:9: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2024-06-06T08:46:49.534 INFO:tasks.workunit.client.0.smithi028.stderr: 878 | rval = attr_remove(name->path, attrname, flags); 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~ 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr:In file included from ../src/global.h:25, 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr: from fsstress.c:12: 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr: 152 | extern int attr_remove (const char *__path, const char *__attrname, 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~~~~ 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr:fsstress.c: In function 'attr_set_path': 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr:fsstress.c:898:9: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr: 898 | rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~ 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr:In file included from ../src/global.h:25, 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr: from fsstress.c:12: 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2024-06-06T08:46:49.535 INFO:tasks.workunit.client.0.smithi028.stderr: 139 | extern int attr_set (const char *__path, const char *__attrname, 2024-06-06T08:46:49.536 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~ 2024-06-06T08:46:49.546 INFO:tasks.workunit.client.0.smithi028.stderr:fsstress.c: In function 'allocsp_f': 2024-06-06T08:46:49.546 INFO:tasks.workunit.client.0.smithi028.stderr:fsstress.c:2047:32: error: 'XFS_IOC_ALLOCSP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-06-06T08:46:49.546 INFO:tasks.workunit.client.0.smithi028.stderr: 2047 | e = xfsctl(f.path, fd, XFS_IOC_ALLOCSP64, &fl) < 0 ? errno : 0; 2024-06-06T08:46:49.546 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~~~~~~~~~~ 2024-06-06T08:46:49.547 INFO:tasks.workunit.client.0.smithi028.stderr: | XFS_IOC_RESVSP64 2024-06-06T08:46:49.547 INFO:tasks.workunit.client.0.smithi028.stderr:fsstress.c:2047:32: note: each undeclared identifier is reported only once for each function it appears in 2024-06-06T08:46:49.567 INFO:tasks.workunit.client.0.smithi028.stderr:fsstress.c: In function 'freesp_f': 2024-06-06T08:46:49.567 INFO:tasks.workunit.client.0.smithi028.stderr:fsstress.c:3640:32: error: 'XFS_IOC_FREESP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-06-06T08:46:49.567 INFO:tasks.workunit.client.0.smithi028.stderr: 3640 | e = xfsctl(f.path, fd, XFS_IOC_FREESP64, &fl) < 0 ? errno : 0; 2024-06-06T08:46:49.567 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~~~~~~~~~ 2024-06-06T08:46:49.567 INFO:tasks.workunit.client.0.smithi028.stderr: | XFS_IOC_RESVSP64 2024-06-06T08:46:49.612 INFO:tasks.workunit.client.0.smithi028.stderr:gmake[3]: *** [Makefile:47: fsstress] Error 1 2024-06-06T08:46:49.612 INFO:tasks.workunit.client.0.smithi028.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-06-06T08:46:50.038 INFO:tasks.workunit.client.0.smithi028.stderr:doio.c: In function 'parse_cmdline': 2024-06-06T08:46:50.038 INFO:tasks.workunit.client.0.smithi028.stderr:doio.c:3113:33: warning: '%s' directive argument is null [-Wformat-overflow=] 2024-06-06T08:46:50.038 INFO:tasks.workunit.client.0.smithi028.stderr: 3113 | fprintf(stderr, 2024-06-06T08:46:50.038 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~~~~~~~~ 2024-06-06T08:46:50.038 INFO:tasks.workunit.client.0.smithi028.stderr: 3114 | "%s%s: Illegal -C arg (%s). Must be one of: ", 2024-06-06T08:46:50.038 INFO:tasks.workunit.client.0.smithi028.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-06T08:46:50.038 INFO:tasks.workunit.client.0.smithi028.stderr: 3115 | Prog, TagName, tok); 2024-06-06T08:46:50.038 INFO:tasks.workunit.client.0.smithi028.stderr: | ~~~~~~~~~~~~~~~~~~~ 2024-06-06T08:46:50.100 INFO:tasks.workunit.client.0.smithi028.stderr:fsx.c: In function 'main': 2024-06-06T08:46:50.100 INFO:tasks.workunit.client.0.smithi028.stderr:fsx.c:2662:33: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2024-06-06T08:46:50.100 INFO:tasks.workunit.client.0.smithi028.stderr: 2662 | strncpy(opsfile, optarg, sizeof(opsfile)); 2024-06-06T08:46:50.100 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-06T08:46:50.100 INFO:tasks.workunit.client.0.smithi028.stderr:fsx.c:2632:25: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2024-06-06T08:46:50.100 INFO:tasks.workunit.client.0.smithi028.stderr: 2632 | strncpy(dname, optarg, sizeof(dname)); 2024-06-06T08:46:50.101 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-06T08:46:50.247 INFO:tasks.workunit.client.0.smithi028.stderr:gmake[2]: *** [include/buildrules:30: ltp] Error 2 2024-06-06T08:46:50.247 INFO:tasks.workunit.client.0.smithi028.stderr:gmake[2]: *** Waiting for unfinished jobs.... 2024-06-06T08:46:50.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:49 smithi028 ceph-mon[31564]: pgmap v536: 97 pgs: 97 active+clean; 69 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 231 KiB/s wr, 27 op/s 2024-06-06T08:46:50.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:49 smithi037 ceph-mon[36609]: pgmap v536: 97 pgs: 97 active+clean; 69 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 231 KiB/s wr, 27 op/s 2024-06-06T08:46:50.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:49 smithi059 ceph-mon[36684]: pgmap v536: 97 pgs: 97 active+clean; 69 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 231 KiB/s wr, 27 op/s 2024-06-06T08:46:52.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:51 smithi028 ceph-mon[31564]: pgmap v537: 97 pgs: 97 active+clean; 69 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 90 KiB/s wr, 31 op/s 2024-06-06T08:46:52.291 INFO:tasks.workunit.client.0.smithi028.stdout: [DEP] 2024-06-06T08:46:52.292 INFO:tasks.workunit.client.0.smithi028.stdout: [DEP] 2024-06-06T08:46:52.294 INFO:tasks.workunit.client.0.smithi028.stdout: [DEP] 2024-06-06T08:46:52.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:51 smithi037 ceph-mon[36609]: pgmap v537: 97 pgs: 97 active+clean; 69 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 90 KiB/s wr, 31 op/s 2024-06-06T08:46:52.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:51 smithi059 ceph-mon[36684]: pgmap v537: 97 pgs: 97 active+clean; 69 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 90 KiB/s wr, 31 op/s 2024-06-06T08:46:52.850 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] dirstress 2024-06-06T08:46:52.854 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] fill 2024-06-06T08:46:52.858 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] fill2 2024-06-06T08:46:52.859 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] getpagesize 2024-06-06T08:46:53.170 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] holes 2024-06-06T08:46:53.184 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] lstat64 2024-06-06T08:46:53.297 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] nametest 2024-06-06T08:46:53.300 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] permname 2024-06-06T08:46:53.555 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] randholes 2024-06-06T08:46:53.558 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] runas 2024-06-06T08:46:53.710 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] truncfile 2024-06-06T08:46:53.713 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] usemem 2024-06-06T08:46:53.911 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] mmapcat 2024-06-06T08:46:53.993 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] append_reader 2024-06-06T08:46:54.023 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] append_writer 2024-06-06T08:46:54.089 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] dirperf 2024-06-06T08:46:54.233 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] metaperf 2024-06-06T08:46:54.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:53 smithi028 ceph-mon[31564]: pgmap v538: 97 pgs: 97 active+clean; 69 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 193 KiB/s wr, 58 op/s 2024-06-06T08:46:54.307 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] devzero 2024-06-06T08:46:54.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:53 smithi037 ceph-mon[36609]: pgmap v538: 97 pgs: 97 active+clean; 69 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 193 KiB/s wr, 58 op/s 2024-06-06T08:46:54.316 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] feature 2024-06-06T08:46:54.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:53 smithi059 ceph-mon[36684]: pgmap v538: 97 pgs: 97 active+clean; 69 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 193 KiB/s wr, 58 op/s 2024-06-06T08:46:54.513 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] alloc 2024-06-06T08:46:54.646 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] fault 2024-06-06T08:46:54.655 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] fstest 2024-06-06T08:46:54.687 INFO:tasks.workunit.client.0.smithi028.stdout: [CC] t_access_root 2024-06-06T08:46:54.792 INFO:tasks.workunit.client.0.smithi028.stderr:alloc.c: In function 'main': 2024-06-06T08:46:54.792 INFO:tasks.workunit.client.0.smithi028.stderr:alloc.c:154:1: error: 'bozo' undeclared (first use in this function) 2024-06-06T08:46:54.792 INFO:tasks.workunit.client.0.smithi028.stderr: 154 | bozo! 2024-06-06T08:46:54.792 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~ 2024-06-06T08:46:54.793 INFO:tasks.workunit.client.0.smithi028.stderr:alloc.c:154:1: note: each undeclared identifier is reported only once for each function it appears in 2024-06-06T08:46:54.793 INFO:tasks.workunit.client.0.smithi028.stderr:alloc.c:154:5: error: expected ';' before '!' token 2024-06-06T08:46:54.793 INFO:tasks.workunit.client.0.smithi028.stderr: 154 | bozo! 2024-06-06T08:46:54.793 INFO:tasks.workunit.client.0.smithi028.stderr: | ^ 2024-06-06T08:46:54.793 INFO:tasks.workunit.client.0.smithi028.stderr: | ; 2024-06-06T08:46:54.794 INFO:tasks.workunit.client.0.smithi028.stderr:alloc.c:184:25: error: 'rflag' undeclared (first use in this function); did you mean 'nflag'? 2024-06-06T08:46:54.794 INFO:tasks.workunit.client.0.smithi028.stderr: 184 | rflag = 1; 2024-06-06T08:46:54.794 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~ 2024-06-06T08:46:54.794 INFO:tasks.workunit.client.0.smithi028.stderr: | nflag 2024-06-06T08:46:54.794 INFO:tasks.workunit.client.0.smithi028.stderr:alloc.c:320:5: error: expected ';' before '!' token 2024-06-06T08:46:54.794 INFO:tasks.workunit.client.0.smithi028.stderr: 320 | bozo! 2024-06-06T08:46:54.794 INFO:tasks.workunit.client.0.smithi028.stderr: | ^ 2024-06-06T08:46:54.794 INFO:tasks.workunit.client.0.smithi028.stderr: | ; 2024-06-06T08:46:54.795 INFO:tasks.workunit.client.0.smithi028.stderr:alloc.c:128:25: warning: variable 'f' set but not used [-Wunused-but-set-variable] 2024-06-06T08:46:54.795 INFO:tasks.workunit.client.0.smithi028.stderr: 128 | struct flock64 f; 2024-06-06T08:46:54.795 INFO:tasks.workunit.client.0.smithi028.stderr: | ^ 2024-06-06T08:46:54.802 INFO:tasks.workunit.client.0.smithi028.stderr:gmake[3]: *** [Makefile:83: alloc] Error 1 2024-06-06T08:46:54.802 INFO:tasks.workunit.client.0.smithi028.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-06-06T08:46:54.928 INFO:tasks.workunit.client.0.smithi028.stderr:fstest.c: In function 'run_child': 2024-06-06T08:46:54.928 INFO:tasks.workunit.client.0.smithi028.stderr:fstest.c:95:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~ 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr:fstest.c:95:24: note: directive argument in the range [0, 2147483647] 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~~~~ 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr:fstest.c:95:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr:fstest.c:166:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~ 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr:fstest.c:166:24: note: directive argument in the range [0, 2147483647] 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-06T08:46:54.929 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~~~~ 2024-06-06T08:46:54.930 INFO:tasks.workunit.client.0.smithi028.stderr:fstest.c:166:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-06-06T08:46:54.930 INFO:tasks.workunit.client.0.smithi028.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-06T08:46:54.930 INFO:tasks.workunit.client.0.smithi028.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-06T08:46:55.040 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-06-06T08:46:55.040 INFO:tasks.workunit.client.0.smithi028.stderr:gmake[2]: *** [include/buildrules:30: src] Error 2 2024-06-06T08:46:55.040 INFO:tasks.workunit.client.0.smithi028.stderr:make[1]: *** [Makefile:53: default] Error 2 2024-06-06T08:46:55.040 INFO:tasks.workunit.client.0.smithi028.stderr:make: *** [Makefile:51: default] Error 2 2024-06-06T08:46:55.041 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-06-06T08:46:55.041 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-06T08:46:56.151 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:55 smithi028 ceph-mon[31564]: pgmap v539: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 318 KiB/s wr, 77 op/s 2024-06-06T08:46:56.155 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi028 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d746ca5346f34eef7e826a1eb71e59e02b682ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-06-06T08:46:56.401 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=0ad6675325f547549222eece543febdb Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_3d746ca5346f34eef7e826a1eb71e59e02b682ae/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi028 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d746ca5346f34eef7e826a1eb71e59e02b682ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-06-06T08:46:56.403 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-06-06T08:46:56.413 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-06T08:46:56.418 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:55 smithi059 ceph-mon[36684]: pgmap v539: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 318 KiB/s wr, 77 op/s 2024-06-06T08:46:56.418 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:55 smithi037 ceph-mon[36609]: pgmap v539: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 318 KiB/s wr, 77 op/s 2024-06-06T08:46:56.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.644+0000 7f13afe00640 1 -- 172.21.15.28:0/1597088594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a8109210 msgr2=0x7f13a8109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:56.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.644+0000 7f13afe00640 1 --2- 172.21.15.28:0/1597088594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a8109210 0x7f13a8109690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1394009860 tx=0x7f139402a340 comp rx=0 tx=0).stop 2024-06-06T08:46:56.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.644+0000 7f13afe00640 1 -- 172.21.15.28:0/1597088594 shutdown_connections 2024-06-06T08:46:56.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.644+0000 7f13afe00640 1 --2- 172.21.15.28:0/1597088594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13a8109bd0 0x7f13a8110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:56.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.644+0000 7f13afe00640 1 --2- 172.21.15.28:0/1597088594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a8109210 0x7f13a8109690 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:56.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.644+0000 7f13afe00640 1 --2- 172.21.15.28:0/1597088594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13a8108020 0x7f13a8108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:56.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.644+0000 7f13afe00640 1 -- 172.21.15.28:0/1597088594 >> 172.21.15.28:0/1597088594 conn(0x7f13a8076ff0 msgr2=0x7f13a8079410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:46:56.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.644+0000 7f13afe00640 1 -- 172.21.15.28:0/1597088594 shutdown_connections 2024-06-06T08:46:56.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.644+0000 7f13afe00640 1 -- 172.21.15.28:0/1597088594 wait complete. 2024-06-06T08:46:56.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.645+0000 7f13afe00640 1 Processor -- start 2024-06-06T08:46:56.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13afe00640 1 -- start start 2024-06-06T08:46:56.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13a8108020 0x7f13a819e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:56.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13afe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a8109210 0x7f13a819e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:56.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13afe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13a8109bd0 0x7f13a81a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:56.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13afe00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8113cb0 con 0x7f13a8109bd0 2024-06-06T08:46:56.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13afe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8113b30 con 0x7f13a8109210 2024-06-06T08:46:56.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13afe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8113e30 con 0x7f13a8108020 2024-06-06T08:46:56.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13ade00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13a8109bd0 0x7f13a81a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:56.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13a8108020 0x7f13a819e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:56.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13a8108020 0x7f13a819e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:35206/0 (socket says 172.21.15.28:35206) 2024-06-06T08:46:56.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13ad400640 1 -- 172.21.15.28:0/139389084 learned_addr learned my addr 172.21.15.28:0/139389084 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:46:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13ade00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13a8109bd0 0x7f13a81a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54300/0 (socket says 172.21.15.28:54300) 2024-06-06T08:46:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.646+0000 7f13aca00640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a8109210 0x7f13a819e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.647+0000 7f13ad400640 1 -- 172.21.15.28:0/139389084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a8109210 msgr2=0x7f13a819e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.647+0000 7f13ad400640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a8109210 0x7f13a819e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.647+0000 7f13ad400640 1 -- 172.21.15.28:0/139389084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13a8109bd0 msgr2=0x7f13a81a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.647+0000 7f13ad400640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13a8109bd0 0x7f13a81a58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.647+0000 7f13ad400640 1 -- 172.21.15.28:0/139389084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a81a5f30 con 0x7f13a8108020 2024-06-06T08:46:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.647+0000 7f13ad400640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13a8108020 0x7f13a819e310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f139c00e9a0 tx=0x7f139c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:46:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.647+0000 7f13a6000640 1 -- 172.21.15.28:0/139389084 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c00cd80 con 0x7f13a8108020 2024-06-06T08:46:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.647+0000 7f13a6000640 1 -- 172.21.15.28:0/139389084 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f139c010910 con 0x7f13a8108020 2024-06-06T08:46:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.647+0000 7f13afe00640 1 -- 172.21.15.28:0/139389084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a81a6220 con 0x7f13a8108020 2024-06-06T08:46:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.647+0000 7f13a6000640 1 -- 172.21.15.28:0/139389084 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c018a30 con 0x7f13a8108020 2024-06-06T08:46:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.647+0000 7f13afe00640 1 -- 172.21.15.28:0/139389084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a81a6740 con 0x7f13a8108020 2024-06-06T08:46:56.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.648+0000 7f13afe00640 1 -- 172.21.15.28:0/139389084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a810f2e0 con 0x7f13a8108020 2024-06-06T08:46:56.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.651+0000 7f13a6000640 1 -- 172.21.15.28:0/139389084 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f139c010ac0 con 0x7f13a8108020 2024-06-06T08:46:56.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.652+0000 7f13a6000640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f13900a2b90 0x7f13900a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.652+0000 7f13a6000640 1 -- 172.21.15.28:0/139389084 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f139c0cfb60 con 0x7f13a8108020 2024-06-06T08:46:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.652+0000 7f13aca00640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f13900a2b90 0x7f13900a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:56.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.653+0000 7f13aca00640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f13900a2b90 0x7f13900a5050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1394009830 tx=0x7f1394030550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:46:56.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.654+0000 7f13a6000640 1 -- 172.21.15.28:0/139389084 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f139c026070 con 0x7f13a8108020 2024-06-06T08:46:56.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.861+0000 7f13afe00640 1 -- 172.21.15.28:0/139389084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13a80625a0 con 0x7f13a8108020 2024-06-06T08:46:56.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.863+0000 7f13a6000640 1 -- 172.21.15.28:0/139389084 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+22770 (secure 0 0 0) 0x7f139c09c9e0 con 0x7f13a8108020 2024-06-06T08:46:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:46:56.862 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":92,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","created":"2024-06-06T08:30:30.991501+0000","modified":"2024-06-06T08:41:41.833381+0000","last_up_change":"2024-06-06T08:38:45.850887+0000","last_in_change":"2024-06-06T08:38:26.532528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T08:34:26.800168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T08:39:56.375661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T08:40:01.096994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7edaffea-7613-4d20-b9b8-108a17af8f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6803","nonce":2001709636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6805","nonce":2001709636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6809","nonce":2001709636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6807","nonce":2001709636}]},"public_addr":"172.21.15.28:6803/2001709636","cluster_addr":"172.21.15.28:6805/2001709636","heartbeat_back_addr":"172.21.15.28:6809/2001709636","heartbeat_front_addr":"172.21.15.28:6807/2001709636","state":["exists","up"]},{"osd":1,"uuid":"17eb7536-c2a4-4f8b-bec4-b1abb5125836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6801","nonce":593429648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6803","nonce":593429648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6807","nonce":593429648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6805","nonce":593429648}]},"public_addr":"172.21.15.37:6801/593429648","cluster_addr":"172.21.15.37:6803/593429648","heartbeat_back_addr":"172.21.15.37:6807/593429648","heartbeat_front_addr":"172.21.15.37:6805/593429648","state":["exists","up"]},{"osd":2,"uuid":"3ea64fd8-13f4-4d53-933b-07055ec72701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6801","nonce":88678886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6803","nonce":88678886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6807","nonce":88678886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6805","nonce":88678886}]},"public_addr":"172.21.15.59:6801/88678886","cluster_addr":"172.21.15.59:6803/88678886","heartbeat_back_addr":"172.21.15.59:6807/88678886","heartbeat_front_addr":"172.21.15.59:6805/88678886","state":["exists","up"]},{"osd":3,"uuid":"8be9cdb5-12a9-438e-b8cd-ce65988b0ac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6811","nonce":484290430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6813","nonce":484290430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6817","nonce":484290430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6815","nonce":484290430}]},"public_addr":"172.21.15.28:6811/484290430","cluster_addr":"172.21.15.28:6813/484290430","heartbeat_back_addr":"172.21.15.28:6817/484290430","heartbeat_front_addr":"172.21.15.28:6815/484290430","state":["exists","up"]},{"osd":4,"uuid":"ddea397d-d7b1-46f3-9a13-dd318cade055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6809","nonce":3596500266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6811","nonce":3596500266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6815","nonce":3596500266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6813","nonce":3596500266}]},"public_addr":"172.21.15.37:6809/3596500266","cluster_addr":"172.21.15.37:6811/3596500266","heartbeat_back_addr":"172.21.15.37:6815/3596500266","heartbeat_front_addr":"172.21.15.37:6813/3596500266","state":["exists","up"]},{"osd":5,"uuid":"ee19857b-b047-4d15-8b17-257b6e4966a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6809","nonce":3037648282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6811","nonce":3037648282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6815","nonce":3037648282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6813","nonce":3037648282}]},"public_addr":"172.21.15.59:6809/3037648282","cluster_addr":"172.21.15.59:6811/3037648282","heartbeat_back_addr":"172.21.15.59:6815/3037648282","heartbeat_front_addr":"172.21.15.59:6813/3037648282","state":["exists","up"]},{"osd":6,"uuid":"1d57d0ba-8e37-4ac2-87e8-40b20b24fc53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6819","nonce":3794924886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6821","nonce":3794924886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6825","nonce":3794924886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6823","nonce":3794924886}]},"public_addr":"172.21.15.28:6819/3794924886","cluster_addr":"172.21.15.28:6821/3794924886","heartbeat_back_addr":"172.21.15.28:6825/3794924886","heartbeat_front_addr":"172.21.15.28:6823/3794924886","state":["exists","up"]},{"osd":7,"uuid":"43f3c2c8-752d-4a70-99dd-2c14aeefa137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6817","nonce":724042860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6819","nonce":724042860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6823","nonce":724042860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6821","nonce":724042860}]},"public_addr":"172.21.15.37:6817/724042860","cluster_addr":"172.21.15.37:6819/724042860","heartbeat_back_addr":"172.21.15.37:6823/724042860","heartbeat_front_addr":"172.21.15.37:6821/724042860","state":["exists","up"]},{"osd":8,"uuid":"3ffc07d7-ca79-419d-88a4-2b53d07ffae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6817","nonce":1240363223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6819","nonce":1240363223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6823","nonce":1240363223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6821","nonce":1240363223}]},"public_addr":"172.21.15.59:6817/1240363223","cluster_addr":"172.21.15.59:6819/1240363223","heartbeat_back_addr":"172.21.15.59:6823/1240363223","heartbeat_front_addr":"172.21.15.59:6821/1240363223","state":["exists","up"]},{"osd":9,"uuid":"4e014fc7-1ca3-4d6c-acdd-95ca59541310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6827","nonce":2555848355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6829","nonce":2555848355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6833","nonce":2555848355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6831","nonce":2555848355}]},"public_addr":"172.21.15.28:6827/2555848355","cluster_addr":"172.21.15.28:6829/2555848355","heartbeat_back_addr":"172.21.15.28:6833/2555848355","heartbeat_front_addr":"172.21.15.28:6831/2555848355","state":["exists","up"]},{"osd":10,"uuid":"fc418661-5e89-4241-b14b-241a2be432f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6825","nonce":176857372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6827","nonce":176857372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6831","nonce":176857372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6829","nonce":176857372}]},"public_addr":"172.21.15.37:6825/176857372","cluster_addr":"172.21.15.37:6827/176857372","heartbeat_back_addr":"172.21.15.37:6831/176857372","heartbeat_front_addr":"172.21.15.37:6829/176857372","state":["exists","up"]},{"osd":11,"uuid":"e54d81ee-1461-4229-a1c0-c6e750dd66ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6825","nonce":2675673798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6827","nonce":2675673798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6831","nonce":2675673798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6829","nonce":2675673798}]},"public_addr":"172.21.15.59:6825/2675673798","cluster_addr":"172.21.15.59:6827/2675673798","heartbeat_back_addr":"172.21.15.59:6831/2675673798","heartbeat_front_addr":"172.21.15.59:6829/2675673798","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:33.904270+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:58.988528+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:22.997033+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:57.171455+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:23.594371+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:48.928423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:22.957203+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:50.599655+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:16.166981+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:50.755673+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:18.677280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:44.432598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":5,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1f","mappings":[{"from":1,"to":2}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/4230567915":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/2860387445":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/886961600":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/3217551014":"2024-06-07T08:31:40.064884+0000","172.21.15.28:0/1629731223":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/219831273":"2024-06-07T08:31:04.770627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T08:46:56.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.865+0000 7f13afe00640 1 -- 172.21.15.28:0/139389084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f13900a2b90 msgr2=0x7f13900a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.865+0000 7f13afe00640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f13900a2b90 0x7f13900a5050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1394009830 tx=0x7f1394030550 comp rx=0 tx=0).stop 2024-06-06T08:46:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.865+0000 7f13afe00640 1 -- 172.21.15.28:0/139389084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13a8108020 msgr2=0x7f13a819e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.865+0000 7f13afe00640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13a8108020 0x7f13a819e310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f139c00e9a0 tx=0x7f139c00ee60 comp rx=0 tx=0).stop 2024-06-06T08:46:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.866+0000 7f13afe00640 1 -- 172.21.15.28:0/139389084 shutdown_connections 2024-06-06T08:46:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.866+0000 7f13afe00640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13a8109bd0 0x7f13a81a58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.866+0000 7f13afe00640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f13900a2b90 0x7f13900a5050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.866+0000 7f13afe00640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a8109210 0x7f13a819e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.866+0000 7f13afe00640 1 --2- 172.21.15.28:0/139389084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13a8108020 0x7f13a819e310 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.866+0000 7f13afe00640 1 -- 172.21.15.28:0/139389084 >> 172.21.15.28:0/139389084 conn(0x7f13a8076ff0 msgr2=0x7f13a810c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:46:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.866+0000 7f13afe00640 1 -- 172.21.15.28:0/139389084 shutdown_connections 2024-06-06T08:46:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:56.866+0000 7f13afe00640 1 -- 172.21.15.28:0/139389084 wait complete. 2024-06-06T08:46:56.883 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-06T08:34:26.800168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-06T08:39:56.375661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-06T08:40:01.096994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-06T08:46:56.884 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-06T08:46:57.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.093+0000 7f994ae00640 1 -- 172.21.15.28:0/2215936628 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9944102e40 msgr2=0x7f9944103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:57.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.093+0000 7f994ae00640 1 --2- 172.21.15.28:0/2215936628 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9944102e40 0x7f9944103260 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9938009900 tx=0x7f993802a3f0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.093+0000 7f994ae00640 1 -- 172.21.15.28:0/2215936628 shutdown_connections 2024-06-06T08:46:57.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.093+0000 7f994ae00640 1 --2- 172.21.15.28:0/2215936628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9944100270 0x7f9944109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.093+0000 7f994ae00640 1 --2- 172.21.15.28:0/2215936628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99440ff8b0 0x7f99440ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.093+0000 7f994ae00640 1 --2- 172.21.15.28:0/2215936628 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9944102e40 0x7f9944103260 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.093+0000 7f994ae00640 1 -- 172.21.15.28:0/2215936628 >> 172.21.15.28:0/2215936628 conn(0x7f99440fb410 msgr2=0x7f99440fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:46:57.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.093+0000 7f994ae00640 1 -- 172.21.15.28:0/2215936628 shutdown_connections 2024-06-06T08:46:57.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.093+0000 7f994ae00640 1 -- 172.21.15.28:0/2215936628 wait complete. 2024-06-06T08:46:57.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.094+0000 7f994ae00640 1 Processor -- start 2024-06-06T08:46:57.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.094+0000 7f994ae00640 1 -- start start 2024-06-06T08:46:57.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.094+0000 7f994ae00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99440ff8b0 0x7f9944107760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:57.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.094+0000 7f994ae00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9944100270 0x7f9944107ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:57.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.094+0000 7f994ae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9944102e40 0x7f99441042d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:57.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.094+0000 7f994ae00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f994410d4c0 con 0x7f9944100270 2024-06-06T08:46:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.094+0000 7f994ae00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f994410d340 con 0x7f99440ff8b0 2024-06-06T08:46:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.094+0000 7f994ae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f994410d640 con 0x7f9944102e40 2024-06-06T08:46:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f994a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9944102e40 0x7f99441042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f9949a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99440ff8b0 0x7f9944107760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f9949000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9944100270 0x7f9944107ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f994a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9944102e40 0x7f99441042d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:35224/0 (socket says 172.21.15.28:35224) 2024-06-06T08:46:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f994a400640 1 -- 172.21.15.28:0/1545239260 learned_addr learned my addr 172.21.15.28:0/1545239260 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:46:57.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f994a400640 1 -- 172.21.15.28:0/1545239260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99440ff8b0 msgr2=0x7f9944107760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:57.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f994a400640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99440ff8b0 0x7f9944107760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f994a400640 1 -- 172.21.15.28:0/1545239260 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9944100270 msgr2=0x7f9944107ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:57.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f994a400640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9944100270 0x7f9944107ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f994a400640 1 -- 172.21.15.28:0/1545239260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9944104b90 con 0x7f9944102e40 2024-06-06T08:46:57.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f9949a00640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99440ff8b0 0x7f9944107760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:46:57.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.095+0000 7f9949000640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9944100270 0x7f9944107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:46:57.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.096+0000 7f994a400640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9944102e40 0x7f99441042d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f993c00eb10 tx=0x7f993c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:46:57.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.096+0000 7f9942000640 1 -- 172.21.15.28:0/1545239260 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c004b20 con 0x7f9944102e40 2024-06-06T08:46:57.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.096+0000 7f9942000640 1 -- 172.21.15.28:0/1545239260 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f993c004cc0 con 0x7f9944102e40 2024-06-06T08:46:57.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.096+0000 7f9942000640 1 -- 172.21.15.28:0/1545239260 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c010760 con 0x7f9944102e40 2024-06-06T08:46:57.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.096+0000 7f994ae00640 1 -- 172.21.15.28:0/1545239260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99441a61b0 con 0x7f9944102e40 2024-06-06T08:46:57.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.096+0000 7f994ae00640 1 -- 172.21.15.28:0/1545239260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99441a65c0 con 0x7f9944102e40 2024-06-06T08:46:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.097+0000 7f994ae00640 1 -- 172.21.15.28:0/1545239260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99441a6880 con 0x7f9944102e40 2024-06-06T08:46:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.099+0000 7f9942000640 1 -- 172.21.15.28:0/1545239260 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f993c005020 con 0x7f9944102e40 2024-06-06T08:46:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.101+0000 7f9942000640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f992c0a2c10 0x7f992c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:57.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.101+0000 7f9942000640 1 -- 172.21.15.28:0/1545239260 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f993c0cf650 con 0x7f9944102e40 2024-06-06T08:46:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.101+0000 7f9949a00640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f992c0a2c10 0x7f992c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.102+0000 7f9949a00640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f992c0a2c10 0x7f992c0a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f993802a9e0 tx=0x7f99380315b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:46:57.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.105+0000 7f9942000640 1 -- 172.21.15.28:0/1545239260 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f993c09c4d0 con 0x7f9944102e40 2024-06-06T08:46:57.251 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:56 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/139389084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:46:57.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:56 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/139389084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:46:57.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.313+0000 7f994ae00640 1 -- 172.21.15.28:0/1545239260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f99441a6a50 con 0x7f9944102e40 2024-06-06T08:46:57.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.314+0000 7f9942000640 1 -- 172.21.15.28:0/1545239260 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f993c09bdd0 con 0x7f9944102e40 2024-06-06T08:46:57.312 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-06-06T08:46:57.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:56 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/139389084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:46:57.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.316+0000 7f994ae00640 1 -- 172.21.15.28:0/1545239260 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f992c0a2c10 msgr2=0x7f992c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:57.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.316+0000 7f994ae00640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f992c0a2c10 0x7f992c0a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f993802a9e0 tx=0x7f99380315b0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.316+0000 7f994ae00640 1 -- 172.21.15.28:0/1545239260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9944102e40 msgr2=0x7f99441042d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:57.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.316+0000 7f994ae00640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9944102e40 0x7f99441042d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f993c00eb10 tx=0x7f993c00c2d0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.316+0000 7f994ae00640 1 -- 172.21.15.28:0/1545239260 shutdown_connections 2024-06-06T08:46:57.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.316+0000 7f994ae00640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9944102e40 0x7f99441042d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.316+0000 7f994ae00640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9944100270 0x7f9944107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.316+0000 7f994ae00640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f992c0a2c10 0x7f992c0a50d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.316+0000 7f994ae00640 1 --2- 172.21.15.28:0/1545239260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99440ff8b0 0x7f9944107760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.316+0000 7f994ae00640 1 -- 172.21.15.28:0/1545239260 >> 172.21.15.28:0/1545239260 conn(0x7f99440fb410 msgr2=0x7f99441009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:46:57.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.317+0000 7f994ae00640 1 -- 172.21.15.28:0/1545239260 shutdown_connections 2024-06-06T08:46:57.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.317+0000 7f994ae00640 1 -- 172.21.15.28:0/1545239260 wait complete. 2024-06-06T08:46:57.334 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-06T08:46:57.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.557+0000 7f20dd200640 1 -- 172.21.15.28:0/573448982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20d8074400 msgr2=0x7f20d8074880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:57.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.557+0000 7f20dd200640 1 --2- 172.21.15.28:0/573448982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20d8074400 0x7f20d8074880 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009930 tx=0x7f20c402a420 comp rx=0 tx=0).stop 2024-06-06T08:46:57.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.557+0000 7f20dd200640 1 -- 172.21.15.28:0/573448982 shutdown_connections 2024-06-06T08:46:57.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.557+0000 7f20dd200640 1 --2- 172.21.15.28:0/573448982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d810dde0 0x7f20d81101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.557+0000 7f20dd200640 1 --2- 172.21.15.28:0/573448982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20d8074400 0x7f20d8074880 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.557+0000 7f20dd200640 1 --2- 172.21.15.28:0/573448982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d80759e0 0x7f20d8073e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.557+0000 7f20dd200640 1 -- 172.21.15.28:0/573448982 >> 172.21.15.28:0/573448982 conn(0x7f20d80fcd80 msgr2=0x7f20d80ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:46:57.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.557+0000 7f20dd200640 1 -- 172.21.15.28:0/573448982 shutdown_connections 2024-06-06T08:46:57.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.557+0000 7f20dd200640 1 -- 172.21.15.28:0/573448982 wait complete. 2024-06-06T08:46:57.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.558+0000 7f20dd200640 1 Processor -- start 2024-06-06T08:46:57.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.558+0000 7f20dd200640 1 -- start start 2024-06-06T08:46:57.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.558+0000 7f20dd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d8074400 0x7f20d819e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:57.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.558+0000 7f20dd200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20d80759e0 0x7f20d819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:57.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.558+0000 7f20dd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d810dde0 0x7f20d81a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:57.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.558+0000 7f20dd200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f20d8113a80 con 0x7f20d80759e0 2024-06-06T08:46:57.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.558+0000 7f20dd200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20d8113900 con 0x7f20d8074400 2024-06-06T08:46:57.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.558+0000 7f20dd200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20d8113c00 con 0x7f20d810dde0 2024-06-06T08:46:57.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.559+0000 7f20d7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d8074400 0x7f20d819e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:57.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.559+0000 7f20d6a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20d80759e0 0x7f20d819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:57.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.559+0000 7f20d7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d8074400 0x7f20d819e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:51108/0 (socket says 172.21.15.28:51108) 2024-06-06T08:46:57.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.559+0000 7f20d7400640 1 -- 172.21.15.28:0/586030848 learned_addr learned my addr 172.21.15.28:0/586030848 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:46:57.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.559+0000 7f20d7e00640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d810dde0 0x7f20d81a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:57.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.559+0000 7f20d6a00640 1 -- 172.21.15.28:0/586030848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d810dde0 msgr2=0x7f20d81a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:57.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.559+0000 7f20d6a00640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d810dde0 0x7f20d81a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.559+0000 7f20d6a00640 1 -- 172.21.15.28:0/586030848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d8074400 msgr2=0x7f20d819e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:57.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.559+0000 7f20d6a00640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d8074400 0x7f20d819e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.559+0000 7f20d6a00640 1 -- 172.21.15.28:0/586030848 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d81a5da0 con 0x7f20d80759e0 2024-06-06T08:46:57.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.560+0000 7f20d6a00640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20d80759e0 0x7f20d819e6c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f20c40314e0 tx=0x7f20c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:46:57.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.560+0000 7f20cfe00640 1 -- 172.21.15.28:0/586030848 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c403f070 con 0x7f20d80759e0 2024-06-06T08:46:57.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.560+0000 7f20cfe00640 1 -- 172.21.15.28:0/586030848 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20c4003cd0 con 0x7f20d80759e0 2024-06-06T08:46:57.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.560+0000 7f20dd200640 1 -- 172.21.15.28:0/586030848 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d81a6030 con 0x7f20d80759e0 2024-06-06T08:46:57.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.560+0000 7f20cfe00640 1 -- 172.21.15.28:0/586030848 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4035070 con 0x7f20d80759e0 2024-06-06T08:46:57.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.560+0000 7f20dd200640 1 -- 172.21.15.28:0/586030848 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d81a6540 con 0x7f20d80759e0 2024-06-06T08:46:57.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.561+0000 7f20dd200640 1 -- 172.21.15.28:0/586030848 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d8103fb0 con 0x7f20d80759e0 2024-06-06T08:46:57.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.563+0000 7f20cfe00640 1 -- 172.21.15.28:0/586030848 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f20c403b460 con 0x7f20d80759e0 2024-06-06T08:46:57.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.565+0000 7f20cfe00640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f20bc0a2c10 0x7f20bc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:57.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.565+0000 7f20cfe00640 1 -- 172.21.15.28:0/586030848 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f20c40ef440 con 0x7f20d80759e0 2024-06-06T08:46:57.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.565+0000 7f20d7400640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f20bc0a2c10 0x7f20bc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:57.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.566+0000 7f20d7400640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f20bc0a2c10 0x7f20bc0a50d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009c90 tx=0x7f20c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:46:57.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.570+0000 7f20cfe00640 1 -- 172.21.15.28:0/586030848 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f20c40bbc70 con 0x7f20d80759e0 2024-06-06T08:46:57.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.778+0000 7f20dd200640 1 -- 172.21.15.28:0/586030848 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f20d80625a0 con 0x7f20d80759e0 2024-06-06T08:46:57.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.779+0000 7f20cfe00640 1 -- 172.21.15.28:0/586030848 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7f20c40bff70 con 0x7f20d80759e0 2024-06-06T08:46:57.778 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-06-06T08:46:57.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 -- 172.21.15.28:0/586030848 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f20bc0a2c10 msgr2=0x7f20bc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:57.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f20bc0a2c10 0x7f20bc0a50d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009c90 tx=0x7f20c8005f90 comp rx=0 tx=0).stop 2024-06-06T08:46:57.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 -- 172.21.15.28:0/586030848 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20d80759e0 msgr2=0x7f20d819e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:57.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20d80759e0 0x7f20d819e6c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f20c40314e0 tx=0x7f20c4004270 comp rx=0 tx=0).stop 2024-06-06T08:46:57.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 -- 172.21.15.28:0/586030848 shutdown_connections 2024-06-06T08:46:57.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d810dde0 0x7f20d81a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20d80759e0 0x7f20d819e6c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f20bc0a2c10 0x7f20bc0a50d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 --2- 172.21.15.28:0/586030848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d8074400 0x7f20d819e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:57.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 -- 172.21.15.28:0/586030848 >> 172.21.15.28:0/586030848 conn(0x7f20d80fcd80 msgr2=0x7f20d8101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:46:57.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 -- 172.21.15.28:0/586030848 shutdown_connections 2024-06-06T08:46:57.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:57.782+0000 7f20dd200640 1 -- 172.21.15.28:0/586030848 wait complete. 2024-06-06T08:46:57.800 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-06T08:46:58.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.013+0000 7f569de00640 1 -- 172.21.15.28:0/234684533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5698075980 msgr2=0x7f5698073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:58.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.013+0000 7f569de00640 1 --2- 172.21.15.28:0/234684533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5698075980 0x7f5698073dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f568c009860 tx=0x7f568c02a3d0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.013+0000 7f569de00640 1 -- 172.21.15.28:0/234684533 shutdown_connections 2024-06-06T08:46:58.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.013+0000 7f569de00640 1 --2- 172.21.15.28:0/234684533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56981096a0 0x7f569810bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.013+0000 7f569de00640 1 --2- 172.21.15.28:0/234684533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56980743a0 0x7f5698074800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.013+0000 7f569de00640 1 --2- 172.21.15.28:0/234684533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5698075980 0x7f5698073dd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.013+0000 7f569de00640 1 -- 172.21.15.28:0/234684533 >> 172.21.15.28:0/234684533 conn(0x7f56980fcd80 msgr2=0x7f56980ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:46:58.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.013+0000 7f569de00640 1 -- 172.21.15.28:0/234684533 shutdown_connections 2024-06-06T08:46:58.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.013+0000 7f569de00640 1 -- 172.21.15.28:0/234684533 wait complete. 2024-06-06T08:46:58.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.014+0000 7f569de00640 1 Processor -- start 2024-06-06T08:46:58.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.014+0000 7f569de00640 1 -- start start 2024-06-06T08:46:58.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f569de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56980743a0 0x7f5698199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:58.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f569de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5698075980 0x7f569819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:58.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f569de00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56981096a0 0x7f56981a1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:58.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f569de00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f569810f660 con 0x7f56981096a0 2024-06-06T08:46:58.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f569de00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f569810f4e0 con 0x7f5698075980 2024-06-06T08:46:58.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f569de00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f569810f7e0 con 0x7f56980743a0 2024-06-06T08:46:58.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f569ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56980743a0 0x7f5698199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:58.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f5697e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5698075980 0x7f569819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:58.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f569d400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56981096a0 0x7f56981a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:58.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f569ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56980743a0 0x7f5698199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:35254/0 (socket says 172.21.15.28:35254) 2024-06-06T08:46:58.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f569ca00640 1 -- 172.21.15.28:0/845312481 learned_addr learned my addr 172.21.15.28:0/845312481 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:46:58.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.015+0000 7f5697e00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5698075980 0x7f569819a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:51124/0 (socket says 172.21.15.28:51124) 2024-06-06T08:46:58.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.016+0000 7f5697e00640 1 -- 172.21.15.28:0/845312481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56980743a0 msgr2=0x7f5698199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:58.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.016+0000 7f5697e00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56980743a0 0x7f5698199d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.016+0000 7f5697e00640 1 -- 172.21.15.28:0/845312481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56981096a0 msgr2=0x7f56981a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:58.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.016+0000 7f5697e00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56981096a0 0x7f56981a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.016+0000 7f5697e00640 1 -- 172.21.15.28:0/845312481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56981a1930 con 0x7f5698075980 2024-06-06T08:46:58.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.016+0000 7f5697e00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5698075980 0x7f569819a260 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f568400e9f0 tx=0x7f568400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:46:58.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.016+0000 7f5695600640 1 -- 172.21.15.28:0/845312481 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568400ccc0 con 0x7f5698075980 2024-06-06T08:46:58.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.016+0000 7f5695600640 1 -- 172.21.15.28:0/845312481 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5684010910 con 0x7f5698075980 2024-06-06T08:46:58.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.016+0000 7f5695600640 1 -- 172.21.15.28:0/845312481 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684018960 con 0x7f5698075980 2024-06-06T08:46:58.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.016+0000 7f569de00640 1 -- 172.21.15.28:0/845312481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56981a1c20 con 0x7f5698075980 2024-06-06T08:46:58.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.016+0000 7f569de00640 1 -- 172.21.15.28:0/845312481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56981a2120 con 0x7f5698075980 2024-06-06T08:46:58.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.017+0000 7f569de00640 1 -- 172.21.15.28:0/845312481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5698108460 con 0x7f5698075980 2024-06-06T08:46:58.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.020+0000 7f5695600640 1 -- 172.21.15.28:0/845312481 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5684010ac0 con 0x7f5698075980 2024-06-06T08:46:58.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.022+0000 7f5695600640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56800a2c10 0x7f56800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:58.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.022+0000 7f5695600640 1 -- 172.21.15.28:0/845312481 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f56840cf870 con 0x7f5698075980 2024-06-06T08:46:58.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.022+0000 7f569ca00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56800a2c10 0x7f56800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:58.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.023+0000 7f569ca00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56800a2c10 0x7f56800a50d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f568c0095f0 tx=0x7f568c030ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:46:58.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.024+0000 7f5695600640 1 -- 172.21.15.28:0/845312481 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f568409c0a0 con 0x7f5698075980 2024-06-06T08:46:58.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.231+0000 7f569de00640 1 -- 172.21.15.28:0/845312481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f569802d5d0 con 0x7f5698075980 2024-06-06T08:46:58.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.232+0000 7f5695600640 1 -- 172.21.15.28:0/845312481 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7f569802d5d0 con 0x7f5698075980 2024-06-06T08:46:58.230 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2024-06-06T08:46:58.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.234+0000 7f569de00640 1 -- 172.21.15.28:0/845312481 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56800a2c10 msgr2=0x7f56800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:58.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.234+0000 7f569de00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56800a2c10 0x7f56800a50d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f568c0095f0 tx=0x7f568c030ab0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.234+0000 7f569de00640 1 -- 172.21.15.28:0/845312481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5698075980 msgr2=0x7f569819a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:58.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.234+0000 7f569de00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5698075980 0x7f569819a260 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f568400e9f0 tx=0x7f568400eeb0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.235+0000 7f569de00640 1 -- 172.21.15.28:0/845312481 shutdown_connections 2024-06-06T08:46:58.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.235+0000 7f569de00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56981096a0 0x7f56981a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.235+0000 7f569de00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f56800a2c10 0x7f56800a50d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.235+0000 7f569de00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5698075980 0x7f569819a260 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.235+0000 7f569de00640 1 --2- 172.21.15.28:0/845312481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56980743a0 0x7f5698199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.235+0000 7f569de00640 1 -- 172.21.15.28:0/845312481 >> 172.21.15.28:0/845312481 conn(0x7f56980fcd80 msgr2=0x7f5698105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:46:58.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.235+0000 7f569de00640 1 -- 172.21.15.28:0/845312481 shutdown_connections 2024-06-06T08:46:58.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.235+0000 7f569de00640 1 -- 172.21.15.28:0/845312481 wait complete. 2024-06-06T08:46:58.250 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:57 smithi028 ceph-mon[31564]: pgmap v540: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 293 KiB/s wr, 79 op/s 2024-06-06T08:46:58.250 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:57 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1545239260' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T08:46:58.250 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:57 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/586030848' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T08:46:58.253 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-06-06T08:46:58.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:57 smithi037 ceph-mon[36609]: pgmap v540: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 293 KiB/s wr, 79 op/s 2024-06-06T08:46:58.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:57 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1545239260' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T08:46:58.314 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:57 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/586030848' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T08:46:58.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:57 smithi059 ceph-mon[36684]: pgmap v540: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 293 KiB/s wr, 79 op/s 2024-06-06T08:46:58.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:57 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1545239260' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T08:46:58.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:57 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/586030848' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T08:46:58.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.470+0000 7f910be00640 1 -- 172.21.15.28:0/1254326291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c1075c0 msgr2=0x7f910c109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.470+0000 7f910be00640 1 --2- 172.21.15.28:0/1254326291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c1075c0 0x7f910c109a10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9104009900 tx=0x7f910402a400 comp rx=0 tx=0).stop 2024-06-06T08:46:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.470+0000 7f910be00640 1 -- 172.21.15.28:0/1254326291 shutdown_connections 2024-06-06T08:46:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.470+0000 7f910be00640 1 --2- 172.21.15.28:0/1254326291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c1075c0 0x7f910c109a10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.470+0000 7f910be00640 1 --2- 172.21.15.28:0/1254326291 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f910c104c90 0x7f910c107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.470+0000 7f910be00640 1 --2- 172.21.15.28:0/1254326291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f910c102360 0x7f910c104750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.470+0000 7f910be00640 1 -- 172.21.15.28:0/1254326291 >> 172.21.15.28:0/1254326291 conn(0x7f910c0fbd70 msgr2=0x7f910c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:46:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.470+0000 7f910be00640 1 -- 172.21.15.28:0/1254326291 shutdown_connections 2024-06-06T08:46:58.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.470+0000 7f910be00640 1 -- 172.21.15.28:0/1254326291 wait complete. 2024-06-06T08:46:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.471+0000 7f910be00640 1 Processor -- start 2024-06-06T08:46:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910be00640 1 -- start start 2024-06-06T08:46:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c102360 0x7f910c199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f910c104c90 0x7f910c19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f910c1075c0 0x7f910c1a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910be00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f910c10d5b0 con 0x7f910c1075c0 2024-06-06T08:46:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f910c10d430 con 0x7f910c104c90 2024-06-06T08:46:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f910c10d730 con 0x7f910c102360 2024-06-06T08:46:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c102360 0x7f910c199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c102360 0x7f910c199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:35270/0 (socket says 172.21.15.28:35270) 2024-06-06T08:46:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f910c104c90 0x7f910c19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910aa00640 1 -- 172.21.15.28:0/4159885130 learned_addr learned my addr 172.21.15.28:0/4159885130 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:46:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.472+0000 7f910b400640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f910c1075c0 0x7f910c1a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.473+0000 7f910a000640 1 -- 172.21.15.28:0/4159885130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c102360 msgr2=0x7f910c199de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.473+0000 7f910a000640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c102360 0x7f910c199de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.473+0000 7f910a000640 1 -- 172.21.15.28:0/4159885130 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f910c1075c0 msgr2=0x7f910c1a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:46:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.473+0000 7f910a000640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f910c1075c0 0x7f910c1a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:46:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.473+0000 7f910a000640 1 -- 172.21.15.28:0/4159885130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c1a1a00 con 0x7f910c104c90 2024-06-06T08:46:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.473+0000 7f910a000640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f910c104c90 0x7f910c19a320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f90f4005fd0 tx=0x7f90f400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:46:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.473+0000 7f9103400640 1 -- 172.21.15.28:0/4159885130 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4009c00 con 0x7f910c104c90 2024-06-06T08:46:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.474+0000 7f9103400640 1 -- 172.21.15.28:0/4159885130 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f4009da0 con 0x7f910c104c90 2024-06-06T08:46:58.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.474+0000 7f9103400640 1 -- 172.21.15.28:0/4159885130 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4010460 con 0x7f910c104c90 2024-06-06T08:46:58.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.474+0000 7f910be00640 1 -- 172.21.15.28:0/4159885130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910c1a1cf0 con 0x7f910c104c90 2024-06-06T08:46:58.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.474+0000 7f910be00640 1 -- 172.21.15.28:0/4159885130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910c1a2230 con 0x7f910c104c90 2024-06-06T08:46:58.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.475+0000 7f910be00640 1 -- 172.21.15.28:0/4159885130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f910c1090b0 con 0x7f910c104c90 2024-06-06T08:46:58.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.477+0000 7f9103400640 1 -- 172.21.15.28:0/4159885130 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f90f4003f50 con 0x7f910c104c90 2024-06-06T08:46:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.479+0000 7f9103400640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f90f00a2c00 0x7f90f00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:46:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.479+0000 7f9103400640 1 -- 172.21.15.28:0/4159885130 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f90f40ceb50 con 0x7f910c104c90 2024-06-06T08:46:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.479+0000 7f910aa00640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f90f00a2c00 0x7f90f00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:46:58.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.480+0000 7f910aa00640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f90f00a2c00 0x7f90f00a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f90fc011440 tx=0x7f90fc009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:46:58.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.481+0000 7f9103400640 1 -- 172.21.15.28:0/4159885130 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f90f4017020 con 0x7f910c104c90 2024-06-06T08:46:58.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.749+0000 7f910be00640 1 -- 172.21.15.28:0/4159885130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f910c02d550 con 0x7f910c104c90 2024-06-06T08:46:58.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.761+0000 7f9103400640 1 -- 172.21.15.28:0/4159885130 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740370 (secure 0 0 0) 0x7f90f409b400 con 0x7f910c104c90 2024-06-06T08:46:58.773 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:46:58.773 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:46:58.774 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 18, 2024-06-06T08:46:58.774 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.774 INFO:teuthology.orchestra.run.smithi028.stdout: "active_gid": 14152, 2024-06-06T08:46:58.774 INFO:teuthology.orchestra.run.smithi028.stdout: "active_name": "x", 2024-06-06T08:46:58.774 INFO:teuthology.orchestra.run.smithi028.stdout: "active_addrs": { 2024-06-06T08:46:58.774 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-06-06T08:46:58.774 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:58.774 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-06-06T08:46:58.775 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6800", 2024-06-06T08:46:58.775 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 2061522436 2024-06-06T08:46:58.775 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.775 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:58.775 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-06-06T08:46:58.775 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6801", 2024-06-06T08:46:58.776 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 2061522436 2024-06-06T08:46:58.776 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:58.776 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-06-06T08:46:58.776 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.776 INFO:teuthology.orchestra.run.smithi028.stdout: "active_addr": "172.21.15.28:6801/2061522436", 2024-06-06T08:46:58.776 INFO:teuthology.orchestra.run.smithi028.stdout: "active_change": "2024-06-06T08:31:40.065096+0000", 2024-06-06T08:46:58.776 INFO:teuthology.orchestra.run.smithi028.stdout: "active_mgr_features": 4540701547738038271, 2024-06-06T08:46:58.776 INFO:teuthology.orchestra.run.smithi028.stdout: "available": true, 2024-06-06T08:46:58.776 INFO:teuthology.orchestra.run.smithi028.stdout: "standbys": [ 2024-06-06T08:46:58.777 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:58.777 INFO:teuthology.orchestra.run.smithi028.stdout: "gid": 24109, 2024-06-06T08:46:58.777 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "z", 2024-06-06T08:46:58.777 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr_features": 4540701547738038271, 2024-06-06T08:46:58.777 INFO:teuthology.orchestra.run.smithi028.stdout: "available_modules": [ 2024-06-06T08:46:58.777 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:58.777 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "alerts", 2024-06-06T08:46:58.777 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:58.778 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:58.778 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:58.778 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:46:58.778 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:46:58.778 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:58.778 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.778 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.778 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:46:58.779 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.779 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.779 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.779 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How frequently to reexamine health status", 2024-06-06T08:46:58.779 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.779 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.780 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.780 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.780 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:58.780 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:58.780 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.780 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.780 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.780 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.781 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.781 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.781 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:58.781 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:58.781 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:58.781 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:58.781 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:58.782 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:58.782 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:58.782 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:58.782 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.782 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.782 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.782 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.782 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.783 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:58.783 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:58.783 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.783 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.783 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.783 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.783 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.783 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.783 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.784 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.784 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.784 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.784 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.784 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.784 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:58.784 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:58.784 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.785 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.785 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.785 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:58.785 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.785 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.785 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:58.785 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:58.786 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:58.786 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:58.786 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:58.786 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:58.786 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:58.786 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:58.786 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.787 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.787 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.787 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.787 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.787 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:58.787 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:58.788 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.788 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.788 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.788 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.788 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.788 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.788 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.788 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.789 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.789 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.789 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.789 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.789 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_destination": { 2024-06-06T08:46:58.789 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_destination", 2024-06-06T08:46:58.789 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.790 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.790 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.790 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.790 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.790 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.790 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.790 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email address to send alerts to", 2024-06-06T08:46:58.790 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.791 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.791 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.791 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.791 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_from_name": { 2024-06-06T08:46:58.791 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_from_name", 2024-06-06T08:46:58.791 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.791 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.792 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.792 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "Ceph", 2024-06-06T08:46:58.792 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.792 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.792 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.792 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email From: name", 2024-06-06T08:46:58.792 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.792 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.793 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.793 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.793 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_host": { 2024-06-06T08:46:58.793 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_host", 2024-06-06T08:46:58.793 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.793 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.793 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.794 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.794 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.794 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.794 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.794 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP server", 2024-06-06T08:46:58.794 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.794 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.795 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.795 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.795 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_password": { 2024-06-06T08:46:58.795 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_password", 2024-06-06T08:46:58.795 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.795 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.795 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.796 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.796 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.796 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.796 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.796 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Password to authenticate with", 2024-06-06T08:46:58.796 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.797 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.797 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.797 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.797 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_port": { 2024-06-06T08:46:58.797 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_port", 2024-06-06T08:46:58.797 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:58.797 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.797 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.798 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "465", 2024-06-06T08:46:58.798 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.798 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.798 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.798 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP port", 2024-06-06T08:46:58.798 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.799 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.799 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.799 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.799 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_sender": { 2024-06-06T08:46:58.799 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_sender", 2024-06-06T08:46:58.799 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.799 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.799 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.800 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.800 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.800 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.800 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.800 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP envelope sender", 2024-06-06T08:46:58.800 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.800 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.801 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.801 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.801 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_ssl": { 2024-06-06T08:46:58.801 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_ssl", 2024-06-06T08:46:58.801 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.801 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.801 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.802 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.802 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.802 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.802 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.802 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-06T08:46:58.802 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.802 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.803 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.803 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.803 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_user": { 2024-06-06T08:46:58.803 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_user", 2024-06-06T08:46:58.803 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.803 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.803 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.803 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.803 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.804 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.804 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.804 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "User to authenticate as", 2024-06-06T08:46:58.804 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.804 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.804 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.804 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:58.805 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:58.805 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.805 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:58.805 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "balancer", 2024-06-06T08:46:58.805 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:58.805 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:58.805 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:58.805 INFO:teuthology.orchestra.run.smithi028.stdout: "active": { 2024-06-06T08:46:58.806 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "active", 2024-06-06T08:46:58.806 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.806 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.806 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.806 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.806 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.806 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.807 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.807 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically balance PGs across cluster", 2024-06-06T08:46:58.807 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.807 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.807 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.807 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.807 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_time": { 2024-06-06T08:46:58.808 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_time", 2024-06-06T08:46:58.808 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.808 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.808 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.808 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0000", 2024-06-06T08:46:58.808 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.808 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.808 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.809 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "beginning time of day to automatically balance", 2024-06-06T08:46:58.809 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T08:46:58.809 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.809 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.809 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.809 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_weekday": { 2024-06-06T08:46:58.810 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_weekday", 2024-06-06T08:46:58.810 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:46:58.810 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.810 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.810 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:46:58.810 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-06-06T08:46:58.810 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-06-06T08:46:58.810 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.811 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-06T08:46:58.811 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T08:46:58.811 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.811 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.811 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.811 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_max_iterations": { 2024-06-06T08:46:58.812 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_max_iterations", 2024-06-06T08:46:58.812 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:46:58.812 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.812 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.812 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "25", 2024-06-06T08:46:58.812 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:46:58.812 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "250", 2024-06-06T08:46:58.812 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.813 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-06T08:46:58.813 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.813 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.813 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.813 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.813 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_metrics": { 2024-06-06T08:46:58.813 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_metrics", 2024-06-06T08:46:58.813 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.814 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.814 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.814 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "pgs,objects,bytes", 2024-06-06T08:46:58.814 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.814 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.814 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.814 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-06T08:46:58.814 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-06T08:46:58.815 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.815 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.815 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.815 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_step": { 2024-06-06T08:46:58.815 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_step", 2024-06-06T08:46:58.815 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:46:58.815 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.815 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.816 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.5", 2024-06-06T08:46:58.816 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0.001", 2024-06-06T08:46:58.816 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "0.999", 2024-06-06T08:46:58.816 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.816 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "aggressiveness of optimization", 2024-06-06T08:46:58.816 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-06T08:46:58.816 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.816 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.817 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.817 INFO:teuthology.orchestra.run.smithi028.stdout: "end_time": { 2024-06-06T08:46:58.817 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_time", 2024-06-06T08:46:58.817 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.817 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.817 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.817 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2359", 2024-06-06T08:46:58.817 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.817 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.818 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.818 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ending time of day to automatically balance", 2024-06-06T08:46:58.818 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T08:46:58.818 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.818 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.819 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.819 INFO:teuthology.orchestra.run.smithi028.stdout: "end_weekday": { 2024-06-06T08:46:58.819 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_weekday", 2024-06-06T08:46:58.819 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:46:58.819 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.819 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.819 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:46:58.819 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-06-06T08:46:58.819 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-06-06T08:46:58.820 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.820 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-06T08:46:58.820 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T08:46:58.820 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.820 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.820 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.820 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:58.821 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:58.821 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.821 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.821 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.821 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.821 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.821 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.821 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:58.822 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:58.822 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:58.822 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:58.822 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:58.822 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:58.822 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:58.823 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:58.823 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.823 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.823 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.823 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.823 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.823 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:58.823 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:58.824 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.824 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.824 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.824 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.824 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.825 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.825 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.825 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.825 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.825 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.825 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.825 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.826 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:58.826 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:58.826 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.826 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.826 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.826 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:58.826 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.827 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.827 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:58.827 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:58.827 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:58.827 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:58.827 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:58.827 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:58.827 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:58.828 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:58.828 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.828 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.828 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.828 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.828 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.828 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:58.828 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:58.829 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.829 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.829 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.829 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.829 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.829 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.829 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.829 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.830 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.830 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.830 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.830 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.830 INFO:teuthology.orchestra.run.smithi028.stdout: "min_score": { 2024-06-06T08:46:58.830 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_score", 2024-06-06T08:46:58.830 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:46:58.831 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.831 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.831 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:46:58.831 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.831 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.831 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.831 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-06T08:46:58.831 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.832 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.832 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.832 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.832 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-06-06T08:46:58.832 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-06-06T08:46:58.832 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.832 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.832 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.833 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "upmap", 2024-06-06T08:46:58.833 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.833 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.833 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:58.833 INFO:teuthology.orchestra.run.smithi028.stdout: "crush-compat", 2024-06-06T08:46:58.833 INFO:teuthology.orchestra.run.smithi028.stdout: "none", 2024-06-06T08:46:58.833 INFO:teuthology.orchestra.run.smithi028.stdout: "read", 2024-06-06T08:46:58.833 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap", 2024-06-06T08:46:58.834 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap-read" 2024-06-06T08:46:58.834 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:58.834 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Balancer mode", 2024-06-06T08:46:58.834 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.834 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.834 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.834 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.834 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_ids": { 2024-06-06T08:46:58.835 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_ids", 2024-06-06T08:46:58.835 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.835 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.835 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.835 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.835 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.835 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.835 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.836 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-06T08:46:58.836 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.836 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.836 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.836 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.836 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:46:58.836 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:46:58.836 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:58.837 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.837 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.837 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:46:58.837 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.837 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.837 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.837 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-06T08:46:58.837 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.838 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.838 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.838 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.838 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_deviation": { 2024-06-06T08:46:58.838 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_deviation", 2024-06-06T08:46:58.838 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:58.838 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.838 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.839 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:46:58.839 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:46:58.839 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.839 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.839 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-06T08:46:58.839 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-06T08:46:58.839 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.839 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.840 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.840 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_optimizations": { 2024-06-06T08:46:58.840 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_optimizations", 2024-06-06T08:46:58.840 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:46:58.840 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.840 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.840 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:58.841 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.841 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.841 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.841 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-06T08:46:58.841 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.841 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.841 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.841 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:58.841 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:58.842 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.842 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:58.842 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm", 2024-06-06T08:46:58.842 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:58.842 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:58.842 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:58.842 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_down_multiplier": { 2024-06-06T08:46:58.843 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_down_multiplier", 2024-06-06T08:46:58.843 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:46:58.843 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.843 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.843 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-06-06T08:46:58.843 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.843 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.843 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.843 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-06T08:46:58.844 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.844 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.844 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.844 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.844 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_refresh_rate": { 2024-06-06T08:46:58.844 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_refresh_rate", 2024-06-06T08:46:58.844 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:58.844 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.845 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.845 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "20", 2024-06-06T08:46:58.845 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.845 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.845 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.845 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-06T08:46:58.845 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.845 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.846 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.846 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.846 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_starting_port": { 2024-06-06T08:46:58.846 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_starting_port", 2024-06-06T08:46:58.846 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:58.846 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.846 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.846 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4721", 2024-06-06T08:46:58.846 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.847 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.847 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.847 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-06T08:46:58.847 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.847 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.847 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.847 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.848 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_ptrace": { 2024-06-06T08:46:58.848 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_ptrace", 2024-06-06T08:46:58.848 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.848 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.848 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.848 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.849 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.849 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.849 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.849 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-06T08:46:58.849 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-06T08:46:58.849 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.849 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.849 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.850 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_interval": { 2024-06-06T08:46:58.850 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_interval", 2024-06-06T08:46:58.850 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:58.850 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.850 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.850 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:46:58.850 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.850 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.851 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.851 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-06T08:46:58.851 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.851 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.851 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.851 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.851 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_memory_target_ratio": { 2024-06-06T08:46:58.851 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_memory_target_ratio", 2024-06-06T08:46:58.851 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:46:58.852 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.852 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.852 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.7", 2024-06-06T08:46:58.852 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.852 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.852 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.852 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-06T08:46:58.852 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.853 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.853 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.853 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.853 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm_log_destination": { 2024-06-06T08:46:58.853 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm_log_destination", 2024-06-06T08:46:58.853 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.853 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.853 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.853 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.854 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.854 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.854 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:58.854 INFO:teuthology.orchestra.run.smithi028.stdout: "file", 2024-06-06T08:46:58.854 INFO:teuthology.orchestra.run.smithi028.stdout: "file,syslog", 2024-06-06T08:46:58.854 INFO:teuthology.orchestra.run.smithi028.stdout: "syslog" 2024-06-06T08:46:58.854 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:58.854 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-06T08:46:58.855 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.855 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.855 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.855 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.855 INFO:teuthology.orchestra.run.smithi028.stdout: "cgroups_split": { 2024-06-06T08:46:58.855 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cgroups_split", 2024-06-06T08:46:58.855 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.855 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.855 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.856 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.856 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.856 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.856 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.856 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-06T08:46:58.856 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.856 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.856 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.857 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.857 INFO:teuthology.orchestra.run.smithi028.stdout: "config_checks_enabled": { 2024-06-06T08:46:58.857 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_checks_enabled", 2024-06-06T08:46:58.857 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.857 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.857 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.857 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.857 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.857 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.858 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.858 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-06T08:46:58.858 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.858 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.858 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.858 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.858 INFO:teuthology.orchestra.run.smithi028.stdout: "config_dashboard": { 2024-06-06T08:46:58.858 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_dashboard", 2024-06-06T08:46:58.859 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.859 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.859 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.859 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.859 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.859 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.859 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.859 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-06T08:46:58.859 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.860 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.860 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.860 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.860 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_alertmanager": { 2024-06-06T08:46:58.860 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_alertmanager", 2024-06-06T08:46:58.860 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.860 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.860 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.861 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-06T08:46:58.861 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.861 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.861 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.861 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:46:58.861 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.861 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.861 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.862 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.862 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_base": { 2024-06-06T08:46:58.862 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_base", 2024-06-06T08:46:58.862 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.862 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.862 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.862 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-06T08:46:58.862 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.863 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.863 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.863 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Container image name, without the tag", 2024-06-06T08:46:58.863 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.863 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.863 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.863 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.863 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_elasticsearch": { 2024-06-06T08:46:58.863 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_elasticsearch", 2024-06-06T08:46:58.864 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.864 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.864 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.864 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-06T08:46:58.864 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.864 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.864 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.864 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "elasticsearch container image", 2024-06-06T08:46:58.865 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.865 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.865 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.865 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.865 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_grafana": { 2024-06-06T08:46:58.865 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_grafana", 2024-06-06T08:46:58.865 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.865 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.866 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.866 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-06T08:46:58.866 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.866 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.866 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.866 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:46:58.866 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.866 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.866 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.867 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.867 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_haproxy": { 2024-06-06T08:46:58.867 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_haproxy", 2024-06-06T08:46:58.867 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.867 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.867 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.867 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-06T08:46:58.868 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.868 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.868 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.868 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "HAproxy container image", 2024-06-06T08:46:58.868 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.868 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.868 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.868 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.869 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_agent": { 2024-06-06T08:46:58.869 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_agent", 2024-06-06T08:46:58.869 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.869 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.869 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.869 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-06T08:46:58.869 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.869 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.870 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.870 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger agent container image", 2024-06-06T08:46:58.870 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.870 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.870 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.870 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.870 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_collector": { 2024-06-06T08:46:58.870 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_collector", 2024-06-06T08:46:58.871 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.871 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.871 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.871 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-06T08:46:58.871 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.871 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.871 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.871 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger collector container image", 2024-06-06T08:46:58.872 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.872 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.872 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.872 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.872 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_query": { 2024-06-06T08:46:58.872 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_query", 2024-06-06T08:46:58.872 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.872 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.872 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.873 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-06T08:46:58.873 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.873 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.873 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.873 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger query container image", 2024-06-06T08:46:58.873 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.873 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.874 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.874 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.874 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_keepalived": { 2024-06-06T08:46:58.874 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_keepalived", 2024-06-06T08:46:58.874 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.874 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.874 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.874 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-06T08:46:58.875 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.875 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.875 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.875 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Keepalived container image", 2024-06-06T08:46:58.875 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.875 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.875 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.875 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.875 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_loki": { 2024-06-06T08:46:58.876 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_loki", 2024-06-06T08:46:58.876 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.876 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.876 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.876 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-06T08:46:58.876 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.876 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.876 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.877 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Loki container image", 2024-06-06T08:46:58.877 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.877 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.877 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.877 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.877 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_node_exporter": { 2024-06-06T08:46:58.877 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_node_exporter", 2024-06-06T08:46:58.877 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.878 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.878 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.878 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-06T08:46:58.878 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.878 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.878 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.878 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:46:58.878 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.879 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.879 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.879 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.879 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_nvmeof": { 2024-06-06T08:46:58.879 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_nvmeof", 2024-06-06T08:46:58.879 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.879 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.879 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.879 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-06T08:46:58.880 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.880 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.880 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.880 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Nvme-of container image", 2024-06-06T08:46:58.880 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.880 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.880 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.880 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.881 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_prometheus": { 2024-06-06T08:46:58.881 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_prometheus", 2024-06-06T08:46:58.881 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.881 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.881 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.881 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-06T08:46:58.881 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.881 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.882 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.882 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:46:58.882 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.882 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.882 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.882 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.882 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_promtail": { 2024-06-06T08:46:58.882 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_promtail", 2024-06-06T08:46:58.883 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.883 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.883 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.883 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-06T08:46:58.883 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.883 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.883 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.883 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Promtail container image", 2024-06-06T08:46:58.884 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.884 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.884 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.884 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.884 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_samba": { 2024-06-06T08:46:58.884 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_samba", 2024-06-06T08:46:58.884 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.884 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.884 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.885 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-06T08:46:58.885 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.885 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.885 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.885 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Samba/SMB container image", 2024-06-06T08:46:58.885 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.885 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.885 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.886 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.886 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_snmp_gateway": { 2024-06-06T08:46:58.886 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_snmp_gateway", 2024-06-06T08:46:58.886 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.886 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.886 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.886 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-06T08:46:58.887 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.887 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.887 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.887 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SNMP Gateway container image", 2024-06-06T08:46:58.887 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.887 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.887 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.887 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.888 INFO:teuthology.orchestra.run.smithi028.stdout: "container_init": { 2024-06-06T08:46:58.888 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_init", 2024-06-06T08:46:58.888 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.888 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.888 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.888 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.888 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.888 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.889 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.889 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Run podman/docker with `--init`", 2024-06-06T08:46:58.889 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.889 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.889 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.889 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.889 INFO:teuthology.orchestra.run.smithi028.stdout: "daemon_cache_timeout": { 2024-06-06T08:46:58.889 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "daemon_cache_timeout", 2024-06-06T08:46:58.890 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:58.890 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.890 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.890 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:46:58.890 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.890 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.890 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.890 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-06T08:46:58.891 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.891 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.891 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.891 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.891 INFO:teuthology.orchestra.run.smithi028.stdout: "default_cephadm_command_timeout": { 2024-06-06T08:46:58.891 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_cephadm_command_timeout", 2024-06-06T08:46:58.891 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:58.891 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.891 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.892 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "900", 2024-06-06T08:46:58.892 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.892 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.892 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.892 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-06T08:46:58.892 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.892 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.893 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.893 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.893 INFO:teuthology.orchestra.run.smithi028.stdout: "default_registry": { 2024-06-06T08:46:58.893 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_registry", 2024-06-06T08:46:58.893 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.893 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.893 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.893 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io", 2024-06-06T08:46:58.894 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.894 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.894 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.894 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-06T08:46:58.894 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.894 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.894 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.894 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.895 INFO:teuthology.orchestra.run.smithi028.stdout: "device_cache_timeout": { 2024-06-06T08:46:58.895 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_cache_timeout", 2024-06-06T08:46:58.895 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:58.895 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.895 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.895 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1800", 2024-06-06T08:46:58.895 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.895 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.896 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.896 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache device inventory", 2024-06-06T08:46:58.896 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.896 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.896 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.896 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.896 INFO:teuthology.orchestra.run.smithi028.stdout: "device_enhanced_scan": { 2024-06-06T08:46:58.896 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_enhanced_scan", 2024-06-06T08:46:58.897 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.897 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.897 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.897 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.897 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.897 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.897 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.897 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-06T08:46:58.898 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.898 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.898 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.898 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.898 INFO:teuthology.orchestra.run.smithi028.stdout: "facts_cache_timeout": { 2024-06-06T08:46:58.898 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "facts_cache_timeout", 2024-06-06T08:46:58.898 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:58.898 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.899 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.899 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:46:58.899 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.899 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.899 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.899 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache host facts data", 2024-06-06T08:46:58.899 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.899 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.900 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.900 INFO:teuthology.orchestra.run.smithi028.stdout: "grafana_dashboards_path": { 2024-06-06T08:46:58.900 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "grafana_dashboards_path", 2024-06-06T08:46:58.900 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.900 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.900 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.900 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-06T08:46:58.901 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.901 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.901 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.901 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-06T08:46:58.901 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.901 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.901 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.901 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.902 INFO:teuthology.orchestra.run.smithi028.stdout: "host_check_interval": { 2024-06-06T08:46:58.902 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "host_check_interval", 2024-06-06T08:46:58.902 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:58.902 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.902 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.902 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:46:58.902 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.902 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.903 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.903 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to perform a host check", 2024-06-06T08:46:58.903 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.903 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.903 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.903 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.903 INFO:teuthology.orchestra.run.smithi028.stdout: "hw_monitoring": { 2024-06-06T08:46:58.903 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hw_monitoring", 2024-06-06T08:46:58.904 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.904 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.904 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.904 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.904 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.904 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.904 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.904 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-06T08:46:58.905 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.905 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.905 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.905 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.905 INFO:teuthology.orchestra.run.smithi028.stdout: "inventory_list_all": { 2024-06-06T08:46:58.905 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "inventory_list_all", 2024-06-06T08:46:58.905 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.905 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.906 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.906 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.906 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.906 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.906 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.906 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-06T08:46:58.906 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.906 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.907 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.907 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.907 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:58.907 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:58.907 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.907 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.907 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.907 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.907 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.908 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.908 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:58.908 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:58.908 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:58.908 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:58.908 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:58.908 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:58.908 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:58.909 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:58.909 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.909 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.909 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.909 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.909 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.909 INFO:teuthology.orchestra.run.smithi028.stdout: "log_refresh_metadata": { 2024-06-06T08:46:58.909 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_refresh_metadata", 2024-06-06T08:46:58.910 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.910 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.910 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.910 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.910 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.910 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.910 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.910 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-06T08:46:58.911 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.911 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.911 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.911 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.911 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:58.911 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:58.911 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.911 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.912 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.912 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.912 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.912 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.912 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.912 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-06T08:46:58.912 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.912 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.913 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.913 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.913 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:58.913 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:58.913 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.913 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.913 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.913 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:58.913 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.914 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.914 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:58.914 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:58.914 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:58.914 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:58.914 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:58.914 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:58.914 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:58.915 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:58.915 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.915 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.915 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.915 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.915 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.915 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:58.915 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:58.916 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.916 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.916 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.916 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.916 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.916 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.916 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.917 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.917 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.917 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.917 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.917 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.917 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-06T08:46:58.917 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-06T08:46:58.917 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.918 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.918 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.918 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.918 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.918 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.918 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.918 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-06T08:46:58.918 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.919 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.919 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.919 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.919 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-06T08:46:58.919 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-06T08:46:58.919 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.919 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.919 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.920 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "*", 2024-06-06T08:46:58.920 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.920 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.920 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.920 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-06T08:46:58.920 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.920 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.920 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.920 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.921 INFO:teuthology.orchestra.run.smithi028.stdout: "max_count_per_host": { 2024-06-06T08:46:58.921 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_count_per_host", 2024-06-06T08:46:58.921 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:58.921 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.921 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.921 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:58.921 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.921 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.922 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.922 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of daemons per service per host", 2024-06-06T08:46:58.922 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.922 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.922 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.922 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.922 INFO:teuthology.orchestra.run.smithi028.stdout: "max_osd_draining_count": { 2024-06-06T08:46:58.922 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_osd_draining_count", 2024-06-06T08:46:58.923 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:58.923 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.923 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.923 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:58.923 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.923 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.923 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.924 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-06T08:46:58.924 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.924 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.924 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.924 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.924 INFO:teuthology.orchestra.run.smithi028.stdout: "migration_current": { 2024-06-06T08:46:58.924 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "migration_current", 2024-06-06T08:46:58.924 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:58.924 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.925 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.925 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.925 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.925 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.925 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.925 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "internal - do not modify", 2024-06-06T08:46:58.925 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.925 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.926 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.926 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.926 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-06-06T08:46:58.926 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-06-06T08:46:58.926 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.926 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.926 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.926 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "root", 2024-06-06T08:46:58.927 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.927 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.927 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:58.927 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm-package", 2024-06-06T08:46:58.927 INFO:teuthology.orchestra.run.smithi028.stdout: "root" 2024-06-06T08:46:58.927 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:58.927 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "mode for remote execution of cephadm", 2024-06-06T08:46:58.927 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.927 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.928 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.928 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.928 INFO:teuthology.orchestra.run.smithi028.stdout: "oob_default_addr": { 2024-06-06T08:46:58.928 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "oob_default_addr", 2024-06-06T08:46:58.928 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.928 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.928 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.928 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "169.254.1.1", 2024-06-06T08:46:58.929 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.929 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.929 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.929 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-06T08:46:58.929 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.929 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.929 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.929 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.929 INFO:teuthology.orchestra.run.smithi028.stdout: "prometheus_alerts_path": { 2024-06-06T08:46:58.930 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus_alerts_path", 2024-06-06T08:46:58.930 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.930 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.930 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.930 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-06T08:46:58.930 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.930 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.931 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.931 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-06T08:46:58.931 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.931 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.931 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.931 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.931 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_insecure": { 2024-06-06T08:46:58.931 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_insecure", 2024-06-06T08:46:58.932 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.932 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.932 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.932 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.932 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.932 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.932 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.933 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-06T08:46:58.933 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.933 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.933 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.933 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.933 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_password": { 2024-06-06T08:46:58.933 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_password", 2024-06-06T08:46:58.933 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.933 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.934 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.934 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.934 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.934 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.934 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.934 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-06T08:46:58.934 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.934 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.935 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.935 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.935 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_url": { 2024-06-06T08:46:58.935 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_url", 2024-06-06T08:46:58.935 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.935 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.935 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.935 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.936 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.936 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.936 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.936 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-06T08:46:58.936 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.936 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.936 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.936 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.937 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_username": { 2024-06-06T08:46:58.937 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_username", 2024-06-06T08:46:58.937 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.937 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.937 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.937 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.937 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.937 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.938 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.938 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-06T08:46:58.938 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.938 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.938 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.938 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.938 INFO:teuthology.orchestra.run.smithi028.stdout: "secure_monitoring_stack": { 2024-06-06T08:46:58.938 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "secure_monitoring_stack", 2024-06-06T08:46:58.939 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.939 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.939 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.939 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.939 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.939 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.939 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.939 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-06T08:46:58.940 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.940 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.940 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.940 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.940 INFO:teuthology.orchestra.run.smithi028.stdout: "service_discovery_port": { 2024-06-06T08:46:58.940 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "service_discovery_port", 2024-06-06T08:46:58.940 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:58.940 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.941 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.941 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8765", 2024-06-06T08:46:58.941 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.941 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.941 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.941 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "cephadm service discovery port", 2024-06-06T08:46:58.941 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.941 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.942 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.942 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.942 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_config_file": { 2024-06-06T08:46:58.942 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_config_file", 2024-06-06T08:46:58.942 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.942 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.942 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.942 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.943 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.943 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.943 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.943 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-06T08:46:58.943 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.943 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.943 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.945 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.945 INFO:teuthology.orchestra.run.smithi028.stdout: "use_agent": { 2024-06-06T08:46:58.945 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_agent", 2024-06-06T08:46:58.945 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.945 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.946 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.946 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.946 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.946 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.946 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.946 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-06T08:46:58.946 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.946 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.947 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.947 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.947 INFO:teuthology.orchestra.run.smithi028.stdout: "use_repo_digest": { 2024-06-06T08:46:58.947 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_repo_digest", 2024-06-06T08:46:58.947 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.947 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.947 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.947 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.948 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.948 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.948 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.948 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-06T08:46:58.948 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.948 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.948 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.948 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.949 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_failed_host_check": { 2024-06-06T08:46:58.949 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_failed_host_check", 2024-06-06T08:46:58.949 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.949 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.949 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.949 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.949 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.949 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.950 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.950 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if the host check fails", 2024-06-06T08:46:58.950 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.950 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.950 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.950 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.950 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_daemons": { 2024-06-06T08:46:58.950 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_daemons", 2024-06-06T08:46:58.951 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.951 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.951 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.951 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.951 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.951 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.951 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.952 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-06T08:46:58.952 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.952 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.952 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.952 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.952 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_hosts": { 2024-06-06T08:46:58.952 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_hosts", 2024-06-06T08:46:58.952 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.952 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.953 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.953 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.953 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.953 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.953 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.953 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-06T08:46:58.953 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.953 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.954 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.954 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:58.954 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:58.954 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.954 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:58.954 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crash", 2024-06-06T08:46:58.954 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:58.955 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:58.955 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:58.955 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:58.955 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:58.955 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.955 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.955 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.955 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.955 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.956 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.956 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:58.956 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:58.956 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:58.956 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:58.956 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:58.956 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:58.956 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:58.957 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:58.957 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.957 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.957 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.957 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.957 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.957 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:58.957 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:58.957 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.958 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.958 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.958 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.958 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.958 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.958 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.958 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.958 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.959 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.959 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.959 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.959 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:58.959 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:58.959 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.959 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.959 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.959 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:58.960 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.960 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.960 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:58.960 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:58.960 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:58.960 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:58.960 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:58.960 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:58.961 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:58.961 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:58.961 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.961 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.961 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.961 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.961 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.961 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:58.961 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:58.962 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.962 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.962 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.962 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.962 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.962 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.962 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.962 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.963 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.963 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.963 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.963 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.963 INFO:teuthology.orchestra.run.smithi028.stdout: "retain_interval": { 2024-06-06T08:46:58.963 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retain_interval", 2024-06-06T08:46:58.963 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:58.963 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.963 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.964 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "31536000", 2024-06-06T08:46:58.964 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.964 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.964 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.964 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-06T08:46:58.964 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.964 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.964 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.965 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.965 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_recent_interval": { 2024-06-06T08:46:58.965 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_recent_interval", 2024-06-06T08:46:58.965 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:58.965 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.965 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:58.965 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1209600", 2024-06-06T08:46:58.965 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.965 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.966 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.966 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-06T08:46:58.966 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.966 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.966 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.966 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:58.966 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:58.966 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.967 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:58.967 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dashboard", 2024-06-06T08:46:58.967 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:58.967 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:58.967 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:58.967 INFO:teuthology.orchestra.run.smithi028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-06T08:46:58.967 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-06T08:46:58.967 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:58.967 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.968 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.968 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:58.968 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.968 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.968 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.968 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.968 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.968 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.969 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.969 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.969 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_HOST": { 2024-06-06T08:46:58.969 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-06T08:46:58.969 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.969 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.969 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.969 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.969 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.970 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.970 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.970 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.970 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.970 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.970 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.970 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.970 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-06T08:46:58.971 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-06T08:46:58.971 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.971 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.971 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.971 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.971 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.971 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.972 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.972 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.972 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.972 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.972 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.972 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.972 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_ENABLED": { 2024-06-06T08:46:58.972 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_ENABLED", 2024-06-06T08:46:58.973 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.973 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.973 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.973 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:58.973 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.973 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.973 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.973 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.974 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.974 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.974 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.974 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.974 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-06T08:46:58.974 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-06T08:46:58.974 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.974 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.975 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.975 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.975 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.975 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.975 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.975 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.975 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.975 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.975 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.976 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.976 INFO:teuthology.orchestra.run.smithi028.stdout: "ENABLE_BROWSABLE_API": { 2024-06-06T08:46:58.976 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-06T08:46:58.976 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.976 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.976 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.976 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.976 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.977 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.977 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.977 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.977 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.977 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.977 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.977 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.977 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-06T08:46:58.978 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-06T08:46:58.978 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.978 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.978 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.978 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.978 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.978 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.978 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.979 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.979 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.979 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.979 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.979 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.979 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-06T08:46:58.979 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-06T08:46:58.980 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.980 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.980 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.980 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.980 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.980 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.980 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.980 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.980 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.981 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.981 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.981 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.981 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-06T08:46:58.981 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-06T08:46:58.981 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.981 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.981 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.982 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.982 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.982 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.982 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.982 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.982 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.982 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.982 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.983 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.983 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-06T08:46:58.983 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-06T08:46:58.983 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.983 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.983 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.983 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.983 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.983 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.984 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.984 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.984 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.984 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.984 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.984 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.984 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-06T08:46:58.984 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-06T08:46:58.985 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.985 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.985 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.985 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.985 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.985 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.985 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.985 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.986 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.986 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.986 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.986 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.986 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-06T08:46:58.986 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-06T08:46:58.986 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.986 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-06T08:46:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-06T08:46:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.989 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.989 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.989 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.989 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.989 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.989 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.989 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.989 INFO:teuthology.orchestra.run.smithi028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-06T08:46:58.989 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-06T08:46:58.990 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.990 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.990 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.990 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.990 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.990 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.990 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.990 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.991 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.991 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.991 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.991 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.991 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_PASSWORD": { 2024-06-06T08:46:58.991 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-06T08:46:58.991 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.991 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.991 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.991 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-06-06T08:46:58.992 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.992 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.992 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.992 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.992 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.992 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.992 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.992 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.993 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-06T08:46:58.993 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-06T08:46:58.993 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:58.993 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.993 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.993 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:58.993 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.993 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.994 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.994 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.994 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.994 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.994 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.994 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.994 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_URL": { 2024-06-06T08:46:58.994 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_URL", 2024-06-06T08:46:58.995 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.995 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.995 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.995 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.995 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.995 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.995 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.995 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.996 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.996 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.996 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.996 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.996 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_USERNAME": { 2024-06-06T08:46:58.996 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-06T08:46:58.996 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.996 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.996 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.997 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-06-06T08:46:58.997 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.997 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.997 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.997 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.997 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.997 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.997 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.998 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.998 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-06T08:46:58.998 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-06T08:46:58.998 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:58.998 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:58.998 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:58.998 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:58.998 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:58.999 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:58.999 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:58.999 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:58.999 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:58.999 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:58.999 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:58.999 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:58.999 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-06T08:46:59.000 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-06T08:46:59.000 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.000 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.000 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.000 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.000 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.000 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.000 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.001 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.001 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.001 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.001 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.001 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.001 INFO:teuthology.orchestra.run.smithi028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-06T08:46:59.001 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-06T08:46:59.001 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.002 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.002 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.002 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.002 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.002 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.002 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.002 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.002 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.002 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.003 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.003 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.003 INFO:teuthology.orchestra.run.smithi028.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-06T08:46:59.003 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-06T08:46:59.003 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.003 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.003 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.003 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.004 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.004 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.004 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.004 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.004 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.004 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.004 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.004 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.005 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_HOST": { 2024-06-06T08:46:59.005 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-06T08:46:59.005 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.005 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.005 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.005 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.005 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.005 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.006 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.006 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.006 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.006 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.006 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.006 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.006 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-06T08:46:59.006 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-06T08:46:59.006 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.007 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.007 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.007 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.007 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.007 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.007 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.007 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.007 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.008 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.008 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.008 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.008 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-06T08:46:59.008 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-06T08:46:59.008 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.008 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.008 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.009 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.009 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.009 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.009 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.009 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.009 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.009 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.009 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.010 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.010 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-06T08:46:59.010 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-06T08:46:59.010 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.010 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.010 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.010 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.010 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.011 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.011 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.011 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.011 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.011 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.011 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.011 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.011 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-06T08:46:59.012 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-06T08:46:59.012 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.012 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.012 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.012 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.012 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.012 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.012 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.013 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.013 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.013 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.013 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.013 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.013 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-06T08:46:59.013 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-06T08:46:59.013 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.013 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.014 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.014 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.014 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.014 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.014 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.014 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.014 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.014 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.015 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.015 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.015 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-06T08:46:59.015 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-06T08:46:59.015 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.015 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.015 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.015 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.016 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.016 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.016 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.016 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.016 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.016 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.016 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.016 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.016 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-06T08:46:59.017 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-06T08:46:59.017 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.017 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.017 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.017 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.017 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.017 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.017 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.017 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.018 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.018 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.018 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.018 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.018 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-06T08:46:59.018 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-06T08:46:59.018 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.019 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.019 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.019 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.019 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.019 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.019 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.019 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.019 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.020 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.020 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.020 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.020 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_ENABLED": { 2024-06-06T08:46:59.020 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-06T08:46:59.020 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.020 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.020 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.020 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.021 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.021 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.021 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.021 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.021 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.021 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.021 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.021 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.022 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-06T08:46:59.022 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-06T08:46:59.022 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.022 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.022 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.022 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-06T08:46:59.022 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.022 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.023 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.023 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.023 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.023 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.023 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.023 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.023 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-06T08:46:59.023 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-06T08:46:59.024 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.024 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.024 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.024 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:59.024 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.024 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.024 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.024 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.025 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.025 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.025 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.025 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.025 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-06T08:46:59.025 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-06T08:46:59.025 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.025 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.025 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.026 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8", 2024-06-06T08:46:59.026 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.026 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.026 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.026 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.026 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.026 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.026 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.027 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.027 INFO:teuthology.orchestra.run.smithi028.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-06T08:46:59.027 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-06T08:46:59.027 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.027 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.027 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.027 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "45", 2024-06-06T08:46:59.027 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.028 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.028 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.028 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.028 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.028 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.028 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.028 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.028 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ACCESS_KEY": { 2024-06-06T08:46:59.029 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-06T08:46:59.029 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.029 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.029 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.029 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.029 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.029 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.029 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.030 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.030 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.030 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.030 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.030 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.030 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-06T08:46:59.030 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-06T08:46:59.031 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.031 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.031 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.031 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-06-06T08:46:59.031 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.031 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.031 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.031 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.032 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.032 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.032 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.032 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.032 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SECRET_KEY": { 2024-06-06T08:46:59.032 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-06T08:46:59.032 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.032 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.033 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.033 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.033 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.033 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.033 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.033 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.033 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.033 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.034 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.034 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.034 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SSL_VERIFY": { 2024-06-06T08:46:59.034 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-06T08:46:59.034 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.034 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.034 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.034 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.035 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.035 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.035 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.035 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.035 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.035 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.035 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.035 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.036 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-06T08:46:59.036 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-06T08:46:59.036 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.036 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.036 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.036 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:46:59.036 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.036 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.036 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.037 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.037 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.037 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.037 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.037 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.037 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-06T08:46:59.037 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-06T08:46:59.037 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.038 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.038 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.038 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:59.038 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.038 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.038 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.038 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.038 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.039 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.039 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.039 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.039 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-06T08:46:59.039 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-06T08:46:59.039 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.039 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.039 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.040 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:46:59.040 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.040 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.040 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.040 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.040 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.040 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.040 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.040 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.041 INFO:teuthology.orchestra.run.smithi028.stdout: "cross_origin_url": { 2024-06-06T08:46:59.041 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cross_origin_url", 2024-06-06T08:46:59.041 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.041 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.041 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.041 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.041 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.041 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.042 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.042 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.042 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.042 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.042 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.042 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.042 INFO:teuthology.orchestra.run.smithi028.stdout: "crt_file": { 2024-06-06T08:46:59.042 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crt_file", 2024-06-06T08:46:59.042 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.043 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.044 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.044 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.044 INFO:teuthology.orchestra.run.smithi028.stdout: "debug": { 2024-06-06T08:46:59.044 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "debug", 2024-06-06T08:46:59.044 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.044 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.044 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.044 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.045 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.045 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.045 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.045 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable/disable debug options", 2024-06-06T08:46:59.045 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.045 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.045 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.045 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.046 INFO:teuthology.orchestra.run.smithi028.stdout: "jwt_token_ttl": { 2024-06-06T08:46:59.046 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "jwt_token_ttl", 2024-06-06T08:46:59.046 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.046 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.046 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.046 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "28800", 2024-06-06T08:46:59.046 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.046 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.046 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.047 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.047 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.047 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.047 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.047 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.047 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-06-06T08:46:59.047 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-06-06T08:46:59.047 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.048 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.048 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.048 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.048 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.048 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.048 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.048 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.048 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.049 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.049 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.049 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.049 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.049 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.049 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.049 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.049 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.049 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.050 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.050 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.050 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.050 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.050 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.050 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.050 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.050 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.051 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.051 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.051 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.051 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.051 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.051 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.051 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.051 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.052 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.052 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.052 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.052 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.052 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.052 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.052 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.052 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.052 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.053 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.053 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.053 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.053 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.053 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.053 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.053 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.053 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.053 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.054 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.054 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.054 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.054 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.054 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.054 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.054 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.054 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.055 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.055 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.055 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.055 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.055 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.055 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.055 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.055 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.056 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.056 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.056 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.056 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.056 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.056 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.056 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.056 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.057 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.057 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.057 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.057 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.057 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.057 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.057 INFO:teuthology.orchestra.run.smithi028.stdout: "motd": { 2024-06-06T08:46:59.057 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "motd", 2024-06-06T08:46:59.058 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.058 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.058 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.058 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.058 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.058 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.058 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.058 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "The message of the day", 2024-06-06T08:46:59.059 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.059 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.059 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.059 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.059 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect_resolve_ip_addr": { 2024-06-06T08:46:59.059 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "redirect_resolve_ip_addr", 2024-06-06T08:46:59.059 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.059 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.060 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.060 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.060 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.060 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.060 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.060 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.060 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.060 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.060 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.060 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.061 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-06-06T08:46:59.061 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-06-06T08:46:59.061 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.061 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.061 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.061 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-06-06T08:46:59.061 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.062 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.062 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.062 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.062 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.062 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.062 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.062 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.062 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-06-06T08:46:59.063 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-06-06T08:46:59.063 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.063 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.063 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.063 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8080", 2024-06-06T08:46:59.063 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.063 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.063 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.064 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.064 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.064 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.064 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.064 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.064 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-06-06T08:46:59.064 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-06-06T08:46:59.064 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.065 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.065 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.065 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.065 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.065 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.065 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.065 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.065 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.065 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.066 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.066 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.066 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl_server_port": { 2024-06-06T08:46:59.066 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl_server_port", 2024-06-06T08:46:59.066 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.066 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.066 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.066 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8443", 2024-06-06T08:46:59.067 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.067 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.067 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.067 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.067 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.067 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.067 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.068 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.068 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-06-06T08:46:59.068 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-06-06T08:46:59.068 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.068 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.068 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.068 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "redirect", 2024-06-06T08:46:59.068 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.069 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.069 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.069 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.069 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect" 2024-06-06T08:46:59.069 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.069 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.069 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.069 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.069 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.070 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.070 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-06-06T08:46:59.070 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-06-06T08:46:59.070 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.070 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.070 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.070 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-06-06T08:46:59.071 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-06-06T08:46:59.071 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-06-06T08:46:59.071 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.071 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.071 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.071 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.071 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.071 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.071 INFO:teuthology.orchestra.run.smithi028.stdout: "url_prefix": { 2024-06-06T08:46:59.072 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url_prefix", 2024-06-06T08:46:59.072 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.072 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.072 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.072 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.072 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.072 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.072 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.073 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.073 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.073 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.073 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.073 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.073 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.073 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.073 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.074 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "devicehealth", 2024-06-06T08:46:59.074 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.074 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.074 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.074 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_monitoring": { 2024-06-06T08:46:59.074 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_monitoring", 2024-06-06T08:46:59.074 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.074 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.075 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.075 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.075 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.075 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.075 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.075 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "monitor device health metrics", 2024-06-06T08:46:59.075 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.075 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.075 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.076 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.076 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.076 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.076 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.076 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.076 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.076 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.077 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.077 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.077 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.077 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.077 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.077 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.077 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.077 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.077 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.078 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.078 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.078 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.078 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.078 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.078 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.078 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.079 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.079 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.079 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.079 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.079 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.079 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.079 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.079 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.079 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.080 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.080 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.080 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.080 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.080 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.080 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.080 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.080 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.081 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.081 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.081 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.081 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.081 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.081 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.081 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.081 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.082 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.082 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.082 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.082 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.082 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.082 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.082 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.082 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.083 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.083 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.083 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.083 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.083 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.083 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.083 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.084 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.084 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.084 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.084 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.084 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.084 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.084 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.084 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.084 INFO:teuthology.orchestra.run.smithi028.stdout: "mark_out_threshold": { 2024-06-06T08:46:59.085 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mark_out_threshold", 2024-06-06T08:46:59.085 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.085 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.085 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.085 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2419200", 2024-06-06T08:46:59.085 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.085 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.085 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.086 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-06T08:46:59.086 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.086 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.086 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.086 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.086 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_name": { 2024-06-06T08:46:59.086 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_name", 2024-06-06T08:46:59.086 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.087 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.087 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.087 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "device_health_metrics", 2024-06-06T08:46:59.087 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.087 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.087 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.087 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-06T08:46:59.087 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.088 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.088 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.088 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.088 INFO:teuthology.orchestra.run.smithi028.stdout: "retention_period": { 2024-06-06T08:46:59.088 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retention_period", 2024-06-06T08:46:59.088 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.088 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.088 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.088 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15552000", 2024-06-06T08:46:59.089 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.089 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.089 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.089 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain device health metrics", 2024-06-06T08:46:59.089 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.089 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.089 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.089 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.090 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_frequency": { 2024-06-06T08:46:59.090 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_frequency", 2024-06-06T08:46:59.090 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.090 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.090 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.090 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-06-06T08:46:59.090 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.091 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.091 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.091 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-06T08:46:59.091 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.091 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.091 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.091 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.091 INFO:teuthology.orchestra.run.smithi028.stdout: "self_heal": { 2024-06-06T08:46:59.092 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "self_heal", 2024-06-06T08:46:59.092 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.092 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.092 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.092 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.092 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.092 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.092 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.093 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-06T08:46:59.093 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.093 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.093 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.093 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.093 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:46:59.093 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:46:59.093 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.093 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.094 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.094 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:46:59.094 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.094 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.094 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.094 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and check device health", 2024-06-06T08:46:59.094 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.094 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.095 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.095 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.095 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_threshold": { 2024-06-06T08:46:59.095 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_threshold", 2024-06-06T08:46:59.095 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.095 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.095 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.095 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7257600", 2024-06-06T08:46:59.095 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.096 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.096 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.096 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-06T08:46:59.096 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.096 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.096 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.096 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.096 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.097 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.097 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.097 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "diskprediction_local", 2024-06-06T08:46:59.097 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.097 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.097 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.097 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.097 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.098 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.098 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.098 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.098 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.098 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.098 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.098 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.098 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.098 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.099 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.099 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.099 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.099 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.099 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.099 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.099 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.099 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.100 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.100 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.100 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.100 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.100 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.100 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.100 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.100 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.101 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.101 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.101 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.101 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.101 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.101 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.101 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.101 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.102 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.102 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.102 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.102 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.102 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.102 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.102 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.102 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.102 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.103 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.103 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.103 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.103 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.103 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.103 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.103 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.103 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.104 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.104 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.104 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.104 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.104 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.104 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.104 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.104 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.104 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.105 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.105 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.105 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.105 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.105 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.105 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.105 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.105 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.106 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.106 INFO:teuthology.orchestra.run.smithi028.stdout: "predict_interval": { 2024-06-06T08:46:59.106 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predict_interval", 2024-06-06T08:46:59.106 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.106 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.106 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.106 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-06-06T08:46:59.106 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.107 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.107 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.107 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.107 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.107 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.107 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.107 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.107 INFO:teuthology.orchestra.run.smithi028.stdout: "predictor_model": { 2024-06-06T08:46:59.107 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predictor_model", 2024-06-06T08:46:59.108 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.108 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.108 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.108 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "prophetstor", 2024-06-06T08:46:59.108 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.108 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.108 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.108 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.109 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.109 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.109 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.109 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.109 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:46:59.109 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:46:59.109 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.109 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.109 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.110 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:46:59.110 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.110 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.110 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.110 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.110 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.110 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.110 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.111 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.111 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.111 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.111 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.111 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "influx", 2024-06-06T08:46:59.111 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": false, 2024-06-06T08:46:59.111 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "influxdb python module not found", 2024-06-06T08:46:59.111 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.112 INFO:teuthology.orchestra.run.smithi028.stdout: "batch_size": { 2024-06-06T08:46:59.112 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "batch_size", 2024-06-06T08:46:59.112 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.112 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.112 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.112 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5000", 2024-06-06T08:46:59.112 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.112 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.113 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.113 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-06T08:46:59.113 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.113 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.113 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.113 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.113 INFO:teuthology.orchestra.run.smithi028.stdout: "database": { 2024-06-06T08:46:59.113 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "database", 2024-06-06T08:46:59.114 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.114 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.114 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.114 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "ceph", 2024-06-06T08:46:59.114 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.114 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.114 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.114 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-06T08:46:59.115 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.115 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.115 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.115 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.115 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": { 2024-06-06T08:46:59.115 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hostname", 2024-06-06T08:46:59.115 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.115 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.116 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.116 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.116 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.116 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.116 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.116 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server hostname", 2024-06-06T08:46:59.116 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.116 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.117 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.117 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.117 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:46:59.117 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:46:59.117 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.117 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.117 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.117 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "30", 2024-06-06T08:46:59.117 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "5", 2024-06-06T08:46:59.118 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.118 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.118 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-06T08:46:59.118 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.118 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.118 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.118 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.118 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.119 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.119 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.119 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.119 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.119 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.119 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.119 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.119 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.119 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.120 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.120 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.120 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.120 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.120 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.120 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.120 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.120 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.121 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.121 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.121 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.121 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.121 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.121 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.121 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.121 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.122 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.122 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.122 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.122 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.122 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.122 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.122 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.122 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.123 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.123 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.123 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.123 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.123 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.123 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.123 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.123 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.124 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.124 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.124 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.124 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.124 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.124 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.124 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.124 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.125 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.125 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.125 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.125 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.125 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.125 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.125 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.125 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.126 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.126 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.126 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.126 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.126 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.126 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.126 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.126 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.126 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.127 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.127 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.127 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.127 INFO:teuthology.orchestra.run.smithi028.stdout: "password": { 2024-06-06T08:46:59.127 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "password", 2024-06-06T08:46:59.127 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.127 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.127 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.128 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.128 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.128 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.128 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.128 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "password of InfluxDB server user", 2024-06-06T08:46:59.128 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.128 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.128 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.128 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.129 INFO:teuthology.orchestra.run.smithi028.stdout: "port": { 2024-06-06T08:46:59.129 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "port", 2024-06-06T08:46:59.129 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.129 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.129 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.129 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8086", 2024-06-06T08:46:59.129 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.129 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.130 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.130 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server port", 2024-06-06T08:46:59.130 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.130 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.130 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.130 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.130 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-06-06T08:46:59.130 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-06-06T08:46:59.131 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.131 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.131 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.131 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "false", 2024-06-06T08:46:59.131 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.131 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.131 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.131 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T08:46:59.131 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.132 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.132 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.132 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.132 INFO:teuthology.orchestra.run.smithi028.stdout: "threads": { 2024-06-06T08:46:59.132 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threads", 2024-06-06T08:46:59.132 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.132 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.132 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.133 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:46:59.133 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:46:59.133 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "32", 2024-06-06T08:46:59.133 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.133 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-06T08:46:59.133 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.133 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.133 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.133 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.134 INFO:teuthology.orchestra.run.smithi028.stdout: "username": { 2024-06-06T08:46:59.134 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "username", 2024-06-06T08:46:59.134 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.134 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.134 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.134 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.134 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.134 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.134 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.135 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "username of InfluxDB server user", 2024-06-06T08:46:59.135 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.135 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.135 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.135 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.135 INFO:teuthology.orchestra.run.smithi028.stdout: "verify_ssl": { 2024-06-06T08:46:59.135 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "verify_ssl", 2024-06-06T08:46:59.136 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.136 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.136 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.136 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "true", 2024-06-06T08:46:59.136 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.136 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.136 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.136 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T08:46:59.136 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.137 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.137 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.137 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.137 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.137 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.137 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.137 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "insights", 2024-06-06T08:46:59.137 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.138 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.138 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.138 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.138 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.138 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.138 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.138 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.139 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.139 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.139 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.139 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.139 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.139 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.139 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.139 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.139 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.140 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.140 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.140 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.140 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.140 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.140 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.140 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.140 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.141 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.141 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.141 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.141 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.141 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.141 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.141 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.142 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.142 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.142 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.142 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.142 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.142 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.142 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.143 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.143 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.143 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.143 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.143 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.143 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.143 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.144 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.144 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.144 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.144 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.144 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.144 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.144 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.144 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.145 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.145 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.145 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.145 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.145 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.145 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.145 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.146 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.146 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.146 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.146 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.146 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.146 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.146 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.146 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.147 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.147 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.147 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.147 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.147 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.147 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.147 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.148 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "iostat", 2024-06-06T08:46:59.148 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.148 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.148 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.148 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.148 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.148 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.148 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.148 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.149 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.149 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.149 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.149 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.149 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.149 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.149 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.149 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.150 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.150 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.150 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.150 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.150 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.150 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.150 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.150 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.151 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.151 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.151 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.151 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.151 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.151 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.151 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.151 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.152 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.152 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.152 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.152 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.152 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.152 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.152 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.152 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.153 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.153 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.153 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.153 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.153 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.153 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.153 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.153 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.153 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.154 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.154 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.154 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.154 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.154 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.154 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.154 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.154 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.155 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.155 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.155 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.155 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.155 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.155 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.155 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.155 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.155 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.156 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.156 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.156 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.156 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.156 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.156 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.156 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.157 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.157 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.157 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.157 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "k8sevents", 2024-06-06T08:46:59.157 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.157 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.157 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.157 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_event_retention_days": { 2024-06-06T08:46:59.158 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ceph_event_retention_days", 2024-06-06T08:46:59.158 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.158 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.158 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.158 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7", 2024-06-06T08:46:59.158 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.158 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.158 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.159 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-06T08:46:59.159 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.159 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.159 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.159 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.159 INFO:teuthology.orchestra.run.smithi028.stdout: "config_check_secs": { 2024-06-06T08:46:59.159 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_check_secs", 2024-06-06T08:46:59.159 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.160 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.160 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.160 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:59.160 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "10", 2024-06-06T08:46:59.160 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.160 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.160 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-06T08:46:59.160 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.160 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.161 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.161 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.161 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.161 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.161 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.161 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.161 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.161 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.162 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.162 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.162 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.162 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.162 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.162 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.162 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.162 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.163 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.163 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.163 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.163 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.163 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.164 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.164 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.164 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.164 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.164 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.164 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.164 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.164 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.165 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.165 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.165 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.165 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.165 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.165 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.165 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.165 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.166 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.166 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.166 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.166 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.166 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.166 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.166 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.166 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.167 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.167 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.167 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.167 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.167 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.167 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.167 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.167 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.167 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.168 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.168 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.168 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.168 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.168 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.168 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.168 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.168 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.168 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.169 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.169 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.169 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.169 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.169 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.169 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.169 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.169 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.169 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.170 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.170 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.170 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.170 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "localpool", 2024-06-06T08:46:59.170 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.170 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.170 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.170 INFO:teuthology.orchestra.run.smithi028.stdout: "failure_domain": { 2024-06-06T08:46:59.171 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "failure_domain", 2024-06-06T08:46:59.171 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.171 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.171 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.171 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "host", 2024-06-06T08:46:59.171 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.171 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.171 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.171 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "failure domain for any created local pool", 2024-06-06T08:46:59.172 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-06T08:46:59.172 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.172 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.172 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.172 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.172 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.172 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.172 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.173 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.173 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.173 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.173 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.173 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.173 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.173 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.173 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.174 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.174 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.174 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.174 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.174 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.174 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.174 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.174 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.175 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.175 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.175 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.175 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.175 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.175 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.175 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.175 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.176 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.176 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.176 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.176 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.176 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.176 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.176 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.176 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.177 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.177 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.177 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.177 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.177 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.177 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.177 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.177 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.178 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.178 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.178 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.178 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.178 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.178 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.178 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.178 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.179 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.179 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.179 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.179 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.179 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.179 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.179 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.179 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.179 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.180 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.180 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.180 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.180 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.180 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.180 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.180 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.181 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.181 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.181 INFO:teuthology.orchestra.run.smithi028.stdout: "min_size": { 2024-06-06T08:46:59.181 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_size", 2024-06-06T08:46:59.181 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.181 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.181 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.181 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.181 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.182 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.182 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.182 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default min_size for any created local pool", 2024-06-06T08:46:59.182 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-06T08:46:59.182 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.182 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.182 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.183 INFO:teuthology.orchestra.run.smithi028.stdout: "num_rep": { 2024-06-06T08:46:59.183 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "num_rep", 2024-06-06T08:46:59.183 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.183 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.183 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.183 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3", 2024-06-06T08:46:59.183 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.183 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.184 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.184 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default replica count for any created local pool", 2024-06-06T08:46:59.184 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.184 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.184 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.184 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.184 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_num": { 2024-06-06T08:46:59.184 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_num", 2024-06-06T08:46:59.185 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.185 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.185 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.185 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "128", 2024-06-06T08:46:59.185 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.185 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.185 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.185 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default pg_num for any created local pool", 2024-06-06T08:46:59.186 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.186 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.186 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.186 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.186 INFO:teuthology.orchestra.run.smithi028.stdout: "prefix": { 2024-06-06T08:46:59.186 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prefix", 2024-06-06T08:46:59.186 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.186 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.187 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.187 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.187 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.187 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.187 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.187 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name prefix for any created local pool", 2024-06-06T08:46:59.187 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.187 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.188 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.188 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.188 INFO:teuthology.orchestra.run.smithi028.stdout: "subtree": { 2024-06-06T08:46:59.188 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "subtree", 2024-06-06T08:46:59.188 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.188 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.188 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.188 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "rack", 2024-06-06T08:46:59.189 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.189 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.189 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.189 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-06T08:46:59.189 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-06T08:46:59.189 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.189 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.189 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.190 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.190 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.190 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.190 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mds_autoscaler", 2024-06-06T08:46:59.190 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.190 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.190 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.190 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.190 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.191 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.191 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.191 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.191 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.191 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.191 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.191 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.192 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.192 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.192 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.192 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.192 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.192 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.192 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.192 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.193 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.193 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.193 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.193 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.193 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.193 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.193 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.193 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.193 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.194 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.194 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.194 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.194 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.194 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.194 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.194 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.194 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.195 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.195 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.195 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.195 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.195 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.195 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.195 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.195 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.196 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.196 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.196 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.196 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.196 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.196 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.196 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.196 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.197 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.197 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.197 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.197 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.197 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.197 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.197 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.197 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.198 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.198 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.198 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.198 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.198 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.198 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.198 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.198 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.199 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.199 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.199 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.199 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.199 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.199 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.199 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.199 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirroring", 2024-06-06T08:46:59.199 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.199 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.200 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.200 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.200 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.200 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.200 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.200 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.200 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.201 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.201 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.201 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.201 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.201 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.201 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.201 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.201 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.202 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.202 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.202 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.202 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.202 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.202 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.202 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.202 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.203 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.203 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.203 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.203 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.203 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.203 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.203 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.203 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.204 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.204 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.204 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.204 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.204 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.204 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.204 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.204 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.205 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.205 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.205 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.205 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.205 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.205 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.205 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.205 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.206 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.206 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.206 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.206 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.206 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.206 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.206 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.207 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.207 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.207 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.207 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.207 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.207 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.207 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.208 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.208 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.208 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.208 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.208 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.208 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.208 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.209 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.209 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.209 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.209 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.209 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.209 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.209 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "nfs", 2024-06-06T08:46:59.209 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.210 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.210 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.210 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.210 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.210 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.210 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.210 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.211 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.211 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.211 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.211 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.211 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.211 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.211 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.211 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.212 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.212 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.212 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.212 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.212 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.212 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.212 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.212 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.212 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.213 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.213 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.213 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.213 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.213 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.213 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.213 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.213 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.214 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.214 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.214 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.214 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.214 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.214 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.214 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.214 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.215 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.215 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.215 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.215 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.215 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.215 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.215 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.216 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.216 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.216 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.216 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.216 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.216 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.216 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.216 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.217 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.217 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.217 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.217 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.217 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.217 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.217 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.218 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.218 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.218 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.218 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.218 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.218 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.218 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.218 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.219 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.219 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.219 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.219 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.219 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.219 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-06-06T08:46:59.219 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.220 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.220 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.220 INFO:teuthology.orchestra.run.smithi028.stdout: "fail_fs": { 2024-06-06T08:46:59.220 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "fail_fs", 2024-06-06T08:46:59.220 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.220 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.220 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.220 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.220 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.221 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.221 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.221 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-06T08:46:59.221 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.221 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.221 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.221 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.221 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.222 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.222 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.222 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.222 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.222 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.222 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.222 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.222 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.223 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.223 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.223 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.223 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.223 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.223 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.223 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.223 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.223 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.224 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.224 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.224 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.224 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.224 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.224 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.224 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.224 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.225 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.225 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.225 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.225 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.225 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.225 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.225 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.225 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.226 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.226 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.226 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.226 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.226 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.226 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.226 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.227 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.227 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.227 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.227 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.227 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.227 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.227 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.228 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.228 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.228 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.228 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.228 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.228 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.228 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.228 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.229 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.229 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.229 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.229 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.229 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.229 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.229 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.230 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.230 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.230 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.230 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.230 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.230 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.230 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.231 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator": { 2024-06-06T08:46:59.231 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-06-06T08:46:59.231 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.231 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.231 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.231 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.231 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.231 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.232 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.232 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm", 2024-06-06T08:46:59.232 INFO:teuthology.orchestra.run.smithi028.stdout: "rook", 2024-06-06T08:46:59.232 INFO:teuthology.orchestra.run.smithi028.stdout: "test_orchestrator" 2024-06-06T08:46:59.232 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.232 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Orchestrator backend", 2024-06-06T08:46:59.232 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.232 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.233 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.233 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.233 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.233 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.233 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.233 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_perf_query", 2024-06-06T08:46:59.233 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.234 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.234 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.234 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.234 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.234 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.234 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.234 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.234 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.235 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.235 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.235 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.235 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.235 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.235 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.235 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.235 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.236 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.236 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.236 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.236 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.236 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.236 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.236 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.237 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.237 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.237 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.237 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.237 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.237 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.237 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.237 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.238 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.238 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.238 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.238 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.238 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.238 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.238 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.238 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.238 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.239 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.239 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.239 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.239 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.239 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.239 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.239 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.239 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.240 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.240 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.240 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.240 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.240 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.240 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.240 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.240 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.241 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.241 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.241 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.241 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.241 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.241 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.241 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.241 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.241 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.242 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.242 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.242 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.242 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.242 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.242 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.242 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.243 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.243 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.243 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.243 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_support", 2024-06-06T08:46:59.243 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.243 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.243 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.243 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.243 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.244 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.244 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.244 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.244 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.244 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.244 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.244 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.244 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.245 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.245 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.245 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.245 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.245 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.245 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.245 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.245 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.245 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.246 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.246 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.246 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.246 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.246 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.246 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.246 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.246 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.247 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.247 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.247 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.247 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.247 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.247 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.247 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.247 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.248 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.248 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.248 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.248 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.248 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.248 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.248 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.248 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.248 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.249 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.249 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.249 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.249 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.249 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.249 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.249 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.249 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.249 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.250 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.250 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.250 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.250 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.250 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.250 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.250 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.251 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.251 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.251 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.251 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.251 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.251 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.251 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.251 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.252 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.252 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.252 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.252 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.252 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.252 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_autoscaler", 2024-06-06T08:46:59.252 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.252 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.253 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.253 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.253 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.253 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.253 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.253 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.253 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.253 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.253 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.254 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.254 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.254 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.254 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.254 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.254 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.255 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.255 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.255 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.255 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.255 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.255 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.255 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.256 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.256 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.256 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.256 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.256 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.256 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.256 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.256 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.256 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.257 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.257 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.257 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.257 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.257 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.257 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.257 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.257 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.258 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.258 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.258 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.258 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.258 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.258 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.258 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.258 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.259 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.259 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.259 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.259 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.259 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.259 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.259 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.259 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.260 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.260 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.260 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.260 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.260 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.260 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.260 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.260 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.261 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.261 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.261 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.261 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.261 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.261 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.261 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.261 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.262 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:46:59.262 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:46:59.262 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.262 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.262 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.262 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:46:59.262 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.262 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.263 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.263 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.263 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.263 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.263 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.263 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.263 INFO:teuthology.orchestra.run.smithi028.stdout: "threshold": { 2024-06-06T08:46:59.264 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threshold", 2024-06-06T08:46:59.264 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:46:59.264 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.264 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.264 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-06-06T08:46:59.264 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1.0", 2024-06-06T08:46:59.264 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.265 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.265 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "scaling threshold", 2024-06-06T08:46:59.265 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-06T08:46:59.265 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.265 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.265 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.266 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.266 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.266 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.266 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "progress", 2024-06-06T08:46:59.266 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.266 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.266 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.266 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_pg_recovery_event": { 2024-06-06T08:46:59.267 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_pg_recovery_event", 2024-06-06T08:46:59.267 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.267 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.267 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.267 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.267 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.267 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.268 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.268 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-06T08:46:59.268 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.268 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.268 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.268 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.268 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-06-06T08:46:59.269 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-06-06T08:46:59.269 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.269 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.269 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.269 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.269 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.269 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.270 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.270 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.270 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.270 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.270 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.270 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.270 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.271 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.271 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.271 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.271 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.271 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.271 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.271 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.271 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.272 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.272 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.272 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.272 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.272 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.272 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.272 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.273 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.273 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.273 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.273 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.273 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.273 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.273 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.274 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.274 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.274 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.274 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.274 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.274 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.274 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.274 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.275 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.275 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.275 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.275 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.275 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.275 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.275 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.275 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.275 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.276 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.276 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.276 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.276 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.276 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.276 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.276 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.276 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.277 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.277 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.277 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.277 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.277 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.277 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.277 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.277 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.278 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.278 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.278 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.278 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.278 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.278 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.278 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.278 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.279 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.279 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.279 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.279 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.279 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.279 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.279 INFO:teuthology.orchestra.run.smithi028.stdout: "max_completed_events": { 2024-06-06T08:46:59.279 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_completed_events", 2024-06-06T08:46:59.279 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "50", 2024-06-06T08:46:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.280 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "number of past completed events to remember", 2024-06-06T08:46:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:46:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:46:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.281 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.282 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.282 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:46:59.282 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.282 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.282 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.282 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long the module is going to sleep", 2024-06-06T08:46:59.282 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.282 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.283 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.283 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.283 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.283 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.283 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.283 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus", 2024-06-06T08:46:59.283 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.283 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.284 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.284 INFO:teuthology.orchestra.run.smithi028.stdout: "cache": { 2024-06-06T08:46:59.284 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cache", 2024-06-06T08:46:59.284 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.284 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.284 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.284 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.284 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.285 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.285 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.285 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.285 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.285 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.285 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.285 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.286 INFO:teuthology.orchestra.run.smithi028.stdout: "exclude_perf_counters": { 2024-06-06T08:46:59.286 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "exclude_perf_counters", 2024-06-06T08:46:59.286 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.286 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.286 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.286 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.286 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.287 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.287 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.287 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-06T08:46:59.287 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-06T08:46:59.287 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.287 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.287 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.287 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.288 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.288 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.288 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.288 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.288 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.288 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.288 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.289 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.289 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.289 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.289 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.289 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.289 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.289 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.289 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.290 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.290 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.290 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.290 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.290 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.290 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.290 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.291 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.291 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.291 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.291 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.291 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.291 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.291 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.291 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.292 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.292 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.292 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.292 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.292 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.292 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.292 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.292 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.293 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.293 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.293 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.293 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.293 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.293 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.293 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.293 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.294 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.294 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.294 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.294 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.294 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.294 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.294 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.294 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.294 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.295 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.295 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.295 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.295 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.295 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.295 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.295 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.296 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.296 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.296 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.296 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.296 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.296 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.296 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.297 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools": { 2024-06-06T08:46:59.297 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools", 2024-06-06T08:46:59.297 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.297 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.297 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.297 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.297 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.297 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.298 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.298 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.298 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.298 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.298 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.298 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.298 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-06T08:46:59.298 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-06T08:46:59.298 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.299 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.299 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.299 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "300", 2024-06-06T08:46:59.299 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.299 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.299 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.299 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.299 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.300 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.300 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.300 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.300 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_interval": { 2024-06-06T08:46:59.300 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_interval", 2024-06-06T08:46:59.300 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:46:59.300 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.300 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.300 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15.0", 2024-06-06T08:46:59.301 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.301 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.301 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.301 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.301 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.301 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.301 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.301 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.302 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-06-06T08:46:59.302 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-06-06T08:46:59.302 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.302 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.302 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.302 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-06-06T08:46:59.302 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.302 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.303 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.303 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-06T08:46:59.303 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.303 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.303 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.303 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.303 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-06-06T08:46:59.303 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-06-06T08:46:59.303 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.304 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.304 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.304 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "9283", 2024-06-06T08:46:59.304 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.304 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.304 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.304 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-06T08:46:59.304 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.305 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.305 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.305 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.305 INFO:teuthology.orchestra.run.smithi028.stdout: "stale_cache_strategy": { 2024-06-06T08:46:59.305 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stale_cache_strategy", 2024-06-06T08:46:59.305 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.305 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.306 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.306 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "log", 2024-06-06T08:46:59.306 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.306 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.306 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.306 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.306 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.306 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.307 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.307 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.307 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-06-06T08:46:59.307 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-06-06T08:46:59.307 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.307 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.307 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.307 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "default", 2024-06-06T08:46:59.308 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.308 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.308 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.308 INFO:teuthology.orchestra.run.smithi028.stdout: "default", 2024-06-06T08:46:59.308 INFO:teuthology.orchestra.run.smithi028.stdout: "error" 2024-06-06T08:46:59.308 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.308 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.308 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.309 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.309 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.309 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.309 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-06-06T08:46:59.309 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-06-06T08:46:59.309 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.309 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.309 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.310 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-06-06T08:46:59.310 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-06-06T08:46:59.310 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-06-06T08:46:59.310 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.310 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.310 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.310 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.310 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.311 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.311 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.311 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.311 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.311 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_support", 2024-06-06T08:46:59.311 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.311 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.311 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.312 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.312 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.312 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.312 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.312 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.312 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.312 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.312 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.312 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.313 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.313 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.313 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.313 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.313 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.313 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.313 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.313 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.314 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.314 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.314 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.314 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.314 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.314 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.314 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.314 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.315 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.315 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.315 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.315 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.315 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.315 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.315 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.315 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.316 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.316 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.316 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.316 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.316 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.316 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.316 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.316 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.316 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.317 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.317 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.317 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.317 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.317 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.317 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.317 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.317 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.318 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.318 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.318 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.318 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.318 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.318 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.318 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.318 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.319 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.319 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.319 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.319 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.319 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.319 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.319 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.319 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.319 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.320 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.320 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.320 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.320 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_snap_create": { 2024-06-06T08:46:59.320 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_snap_create", 2024-06-06T08:46:59.320 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.320 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.320 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.321 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:59.321 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.321 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.321 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.321 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.321 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.321 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.321 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.321 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.322 INFO:teuthology.orchestra.run.smithi028.stdout: "mirror_snapshot_schedule": { 2024-06-06T08:46:59.322 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirror_snapshot_schedule", 2024-06-06T08:46:59.322 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.322 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.322 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.322 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.322 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.322 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.323 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.323 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.323 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.323 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.323 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.323 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.323 INFO:teuthology.orchestra.run.smithi028.stdout: "trash_purge_schedule": { 2024-06-06T08:46:59.323 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "trash_purge_schedule", 2024-06-06T08:46:59.324 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.324 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.324 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.324 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.324 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.324 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.324 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.324 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.324 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.325 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.325 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.325 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.325 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.325 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.325 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.325 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "restful", 2024-06-06T08:46:59.325 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.326 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.326 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.326 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_auth": { 2024-06-06T08:46:59.326 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_auth", 2024-06-06T08:46:59.326 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.326 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.326 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.326 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.327 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.327 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.327 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.327 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.327 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.327 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.327 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.327 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.327 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-06-06T08:46:59.328 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-06-06T08:46:59.328 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.328 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.328 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.328 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.328 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.328 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.328 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.329 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.329 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.329 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.329 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.329 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.330 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.330 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.330 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.330 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.330 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.330 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.330 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.331 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.331 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.331 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.331 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.331 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.331 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.331 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.331 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.332 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.332 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.332 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.332 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.332 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.332 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.332 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.332 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.332 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.333 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.333 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.333 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.333 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.333 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.333 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.333 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.334 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.334 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.334 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.334 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.334 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.334 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.334 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.334 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.335 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.335 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.335 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.335 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.335 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.335 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.335 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.335 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.336 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.336 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.336 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.336 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.336 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.336 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.336 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.336 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.336 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.337 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.337 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.337 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.337 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.337 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.337 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.337 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.337 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.338 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.338 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.338 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.338 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.338 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.338 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.338 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-06-06T08:46:59.338 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-06-06T08:46:59.339 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.339 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.339 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.339 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.339 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.339 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.339 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.339 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.340 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.340 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.340 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.340 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.340 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-06-06T08:46:59.340 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-06-06T08:46:59.340 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.340 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.340 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.341 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.341 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.341 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.341 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.341 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.341 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.341 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.341 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.341 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.342 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.342 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.342 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.342 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rgw", 2024-06-06T08:46:59.342 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.342 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.342 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.342 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.343 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.343 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.343 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.343 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.343 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.343 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.343 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.343 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.343 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.344 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.344 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.344 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.344 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.344 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.344 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.344 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.344 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.345 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.345 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.345 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.345 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.345 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.345 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.345 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.345 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.345 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.346 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.346 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.346 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.346 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.346 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.346 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.346 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.346 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.349 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.349 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.349 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.349 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.349 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.349 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.349 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.349 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.350 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.350 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.350 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.350 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.350 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.350 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.350 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.350 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.351 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.351 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.351 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.351 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.351 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.351 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.351 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rook", 2024-06-06T08:46:59.352 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.352 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.352 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.352 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.352 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.352 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.352 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.352 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.352 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.353 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.353 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.353 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.353 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.353 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.353 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.353 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.354 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.354 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.354 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.354 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.354 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.354 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.354 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.354 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.355 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.355 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.355 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.355 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.355 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.355 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.355 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.355 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.355 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.356 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.356 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.356 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.356 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.356 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.356 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.356 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.356 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.357 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.357 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.357 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.357 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.357 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.357 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.357 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.357 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.357 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.358 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.358 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.358 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.358 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.358 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.358 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.358 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.359 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.359 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.359 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.359 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.359 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.359 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.359 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.359 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.359 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.360 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.360 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.360 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.360 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.360 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.360 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.360 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.360 INFO:teuthology.orchestra.run.smithi028.stdout: "storage_class": { 2024-06-06T08:46:59.360 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "storage_class", 2024-06-06T08:46:59.361 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.361 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.361 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.361 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "local", 2024-06-06T08:46:59.361 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.361 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.361 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.361 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-06T08:46:59.362 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.362 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.362 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.362 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.362 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.362 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.362 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.362 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "selftest", 2024-06-06T08:46:59.363 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.363 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.363 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.363 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.363 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.363 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.363 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.363 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.363 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.364 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.364 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.364 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.364 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.364 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.364 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.364 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.364 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.365 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.365 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.365 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.365 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.365 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.365 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.365 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.365 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.365 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.366 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.366 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.366 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.366 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.366 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.366 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.366 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.366 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.367 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.367 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.367 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.367 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.367 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.367 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.367 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.367 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.367 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.368 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.368 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.368 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.368 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.368 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.368 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.368 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.368 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.369 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.369 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.369 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.369 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.369 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.369 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.369 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.369 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.370 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.370 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.370 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.370 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.370 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.370 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.370 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.370 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.370 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.371 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.371 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.371 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.371 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.371 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.371 INFO:teuthology.orchestra.run.smithi028.stdout: "roption1": { 2024-06-06T08:46:59.371 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption1", 2024-06-06T08:46:59.371 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.372 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.372 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.372 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.372 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.372 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.372 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.372 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.372 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.373 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.373 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.373 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.373 INFO:teuthology.orchestra.run.smithi028.stdout: "roption2": { 2024-06-06T08:46:59.373 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption2", 2024-06-06T08:46:59.373 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.373 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.373 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.373 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "xyz", 2024-06-06T08:46:59.374 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.374 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.374 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.374 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.374 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.374 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.374 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.374 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.375 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption1": { 2024-06-06T08:46:59.375 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption1", 2024-06-06T08:46:59.375 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.375 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.375 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.375 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.375 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.375 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.376 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.376 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.376 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.376 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.376 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.376 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.376 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption2": { 2024-06-06T08:46:59.376 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption2", 2024-06-06T08:46:59.376 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.377 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.377 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.377 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.377 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.377 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.377 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.377 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.378 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.378 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.378 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.378 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.378 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption3": { 2024-06-06T08:46:59.378 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption3", 2024-06-06T08:46:59.378 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:46:59.378 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.379 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.379 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.379 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.379 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.379 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.379 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.379 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.379 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.379 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.380 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.380 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption4": { 2024-06-06T08:46:59.380 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption4", 2024-06-06T08:46:59.380 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.380 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.380 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.380 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.380 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.381 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.381 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.381 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.381 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.381 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.381 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.381 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.381 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption5": { 2024-06-06T08:46:59.382 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption5", 2024-06-06T08:46:59.382 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.382 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.382 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.382 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.382 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.382 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.382 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.383 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.383 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.383 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.383 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.383 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.383 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption6": { 2024-06-06T08:46:59.383 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption6", 2024-06-06T08:46:59.383 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.383 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.384 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.384 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.384 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.384 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.384 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.384 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.384 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.384 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.385 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.385 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.385 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption7": { 2024-06-06T08:46:59.385 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption7", 2024-06-06T08:46:59.385 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.385 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.385 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.385 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.386 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:46:59.386 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "42", 2024-06-06T08:46:59.386 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.386 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.386 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.386 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.386 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.386 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.387 INFO:teuthology.orchestra.run.smithi028.stdout: "testkey": { 2024-06-06T08:46:59.387 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testkey", 2024-06-06T08:46:59.387 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.387 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.387 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.387 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.387 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.387 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.388 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.388 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.388 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.388 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.388 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.388 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.388 INFO:teuthology.orchestra.run.smithi028.stdout: "testlkey": { 2024-06-06T08:46:59.388 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testlkey", 2024-06-06T08:46:59.389 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.389 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.389 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.389 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.389 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.389 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.389 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.389 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.389 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.390 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.390 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.390 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.390 INFO:teuthology.orchestra.run.smithi028.stdout: "testnewline": { 2024-06-06T08:46:59.390 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testnewline", 2024-06-06T08:46:59.390 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.390 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.391 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.391 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.391 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.391 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.391 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.391 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.391 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.391 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.392 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.392 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.392 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.392 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.392 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.392 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snap_schedule", 2024-06-06T08:46:59.392 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.392 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.393 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.393 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_m_granularity": { 2024-06-06T08:46:59.393 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_m_granularity", 2024-06-06T08:46:59.393 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.393 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.393 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.393 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.393 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.393 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.394 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.394 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow minute scheduled snapshots", 2024-06-06T08:46:59.394 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.394 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.394 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.394 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.394 INFO:teuthology.orchestra.run.smithi028.stdout: "dump_on_update": { 2024-06-06T08:46:59.394 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dump_on_update", 2024-06-06T08:46:59.395 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.395 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.395 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.395 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.395 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.395 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.395 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.395 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "dump database to debug log on update", 2024-06-06T08:46:59.396 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.396 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.396 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.396 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.396 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.396 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.396 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.396 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.397 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.397 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.397 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.397 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.397 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.397 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.397 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.397 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.398 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.398 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.398 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.398 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.398 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.398 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.398 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.398 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.399 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.399 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.399 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.399 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.399 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.399 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.399 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.399 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.400 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.400 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.400 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.400 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.400 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.400 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.400 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.400 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.400 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.401 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.401 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.401 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.401 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.401 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.401 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.401 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.402 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.402 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.402 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.402 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.402 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.402 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.402 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.402 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.402 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.403 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.403 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.403 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.403 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.403 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.403 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.403 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.404 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.404 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.404 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.404 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.404 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.404 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.404 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.404 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.404 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.405 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.405 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.405 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.405 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.405 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stats", 2024-06-06T08:46:59.405 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.405 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.405 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.406 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.406 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.406 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.406 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.406 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.406 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.406 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.407 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.407 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.407 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.407 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.407 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.407 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.407 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.407 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.408 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.408 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.408 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.408 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.408 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.408 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.408 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.408 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.408 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.409 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.409 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.409 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.409 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.409 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.409 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.409 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.409 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.410 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.410 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.410 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.410 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.410 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.410 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.410 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.410 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.411 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.411 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.411 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.411 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.411 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.411 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.411 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.411 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.411 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.412 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.412 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.412 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.412 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.412 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.412 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.412 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.412 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.412 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.413 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.413 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.413 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.413 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.413 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.413 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.413 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.413 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.414 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.414 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.414 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.414 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.414 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.414 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.414 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.414 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "status", 2024-06-06T08:46:59.414 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.415 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.415 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.415 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.415 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.415 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.415 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.415 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.415 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.416 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.416 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.416 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.416 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.416 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.416 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.416 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.416 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.416 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.417 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.417 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.417 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.417 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.417 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.417 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.417 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.418 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.418 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.418 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.418 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.418 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.418 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.418 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.418 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.418 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.419 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.419 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.419 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.419 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.419 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.419 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.419 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.419 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.419 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.420 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.420 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.420 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.420 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.420 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.420 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.420 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.420 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.421 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.421 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.421 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.421 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.421 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.421 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.421 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.421 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.421 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.422 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.422 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.422 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.422 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.422 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.422 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.422 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.422 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.423 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.423 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.423 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.423 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.423 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.423 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.423 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.423 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.423 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telegraf", 2024-06-06T08:46:59.424 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.424 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.424 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.424 INFO:teuthology.orchestra.run.smithi028.stdout: "address": { 2024-06-06T08:46:59.424 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "address", 2024-06-06T08:46:59.424 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.424 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.424 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.425 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-06T08:46:59.425 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.425 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.425 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.425 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.425 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.425 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.425 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.426 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.426 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:46:59.426 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:46:59.426 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.426 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.426 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.426 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15", 2024-06-06T08:46:59.426 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.426 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.427 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.427 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.427 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.427 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.427 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.427 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.427 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.427 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.428 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.428 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.428 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.428 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.428 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.428 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.428 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.428 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.429 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.429 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.429 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.429 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.429 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.429 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.429 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.429 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.429 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.430 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.430 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.430 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.430 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.430 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.430 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.430 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.430 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.431 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.431 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.431 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.431 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.431 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.431 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.431 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.431 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.431 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.432 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.432 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.432 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.432 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.432 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.432 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.432 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.432 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.433 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.433 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.433 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.433 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.433 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.433 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.433 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.433 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.434 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.434 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.434 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.434 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.434 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.434 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.434 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.434 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.435 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.435 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.435 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.435 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.435 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.435 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.435 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.435 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.436 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.436 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.436 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.436 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.436 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.436 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telemetry", 2024-06-06T08:46:59.436 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.436 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.437 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.437 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_basic": { 2024-06-06T08:46:59.437 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_basic", 2024-06-06T08:46:59.437 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.437 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.437 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.437 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.437 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.438 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.438 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.438 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-06T08:46:59.438 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.438 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.438 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.438 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.438 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_crash": { 2024-06-06T08:46:59.439 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_crash", 2024-06-06T08:46:59.439 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.439 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.439 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.439 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.439 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.439 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.440 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.440 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-06T08:46:59.440 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.440 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.440 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.440 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.440 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_device": { 2024-06-06T08:46:59.440 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_device", 2024-06-06T08:46:59.440 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.441 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.441 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.441 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.441 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.441 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.441 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.441 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-06T08:46:59.441 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.442 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.442 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.442 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.442 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_ident": { 2024-06-06T08:46:59.442 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_ident", 2024-06-06T08:46:59.442 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.442 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.442 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.443 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.443 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.443 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.443 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.443 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-06T08:46:59.443 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.443 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.443 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.443 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.444 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_perf": { 2024-06-06T08:46:59.444 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_perf", 2024-06-06T08:46:59.444 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.444 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.444 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.444 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.444 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.444 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.445 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.445 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-06T08:46:59.445 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.445 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.445 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.445 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.445 INFO:teuthology.orchestra.run.smithi028.stdout: "contact": { 2024-06-06T08:46:59.446 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "contact", 2024-06-06T08:46:59.446 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.446 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.446 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.446 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.446 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.446 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.446 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.447 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.447 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.447 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.447 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.447 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.447 INFO:teuthology.orchestra.run.smithi028.stdout: "description": { 2024-06-06T08:46:59.447 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "description", 2024-06-06T08:46:59.447 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.447 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.448 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.448 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.448 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.448 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.448 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.448 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.448 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.448 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.449 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.449 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.449 INFO:teuthology.orchestra.run.smithi028.stdout: "device_url": { 2024-06-06T08:46:59.449 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_url", 2024-06-06T08:46:59.449 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.449 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.449 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.449 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-06T08:46:59.449 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.450 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.450 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.450 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.450 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.450 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.450 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.450 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.450 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-06-06T08:46:59.451 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-06-06T08:46:59.451 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.451 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.451 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.451 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.451 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.451 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.452 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.452 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.452 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.452 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.452 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.452 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.452 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:46:59.452 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:46:59.452 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.453 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.453 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.453 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "24", 2024-06-06T08:46:59.453 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "8", 2024-06-06T08:46:59.453 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.453 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.453 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.453 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.454 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.454 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.454 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.454 INFO:teuthology.orchestra.run.smithi028.stdout: "last_opt_revision": { 2024-06-06T08:46:59.454 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "last_opt_revision", 2024-06-06T08:46:59.454 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.454 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.455 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.455 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1", 2024-06-06T08:46:59.455 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.455 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.455 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.455 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.455 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.455 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.456 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.456 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.456 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard": { 2024-06-06T08:46:59.456 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard", 2024-06-06T08:46:59.456 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.456 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.456 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.456 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.457 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.457 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.457 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.457 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.457 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.457 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.457 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.457 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.458 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard_description": { 2024-06-06T08:46:59.458 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard_description", 2024-06-06T08:46:59.458 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.458 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.458 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.458 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.458 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.458 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.459 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.459 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.459 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.459 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.459 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.459 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.459 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.459 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.460 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.460 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.460 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.460 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.460 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.460 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.460 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.460 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.461 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.461 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.461 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.461 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.461 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.461 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.461 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.461 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.462 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.462 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.462 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.462 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.462 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.462 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.462 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.462 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.463 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.463 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.463 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.463 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.463 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.463 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.463 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.463 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.464 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.464 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.464 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.464 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.464 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.464 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.464 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.464 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.465 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.465 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.465 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.465 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.465 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.465 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.465 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.465 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.465 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.466 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.466 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.466 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.466 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.466 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.466 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.466 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.467 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.467 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.467 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.467 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.467 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.467 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.467 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.467 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.467 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.468 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.468 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.468 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.468 INFO:teuthology.orchestra.run.smithi028.stdout: "organization": { 2024-06-06T08:46:59.468 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "organization", 2024-06-06T08:46:59.468 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.468 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.468 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.469 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.469 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.469 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.469 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.469 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.469 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.469 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.469 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.470 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.470 INFO:teuthology.orchestra.run.smithi028.stdout: "proxy": { 2024-06-06T08:46:59.470 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "proxy", 2024-06-06T08:46:59.470 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.470 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.470 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.470 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.471 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.471 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.471 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.471 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.471 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.471 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.471 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.471 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.472 INFO:teuthology.orchestra.run.smithi028.stdout: "url": { 2024-06-06T08:46:59.472 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url", 2024-06-06T08:46:59.472 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.472 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.472 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.472 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-06T08:46:59.472 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.472 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.473 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.473 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.473 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.473 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.473 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.473 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.473 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.473 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.474 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.474 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "test_orchestrator", 2024-06-06T08:46:59.474 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.474 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.474 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.474 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.474 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.474 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.475 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.475 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.475 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.475 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.475 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.475 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.475 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.475 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.475 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.476 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.476 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.476 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.476 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.476 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.476 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.476 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.476 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.477 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.477 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.477 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.477 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.477 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.477 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.477 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.477 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.477 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.478 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.478 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.478 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.478 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.478 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.478 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.478 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.478 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.479 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.479 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.479 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.479 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.479 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.479 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.479 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.479 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.480 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.480 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.480 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.480 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.480 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.480 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.480 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.480 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.481 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.481 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.481 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.481 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.481 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.481 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.481 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.481 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.482 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.482 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.482 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.482 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.482 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.482 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.482 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.482 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.483 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.483 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.483 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.483 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.483 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "volumes", 2024-06-06T08:46:59.483 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.483 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.483 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.484 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.484 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.484 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.484 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.484 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.484 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.484 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.484 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.485 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.485 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.485 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.485 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.485 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.485 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.485 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.485 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.486 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.486 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.486 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.486 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.486 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.486 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.486 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.486 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.486 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.487 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.487 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.487 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.487 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.487 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.487 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.487 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.487 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.488 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.488 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.488 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.488 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.488 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.488 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.488 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.488 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.489 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.489 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.489 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.489 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.489 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.489 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.489 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.489 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.490 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.490 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.490 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.490 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.490 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.490 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.490 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.490 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.491 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.491 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.491 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.491 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.491 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.491 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.491 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.491 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.491 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.492 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.492 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.492 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.492 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.492 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_clones": { 2024-06-06T08:46:59.492 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_clones", 2024-06-06T08:46:59.492 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.493 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.493 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.493 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4", 2024-06-06T08:46:59.493 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.493 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.493 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.493 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-06T08:46:59.493 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.493 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.494 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.494 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.494 INFO:teuthology.orchestra.run.smithi028.stdout: "periodic_async_work": { 2024-06-06T08:46:59.494 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "periodic_async_work", 2024-06-06T08:46:59.494 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.494 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.494 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.494 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.495 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.495 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.495 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.495 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Periodically check for async work", 2024-06-06T08:46:59.495 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.495 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.495 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.496 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.496 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_delay": { 2024-06-06T08:46:59.496 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_delay", 2024-06-06T08:46:59.496 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.496 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.496 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.496 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:46:59.496 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.497 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.497 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.497 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-06T08:46:59.497 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.497 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.497 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.497 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.497 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_no_wait": { 2024-06-06T08:46:59.498 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_no_wait", 2024-06-06T08:46:59.498 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.498 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.498 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.498 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.498 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.498 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.498 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.499 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-06T08:46:59.499 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.499 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.499 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.499 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.499 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.499 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.499 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.500 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix", 2024-06-06T08:46:59.500 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.500 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.500 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.500 INFO:teuthology.orchestra.run.smithi028.stdout: "discovery_interval": { 2024-06-06T08:46:59.500 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "discovery_interval", 2024-06-06T08:46:59.500 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:46:59.501 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.501 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.501 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "100", 2024-06-06T08:46:59.501 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.501 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.501 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.501 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.501 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.501 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.502 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.502 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.502 INFO:teuthology.orchestra.run.smithi028.stdout: "identifier": { 2024-06-06T08:46:59.502 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "identifier", 2024-06-06T08:46:59.502 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.502 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.502 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.503 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.503 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.503 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.503 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.503 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.503 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.503 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.503 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.504 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.504 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:46:59.504 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:46:59.504 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.504 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.504 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.504 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:46:59.504 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.504 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.505 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.505 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.505 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.505 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.505 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.505 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.505 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.506 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.506 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.506 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.506 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.506 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.506 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.506 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.506 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.507 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.507 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.507 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.507 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.507 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.507 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.507 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.507 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.508 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.508 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.508 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.508 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.508 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.508 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.508 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.508 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.508 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.509 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.509 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.509 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.509 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.509 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.509 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.509 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.510 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.510 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.510 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.510 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.510 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.510 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.510 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.510 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.510 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.511 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.511 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.511 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.511 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.511 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.511 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.511 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.511 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.512 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.512 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.512 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.512 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.512 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.512 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.512 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.512 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.513 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.513 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.513 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.513 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.513 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.513 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.513 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.513 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.513 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.514 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.514 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.514 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.514 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_host": { 2024-06-06T08:46:59.514 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_host", 2024-06-06T08:46:59.514 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.514 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.514 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.515 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.515 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.515 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.515 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.515 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.515 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.515 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.515 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.515 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.516 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_port": { 2024-06-06T08:46:59.516 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_port", 2024-06-06T08:46:59.516 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.516 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.516 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.516 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10051", 2024-06-06T08:46:59.516 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.516 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.517 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.517 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.517 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.517 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.517 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.517 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.517 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_sender": { 2024-06-06T08:46:59.517 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_sender", 2024-06-06T08:46:59.517 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.518 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.518 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.518 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-06T08:46:59.518 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.518 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.518 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.518 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.519 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.519 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.519 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.519 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.519 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.519 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.519 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-06-06T08:46:59.519 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.520 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.520 INFO:teuthology.orchestra.run.smithi028.stdout: "gid": 24116, 2024-06-06T08:46:59.520 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "y", 2024-06-06T08:46:59.520 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr_features": 4540701547738038271, 2024-06-06T08:46:59.520 INFO:teuthology.orchestra.run.smithi028.stdout: "available_modules": [ 2024-06-06T08:46:59.520 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.520 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "alerts", 2024-06-06T08:46:59.520 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.520 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.521 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.521 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:46:59.521 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:46:59.521 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.521 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.521 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.521 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:46:59.521 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.522 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.522 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.522 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How frequently to reexamine health status", 2024-06-06T08:46:59.522 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.522 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.522 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.522 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.522 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.523 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.523 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.523 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.523 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.523 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.523 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.523 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.523 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.524 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.524 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.524 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.524 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.524 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.524 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.524 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.524 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.525 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.525 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.525 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.525 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.525 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.525 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.525 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.525 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.525 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.526 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.526 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.526 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.526 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.526 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.526 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.526 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.527 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.527 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.527 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.527 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.527 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.527 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.527 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.527 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.527 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.528 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.528 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.528 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.528 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.528 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.528 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.528 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.528 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.529 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.529 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.529 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.529 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.529 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.529 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.529 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.530 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.530 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.530 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.530 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.530 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.530 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.530 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.530 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.530 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.531 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.531 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.531 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.531 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.531 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_destination": { 2024-06-06T08:46:59.531 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_destination", 2024-06-06T08:46:59.531 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.531 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.531 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.532 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.532 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.532 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.532 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.532 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email address to send alerts to", 2024-06-06T08:46:59.532 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.532 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.532 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.533 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.533 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_from_name": { 2024-06-06T08:46:59.533 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_from_name", 2024-06-06T08:46:59.533 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.533 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.533 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.533 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "Ceph", 2024-06-06T08:46:59.533 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.534 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.534 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.534 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email From: name", 2024-06-06T08:46:59.534 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.534 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.534 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.534 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.534 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_host": { 2024-06-06T08:46:59.535 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_host", 2024-06-06T08:46:59.535 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.535 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.535 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.535 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.535 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.535 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.535 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.536 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP server", 2024-06-06T08:46:59.536 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.536 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.536 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.536 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.536 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_password": { 2024-06-06T08:46:59.536 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_password", 2024-06-06T08:46:59.536 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.536 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.537 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.537 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.537 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.537 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.537 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.537 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Password to authenticate with", 2024-06-06T08:46:59.537 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.537 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.538 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.538 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.538 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_port": { 2024-06-06T08:46:59.538 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_port", 2024-06-06T08:46:59.538 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.538 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.538 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.539 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "465", 2024-06-06T08:46:59.539 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.539 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.539 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.539 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP port", 2024-06-06T08:46:59.539 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.539 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.539 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.539 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.539 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_sender": { 2024-06-06T08:46:59.540 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_sender", 2024-06-06T08:46:59.540 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.540 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.540 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.540 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.540 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.540 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.540 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.541 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP envelope sender", 2024-06-06T08:46:59.541 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.541 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.541 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.541 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.541 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_ssl": { 2024-06-06T08:46:59.541 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_ssl", 2024-06-06T08:46:59.541 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.541 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.542 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.542 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.542 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.542 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.542 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.542 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-06T08:46:59.542 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.542 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.543 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.543 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.543 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_user": { 2024-06-06T08:46:59.543 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_user", 2024-06-06T08:46:59.543 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.543 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.543 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.543 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.544 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.544 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.544 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.544 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "User to authenticate as", 2024-06-06T08:46:59.544 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.544 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.544 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.544 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.545 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.545 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.545 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.545 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "balancer", 2024-06-06T08:46:59.545 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.545 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.545 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.545 INFO:teuthology.orchestra.run.smithi028.stdout: "active": { 2024-06-06T08:46:59.546 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "active", 2024-06-06T08:46:59.546 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.546 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.546 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.546 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.546 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.546 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.546 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.547 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically balance PGs across cluster", 2024-06-06T08:46:59.547 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.547 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.547 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.547 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.547 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_time": { 2024-06-06T08:46:59.547 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_time", 2024-06-06T08:46:59.547 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.548 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.548 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.548 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0000", 2024-06-06T08:46:59.548 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.548 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.548 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.548 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "beginning time of day to automatically balance", 2024-06-06T08:46:59.548 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T08:46:59.549 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.549 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.549 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.549 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_weekday": { 2024-06-06T08:46:59.549 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_weekday", 2024-06-06T08:46:59.549 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:46:59.549 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.550 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.550 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:46:59.550 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-06-06T08:46:59.550 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-06-06T08:46:59.550 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.550 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-06T08:46:59.550 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T08:46:59.550 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.551 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.551 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.551 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_max_iterations": { 2024-06-06T08:46:59.551 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_max_iterations", 2024-06-06T08:46:59.551 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:46:59.551 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.551 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.551 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "25", 2024-06-06T08:46:59.553 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:46:59.553 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "250", 2024-06-06T08:46:59.553 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.553 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-06T08:46:59.553 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.553 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.554 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.554 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.554 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_metrics": { 2024-06-06T08:46:59.554 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_metrics", 2024-06-06T08:46:59.554 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.554 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.554 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.554 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "pgs,objects,bytes", 2024-06-06T08:46:59.555 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.555 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.555 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.555 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-06T08:46:59.555 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-06T08:46:59.555 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.555 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.555 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.556 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_step": { 2024-06-06T08:46:59.556 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_step", 2024-06-06T08:46:59.556 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:46:59.556 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.556 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.556 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.5", 2024-06-06T08:46:59.556 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0.001", 2024-06-06T08:46:59.556 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "0.999", 2024-06-06T08:46:59.556 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.557 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "aggressiveness of optimization", 2024-06-06T08:46:59.557 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-06T08:46:59.557 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.557 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.557 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.557 INFO:teuthology.orchestra.run.smithi028.stdout: "end_time": { 2024-06-06T08:46:59.557 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_time", 2024-06-06T08:46:59.557 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.557 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.558 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.558 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2359", 2024-06-06T08:46:59.558 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.558 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.558 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.558 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ending time of day to automatically balance", 2024-06-06T08:46:59.558 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T08:46:59.559 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.559 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.559 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.559 INFO:teuthology.orchestra.run.smithi028.stdout: "end_weekday": { 2024-06-06T08:46:59.559 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_weekday", 2024-06-06T08:46:59.559 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:46:59.559 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.559 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.559 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:46:59.560 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-06-06T08:46:59.560 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-06-06T08:46:59.560 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.560 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-06T08:46:59.560 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T08:46:59.560 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.560 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.560 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.561 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.561 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.561 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.561 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.561 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.561 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.561 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.561 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.561 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.562 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.562 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.562 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.562 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.562 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.562 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.562 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.562 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.563 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.563 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.563 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.563 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.563 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.563 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.563 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.563 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.564 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.564 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.564 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.564 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.564 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.564 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.564 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.564 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.564 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.565 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.565 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.565 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.565 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.565 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.565 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.565 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.565 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.565 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.566 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.566 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.566 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.566 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.566 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.566 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.566 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.566 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.567 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.567 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.567 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.567 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.567 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.567 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.567 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.567 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.568 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.568 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.568 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.568 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.568 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.568 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.568 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.568 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.569 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.569 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.569 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.569 INFO:teuthology.orchestra.run.smithi028.stdout: "min_score": { 2024-06-06T08:46:59.569 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_score", 2024-06-06T08:46:59.569 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:46:59.569 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.569 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.569 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:46:59.570 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.570 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.570 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.570 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-06T08:46:59.570 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.570 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.570 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.570 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.571 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-06-06T08:46:59.571 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-06-06T08:46:59.571 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.571 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.571 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.571 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "upmap", 2024-06-06T08:46:59.571 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.571 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.572 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.572 INFO:teuthology.orchestra.run.smithi028.stdout: "crush-compat", 2024-06-06T08:46:59.572 INFO:teuthology.orchestra.run.smithi028.stdout: "none", 2024-06-06T08:46:59.572 INFO:teuthology.orchestra.run.smithi028.stdout: "read", 2024-06-06T08:46:59.572 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap", 2024-06-06T08:46:59.572 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap-read" 2024-06-06T08:46:59.572 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.572 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Balancer mode", 2024-06-06T08:46:59.572 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.573 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.573 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.573 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.573 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_ids": { 2024-06-06T08:46:59.573 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_ids", 2024-06-06T08:46:59.573 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.573 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.573 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.573 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.574 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.574 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.574 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.574 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-06T08:46:59.574 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.574 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.574 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.575 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.575 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:46:59.575 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:46:59.575 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.575 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.575 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.575 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:46:59.575 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.576 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.576 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.576 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-06T08:46:59.576 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.576 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.576 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.576 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.576 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_deviation": { 2024-06-06T08:46:59.577 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_deviation", 2024-06-06T08:46:59.577 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.577 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.577 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.577 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:46:59.577 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:46:59.577 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.577 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.578 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-06T08:46:59.578 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-06T08:46:59.578 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.578 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.578 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.578 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_optimizations": { 2024-06-06T08:46:59.578 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_optimizations", 2024-06-06T08:46:59.579 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:46:59.579 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.579 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.579 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:59.579 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.579 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.579 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.579 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-06T08:46:59.579 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.580 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.580 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.580 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.580 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.580 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.580 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.580 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm", 2024-06-06T08:46:59.581 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.581 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.581 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.581 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_down_multiplier": { 2024-06-06T08:46:59.581 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_down_multiplier", 2024-06-06T08:46:59.581 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:46:59.581 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.581 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.581 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-06-06T08:46:59.582 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.582 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.582 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.582 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-06T08:46:59.582 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.582 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.582 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.582 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.583 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_refresh_rate": { 2024-06-06T08:46:59.583 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_refresh_rate", 2024-06-06T08:46:59.583 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.583 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.583 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.583 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "20", 2024-06-06T08:46:59.583 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.583 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.583 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.584 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-06T08:46:59.584 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.584 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.584 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.584 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.584 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_starting_port": { 2024-06-06T08:46:59.584 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_starting_port", 2024-06-06T08:46:59.584 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.585 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.585 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.585 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4721", 2024-06-06T08:46:59.585 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.585 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.585 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.585 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-06T08:46:59.585 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.586 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.586 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.586 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.586 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_ptrace": { 2024-06-06T08:46:59.586 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_ptrace", 2024-06-06T08:46:59.586 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.586 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.586 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.587 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.587 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.587 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.587 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.587 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-06T08:46:59.587 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-06T08:46:59.587 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.587 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.588 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.588 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_interval": { 2024-06-06T08:46:59.588 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_interval", 2024-06-06T08:46:59.588 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.588 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.588 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.588 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:46:59.588 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.589 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.589 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.589 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-06T08:46:59.589 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.589 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.589 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.589 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.589 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_memory_target_ratio": { 2024-06-06T08:46:59.590 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_memory_target_ratio", 2024-06-06T08:46:59.590 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:46:59.590 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.590 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.590 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.7", 2024-06-06T08:46:59.590 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.590 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.590 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.591 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-06T08:46:59.591 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.591 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.591 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.591 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.591 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm_log_destination": { 2024-06-06T08:46:59.591 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm_log_destination", 2024-06-06T08:46:59.591 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.592 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.592 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.592 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.592 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.592 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.592 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.592 INFO:teuthology.orchestra.run.smithi028.stdout: "file", 2024-06-06T08:46:59.592 INFO:teuthology.orchestra.run.smithi028.stdout: "file,syslog", 2024-06-06T08:46:59.593 INFO:teuthology.orchestra.run.smithi028.stdout: "syslog" 2024-06-06T08:46:59.593 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.593 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-06T08:46:59.593 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.593 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.593 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.593 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.593 INFO:teuthology.orchestra.run.smithi028.stdout: "cgroups_split": { 2024-06-06T08:46:59.594 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cgroups_split", 2024-06-06T08:46:59.594 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.594 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.594 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.594 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.594 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.594 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.594 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.595 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-06T08:46:59.595 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.595 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.595 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.595 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.595 INFO:teuthology.orchestra.run.smithi028.stdout: "config_checks_enabled": { 2024-06-06T08:46:59.595 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_checks_enabled", 2024-06-06T08:46:59.595 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.596 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.596 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.596 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.596 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.596 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.596 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.596 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-06T08:46:59.596 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.597 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.597 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.597 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.597 INFO:teuthology.orchestra.run.smithi028.stdout: "config_dashboard": { 2024-06-06T08:46:59.597 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_dashboard", 2024-06-06T08:46:59.597 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.597 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.597 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.597 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.598 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.598 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.598 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.598 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-06T08:46:59.598 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.598 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.598 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.598 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.599 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_alertmanager": { 2024-06-06T08:46:59.599 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_alertmanager", 2024-06-06T08:46:59.599 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.599 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.599 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.599 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-06T08:46:59.599 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.599 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.600 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.600 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:46:59.600 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.600 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.600 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.600 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.600 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_base": { 2024-06-06T08:46:59.600 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_base", 2024-06-06T08:46:59.601 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.601 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.601 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.601 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-06T08:46:59.601 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.601 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.601 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.601 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Container image name, without the tag", 2024-06-06T08:46:59.602 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.602 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.602 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.602 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.602 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_elasticsearch": { 2024-06-06T08:46:59.602 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_elasticsearch", 2024-06-06T08:46:59.602 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.602 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.603 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.603 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-06T08:46:59.603 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.603 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.603 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.603 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "elasticsearch container image", 2024-06-06T08:46:59.603 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.603 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.604 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.604 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.604 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_grafana": { 2024-06-06T08:46:59.604 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_grafana", 2024-06-06T08:46:59.604 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.604 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.604 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.604 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-06T08:46:59.604 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.605 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.605 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.605 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:46:59.605 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.605 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.605 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.605 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.606 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_haproxy": { 2024-06-06T08:46:59.606 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_haproxy", 2024-06-06T08:46:59.606 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.606 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.606 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.606 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-06T08:46:59.606 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.606 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.606 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.607 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "HAproxy container image", 2024-06-06T08:46:59.607 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.607 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.607 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.607 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.607 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_agent": { 2024-06-06T08:46:59.607 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_agent", 2024-06-06T08:46:59.607 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.608 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.608 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.608 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-06T08:46:59.608 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.608 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.608 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.608 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger agent container image", 2024-06-06T08:46:59.608 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.608 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.609 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.609 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.609 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_collector": { 2024-06-06T08:46:59.609 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_collector", 2024-06-06T08:46:59.609 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.609 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.609 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.609 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-06T08:46:59.609 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.610 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.610 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.610 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger collector container image", 2024-06-06T08:46:59.610 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.610 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.610 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.610 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.611 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_query": { 2024-06-06T08:46:59.611 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_query", 2024-06-06T08:46:59.611 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.611 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.611 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.611 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-06T08:46:59.611 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.611 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.611 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.612 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger query container image", 2024-06-06T08:46:59.612 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.612 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.612 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.612 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.612 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_keepalived": { 2024-06-06T08:46:59.612 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_keepalived", 2024-06-06T08:46:59.612 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.612 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.613 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.613 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-06T08:46:59.613 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.613 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.613 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.613 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Keepalived container image", 2024-06-06T08:46:59.613 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.613 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.613 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.614 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.614 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_loki": { 2024-06-06T08:46:59.614 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_loki", 2024-06-06T08:46:59.614 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.614 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.614 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.614 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-06T08:46:59.614 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.615 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.615 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.615 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Loki container image", 2024-06-06T08:46:59.615 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.615 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.615 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.615 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.615 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_node_exporter": { 2024-06-06T08:46:59.616 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_node_exporter", 2024-06-06T08:46:59.616 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.616 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.616 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.616 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-06T08:46:59.616 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.616 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.616 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.617 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:46:59.617 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.617 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.617 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.617 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.617 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_nvmeof": { 2024-06-06T08:46:59.617 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_nvmeof", 2024-06-06T08:46:59.617 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.617 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.618 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.618 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-06T08:46:59.618 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.618 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.618 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.618 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Nvme-of container image", 2024-06-06T08:46:59.618 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.618 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.619 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.619 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.619 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_prometheus": { 2024-06-06T08:46:59.619 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_prometheus", 2024-06-06T08:46:59.619 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.619 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.619 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.620 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-06T08:46:59.620 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.620 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.620 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.620 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:46:59.620 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.620 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.620 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.621 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.621 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_promtail": { 2024-06-06T08:46:59.621 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_promtail", 2024-06-06T08:46:59.621 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.621 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.621 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.621 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-06T08:46:59.622 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.622 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.622 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.622 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Promtail container image", 2024-06-06T08:46:59.622 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.622 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.622 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.622 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.623 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_samba": { 2024-06-06T08:46:59.623 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_samba", 2024-06-06T08:46:59.623 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.623 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.623 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.623 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-06T08:46:59.623 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.623 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.624 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.624 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Samba/SMB container image", 2024-06-06T08:46:59.624 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.624 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.624 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.624 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.624 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_snmp_gateway": { 2024-06-06T08:46:59.625 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_snmp_gateway", 2024-06-06T08:46:59.625 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.625 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.625 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.625 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-06T08:46:59.625 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.625 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.625 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.626 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SNMP Gateway container image", 2024-06-06T08:46:59.626 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.626 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.626 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.626 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.626 INFO:teuthology.orchestra.run.smithi028.stdout: "container_init": { 2024-06-06T08:46:59.626 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_init", 2024-06-06T08:46:59.626 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.627 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.627 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.627 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.627 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.627 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.627 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.627 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Run podman/docker with `--init`", 2024-06-06T08:46:59.628 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.628 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.628 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.628 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.628 INFO:teuthology.orchestra.run.smithi028.stdout: "daemon_cache_timeout": { 2024-06-06T08:46:59.628 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "daemon_cache_timeout", 2024-06-06T08:46:59.628 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.628 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.628 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.629 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:46:59.629 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.629 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.629 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.629 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-06T08:46:59.629 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.629 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.629 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.630 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.630 INFO:teuthology.orchestra.run.smithi028.stdout: "default_cephadm_command_timeout": { 2024-06-06T08:46:59.630 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_cephadm_command_timeout", 2024-06-06T08:46:59.630 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.630 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.630 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.630 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "900", 2024-06-06T08:46:59.630 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.631 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.631 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.631 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-06T08:46:59.631 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.631 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.631 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.631 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.631 INFO:teuthology.orchestra.run.smithi028.stdout: "default_registry": { 2024-06-06T08:46:59.631 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_registry", 2024-06-06T08:46:59.632 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.632 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.632 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.632 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io", 2024-06-06T08:46:59.632 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.632 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.632 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.633 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-06T08:46:59.633 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.633 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.633 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.633 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.633 INFO:teuthology.orchestra.run.smithi028.stdout: "device_cache_timeout": { 2024-06-06T08:46:59.633 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_cache_timeout", 2024-06-06T08:46:59.633 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.633 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.634 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.634 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1800", 2024-06-06T08:46:59.634 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.634 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.634 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.634 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache device inventory", 2024-06-06T08:46:59.634 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.634 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.635 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.635 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.635 INFO:teuthology.orchestra.run.smithi028.stdout: "device_enhanced_scan": { 2024-06-06T08:46:59.635 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_enhanced_scan", 2024-06-06T08:46:59.635 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.635 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.635 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.635 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.636 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.636 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.636 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.636 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-06T08:46:59.636 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.636 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.636 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.636 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.637 INFO:teuthology.orchestra.run.smithi028.stdout: "facts_cache_timeout": { 2024-06-06T08:46:59.637 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "facts_cache_timeout", 2024-06-06T08:46:59.637 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.637 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.637 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.637 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:46:59.637 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.637 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.637 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.638 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache host facts data", 2024-06-06T08:46:59.638 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.638 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.638 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.638 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.638 INFO:teuthology.orchestra.run.smithi028.stdout: "grafana_dashboards_path": { 2024-06-06T08:46:59.638 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "grafana_dashboards_path", 2024-06-06T08:46:59.638 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.639 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.639 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.639 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-06T08:46:59.639 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.639 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.639 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.639 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-06T08:46:59.639 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.640 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.640 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.640 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.640 INFO:teuthology.orchestra.run.smithi028.stdout: "host_check_interval": { 2024-06-06T08:46:59.640 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "host_check_interval", 2024-06-06T08:46:59.640 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.640 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.641 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.641 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:46:59.641 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.641 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.641 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.641 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to perform a host check", 2024-06-06T08:46:59.641 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.641 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.642 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.642 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.642 INFO:teuthology.orchestra.run.smithi028.stdout: "hw_monitoring": { 2024-06-06T08:46:59.642 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hw_monitoring", 2024-06-06T08:46:59.642 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.642 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.642 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.642 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.643 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.643 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.643 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.643 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-06T08:46:59.643 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.643 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.643 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.644 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.644 INFO:teuthology.orchestra.run.smithi028.stdout: "inventory_list_all": { 2024-06-06T08:46:59.644 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "inventory_list_all", 2024-06-06T08:46:59.644 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.644 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.644 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.645 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.645 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.645 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.645 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.645 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-06T08:46:59.645 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.645 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.645 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.646 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.646 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.646 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.646 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.646 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.646 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.646 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.646 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.647 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.647 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.647 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.647 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.647 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.647 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.647 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.647 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.647 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.648 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.648 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.648 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.648 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.648 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.648 INFO:teuthology.orchestra.run.smithi028.stdout: "log_refresh_metadata": { 2024-06-06T08:46:59.648 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_refresh_metadata", 2024-06-06T08:46:59.648 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.649 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.649 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.649 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.649 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.649 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.649 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.649 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-06T08:46:59.649 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.650 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.650 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.650 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.650 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.650 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.650 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.650 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.650 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.651 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.651 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.651 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.651 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.651 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-06T08:46:59.651 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.651 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.651 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.652 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.652 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.652 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.652 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.652 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.652 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.652 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.652 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.652 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.653 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.653 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.653 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.653 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.653 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.653 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.653 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.654 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.654 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.654 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.654 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.654 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.654 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.654 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.654 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.654 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.655 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.655 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.655 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.655 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.655 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.655 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.655 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.655 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.656 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.656 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.656 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.656 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-06T08:46:59.656 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-06T08:46:59.656 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.656 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.656 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.657 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.657 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.657 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.657 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.657 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-06T08:46:59.657 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.657 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.657 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.657 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.658 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-06T08:46:59.658 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-06T08:46:59.658 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.658 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.658 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.658 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "*", 2024-06-06T08:46:59.658 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.658 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.659 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.659 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-06T08:46:59.659 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.659 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.659 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.659 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.659 INFO:teuthology.orchestra.run.smithi028.stdout: "max_count_per_host": { 2024-06-06T08:46:59.659 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_count_per_host", 2024-06-06T08:46:59.659 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.660 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.660 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.660 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:59.660 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.660 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.660 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.660 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of daemons per service per host", 2024-06-06T08:46:59.660 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.661 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.661 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.661 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.661 INFO:teuthology.orchestra.run.smithi028.stdout: "max_osd_draining_count": { 2024-06-06T08:46:59.661 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_osd_draining_count", 2024-06-06T08:46:59.661 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.661 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.661 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.661 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:59.662 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.662 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.662 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.662 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-06T08:46:59.662 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.662 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.662 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.662 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.663 INFO:teuthology.orchestra.run.smithi028.stdout: "migration_current": { 2024-06-06T08:46:59.663 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "migration_current", 2024-06-06T08:46:59.663 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.663 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.663 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.663 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.663 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.663 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.664 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.664 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "internal - do not modify", 2024-06-06T08:46:59.664 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.664 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.664 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.664 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.664 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-06-06T08:46:59.664 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-06-06T08:46:59.664 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.665 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.665 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.665 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "root", 2024-06-06T08:46:59.665 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.665 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.665 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.665 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm-package", 2024-06-06T08:46:59.665 INFO:teuthology.orchestra.run.smithi028.stdout: "root" 2024-06-06T08:46:59.666 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.666 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "mode for remote execution of cephadm", 2024-06-06T08:46:59.666 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.666 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.666 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.666 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.666 INFO:teuthology.orchestra.run.smithi028.stdout: "oob_default_addr": { 2024-06-06T08:46:59.666 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "oob_default_addr", 2024-06-06T08:46:59.667 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.667 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.667 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.667 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "169.254.1.1", 2024-06-06T08:46:59.667 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.667 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.667 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.667 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-06T08:46:59.668 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.668 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.668 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.668 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.668 INFO:teuthology.orchestra.run.smithi028.stdout: "prometheus_alerts_path": { 2024-06-06T08:46:59.668 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus_alerts_path", 2024-06-06T08:46:59.668 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.668 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.669 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.669 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-06T08:46:59.669 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.669 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.669 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.669 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-06T08:46:59.669 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.669 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.670 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.670 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.670 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_insecure": { 2024-06-06T08:46:59.670 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_insecure", 2024-06-06T08:46:59.670 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.670 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.670 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.670 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.671 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.671 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.671 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.671 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-06T08:46:59.671 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.671 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.671 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.671 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.672 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_password": { 2024-06-06T08:46:59.672 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_password", 2024-06-06T08:46:59.672 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.672 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.672 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.672 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.672 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.673 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.673 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.673 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-06T08:46:59.673 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.673 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.673 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.673 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.673 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_url": { 2024-06-06T08:46:59.674 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_url", 2024-06-06T08:46:59.674 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.674 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.674 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.674 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.674 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.674 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.674 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.675 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-06T08:46:59.675 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.675 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.675 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.675 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.675 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_username": { 2024-06-06T08:46:59.675 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_username", 2024-06-06T08:46:59.675 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.675 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.676 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.676 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.676 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.676 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.676 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.676 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-06T08:46:59.676 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.676 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.677 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.677 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.677 INFO:teuthology.orchestra.run.smithi028.stdout: "secure_monitoring_stack": { 2024-06-06T08:46:59.677 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "secure_monitoring_stack", 2024-06-06T08:46:59.677 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.677 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.677 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.677 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.678 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.678 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.678 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.678 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-06T08:46:59.678 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.678 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.678 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.678 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.679 INFO:teuthology.orchestra.run.smithi028.stdout: "service_discovery_port": { 2024-06-06T08:46:59.679 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "service_discovery_port", 2024-06-06T08:46:59.679 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.679 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.679 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.679 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8765", 2024-06-06T08:46:59.679 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.679 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.679 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.680 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "cephadm service discovery port", 2024-06-06T08:46:59.680 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.680 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.680 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.680 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.680 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_config_file": { 2024-06-06T08:46:59.680 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_config_file", 2024-06-06T08:46:59.680 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.681 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.681 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.681 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.681 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.681 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.681 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.681 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-06T08:46:59.681 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.682 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.682 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.682 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.682 INFO:teuthology.orchestra.run.smithi028.stdout: "use_agent": { 2024-06-06T08:46:59.682 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_agent", 2024-06-06T08:46:59.682 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.682 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.682 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.683 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.683 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.683 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.683 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.683 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-06T08:46:59.683 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.683 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.683 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.683 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.684 INFO:teuthology.orchestra.run.smithi028.stdout: "use_repo_digest": { 2024-06-06T08:46:59.684 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_repo_digest", 2024-06-06T08:46:59.684 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.684 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.684 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.684 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.684 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.684 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.685 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.685 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-06T08:46:59.685 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.685 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.685 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.685 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.685 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_failed_host_check": { 2024-06-06T08:46:59.685 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_failed_host_check", 2024-06-06T08:46:59.686 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.686 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.686 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.686 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.686 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.686 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.686 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.686 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if the host check fails", 2024-06-06T08:46:59.687 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.687 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.687 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.687 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.687 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_daemons": { 2024-06-06T08:46:59.687 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_daemons", 2024-06-06T08:46:59.687 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.687 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.688 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.688 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.688 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.688 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.688 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.688 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-06T08:46:59.688 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.688 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.689 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.689 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.689 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_hosts": { 2024-06-06T08:46:59.689 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_hosts", 2024-06-06T08:46:59.689 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.689 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.689 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.689 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.690 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.690 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.690 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.690 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-06T08:46:59.690 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.690 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.690 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.690 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.691 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.691 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.691 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.691 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crash", 2024-06-06T08:46:59.691 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.691 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.691 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.691 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.692 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.692 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.692 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.692 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.692 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.692 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.692 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.692 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.692 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.693 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.693 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.693 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.693 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.693 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.693 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.693 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.693 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.694 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.694 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.694 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.694 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.694 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.694 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.694 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.694 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.695 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.695 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.695 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.695 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.695 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.695 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.695 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.695 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.696 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.696 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.696 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.696 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.696 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.696 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.696 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.696 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.697 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.697 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.697 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.697 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.697 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.697 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.697 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.697 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.698 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.698 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.698 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.698 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.698 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.698 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.698 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.699 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.699 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.699 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.699 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.699 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.699 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.699 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.699 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.700 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.700 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.700 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.700 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.700 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.700 INFO:teuthology.orchestra.run.smithi028.stdout: "retain_interval": { 2024-06-06T08:46:59.700 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retain_interval", 2024-06-06T08:46:59.700 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.701 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.701 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.701 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "31536000", 2024-06-06T08:46:59.701 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.701 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.701 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.701 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-06T08:46:59.701 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.701 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.702 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.702 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.702 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_recent_interval": { 2024-06-06T08:46:59.702 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_recent_interval", 2024-06-06T08:46:59.702 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.702 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.702 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.703 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1209600", 2024-06-06T08:46:59.703 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.703 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.703 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.703 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-06T08:46:59.703 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.703 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.703 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.703 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.704 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.704 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.704 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.704 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dashboard", 2024-06-06T08:46:59.704 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.704 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.704 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.704 INFO:teuthology.orchestra.run.smithi028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-06T08:46:59.705 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-06T08:46:59.705 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.705 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.705 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.705 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:59.705 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.705 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.705 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.706 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.706 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.706 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.706 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.706 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.706 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_HOST": { 2024-06-06T08:46:59.706 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-06T08:46:59.707 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.707 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.707 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.707 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.707 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.707 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.707 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.707 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.707 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.708 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.708 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.708 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.708 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-06T08:46:59.708 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-06T08:46:59.708 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.708 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.708 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.709 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.709 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.709 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.709 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.709 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.709 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.709 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.709 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.710 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.710 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_ENABLED": { 2024-06-06T08:46:59.710 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_ENABLED", 2024-06-06T08:46:59.710 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.710 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.710 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.710 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.710 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.711 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.711 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.711 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.711 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.711 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.711 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.711 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.711 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-06T08:46:59.711 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-06T08:46:59.712 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.712 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.712 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.712 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.712 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.712 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.712 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.712 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.713 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.713 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.713 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.713 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.713 INFO:teuthology.orchestra.run.smithi028.stdout: "ENABLE_BROWSABLE_API": { 2024-06-06T08:46:59.713 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-06T08:46:59.713 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.713 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.714 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.714 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.714 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.714 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.714 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.714 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.714 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.714 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.715 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.715 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.715 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-06T08:46:59.715 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-06T08:46:59.715 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.715 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.715 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.715 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.715 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.716 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.716 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.716 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.716 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.716 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.716 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.716 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.716 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-06T08:46:59.717 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-06T08:46:59.717 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.717 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.717 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.717 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.717 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.717 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.717 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.717 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.718 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.718 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.718 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.718 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.718 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-06T08:46:59.718 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-06T08:46:59.718 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.719 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.719 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.719 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.719 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.719 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.719 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.719 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.719 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.719 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.720 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.720 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.720 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-06T08:46:59.720 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-06T08:46:59.720 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.720 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.720 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.720 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.721 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.721 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.721 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.721 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.721 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.721 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.721 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.721 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.722 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-06T08:46:59.722 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-06T08:46:59.722 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.722 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.722 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.722 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.722 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.722 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.723 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.723 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.723 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.723 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.723 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.723 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.723 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-06T08:46:59.723 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-06T08:46:59.724 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.724 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.724 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.724 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.724 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.724 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.724 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.724 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.724 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.725 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.725 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.725 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.725 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-06T08:46:59.725 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-06T08:46:59.725 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.725 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.725 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.726 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.726 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.726 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.726 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.726 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.726 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.726 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.726 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.727 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.727 INFO:teuthology.orchestra.run.smithi028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-06T08:46:59.727 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-06T08:46:59.727 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.727 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.727 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.727 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.727 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.728 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.728 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.728 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.728 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.728 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.728 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.728 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.728 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_PASSWORD": { 2024-06-06T08:46:59.729 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-06T08:46:59.729 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.729 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.729 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.729 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-06-06T08:46:59.729 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.729 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.729 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.729 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.730 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.730 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.730 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.730 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.730 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-06T08:46:59.730 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-06T08:46:59.730 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.730 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.731 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.731 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.731 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.731 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.731 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.731 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.731 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.731 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.732 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.732 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.732 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_URL": { 2024-06-06T08:46:59.732 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_URL", 2024-06-06T08:46:59.732 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.732 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.732 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.732 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.733 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.733 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.733 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.733 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.733 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.733 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.733 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.733 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.733 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_USERNAME": { 2024-06-06T08:46:59.734 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-06T08:46:59.734 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.734 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.734 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.734 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-06-06T08:46:59.734 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.734 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.734 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.735 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.735 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.735 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.735 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.735 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.735 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-06T08:46:59.735 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-06T08:46:59.735 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.736 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.736 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.736 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.736 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.736 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.736 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.736 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.736 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.736 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.737 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.737 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.737 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-06T08:46:59.737 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-06T08:46:59.737 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.737 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.737 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.737 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.738 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.738 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.738 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.738 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.738 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.738 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.738 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.739 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.739 INFO:teuthology.orchestra.run.smithi028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-06T08:46:59.739 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-06T08:46:59.739 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.739 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.739 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.739 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.739 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.739 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.740 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.740 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.740 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.740 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.740 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.740 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.740 INFO:teuthology.orchestra.run.smithi028.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-06T08:46:59.740 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-06T08:46:59.741 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.741 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.741 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.741 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.741 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.741 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.741 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.741 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.742 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.742 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.742 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.742 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.742 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_HOST": { 2024-06-06T08:46:59.742 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-06T08:46:59.742 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.742 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.743 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.743 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.743 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.743 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.743 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.743 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.743 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.743 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.744 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.744 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.744 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-06T08:46:59.744 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-06T08:46:59.744 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.744 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.744 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.744 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.744 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.745 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.745 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.745 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.745 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.745 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.745 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.745 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.745 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-06T08:46:59.746 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-06T08:46:59.746 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.746 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.746 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.746 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.746 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.746 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.746 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.746 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.747 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.747 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.747 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.747 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.747 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-06T08:46:59.747 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-06T08:46:59.747 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.747 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.748 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.748 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.748 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.748 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.748 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.748 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.748 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.748 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.749 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.749 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.749 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-06T08:46:59.749 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-06T08:46:59.749 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.749 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.749 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.749 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.749 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.750 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.750 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.750 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.750 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.750 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.750 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.750 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.750 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-06T08:46:59.751 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-06T08:46:59.751 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.751 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.751 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.751 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.751 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.751 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.752 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.752 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.752 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.752 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.752 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.752 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.752 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-06T08:46:59.752 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-06T08:46:59.752 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.753 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.753 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.753 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.753 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.753 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.753 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.753 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.753 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.754 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.754 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.754 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.754 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-06T08:46:59.754 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-06T08:46:59.754 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.754 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.754 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.755 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.755 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.755 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.755 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.755 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.755 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.755 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.755 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.756 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.756 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-06T08:46:59.756 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-06T08:46:59.756 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.756 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.756 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.756 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.756 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.756 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.757 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.757 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.757 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.757 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.757 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.757 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.757 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_ENABLED": { 2024-06-06T08:46:59.757 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-06T08:46:59.758 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.758 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.758 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.758 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.758 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.758 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.758 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.758 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.759 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.759 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.759 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.759 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.759 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-06T08:46:59.759 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-06T08:46:59.759 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.759 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.760 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.760 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-06T08:46:59.760 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.760 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.760 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.760 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.760 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.760 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.761 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.761 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.761 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-06T08:46:59.761 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-06T08:46:59.761 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.761 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.761 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.761 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:59.762 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.762 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.762 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.762 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.762 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.762 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.762 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.762 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.763 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-06T08:46:59.763 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-06T08:46:59.763 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.763 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.763 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.763 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8", 2024-06-06T08:46:59.763 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.763 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.764 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.764 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.764 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.764 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.764 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.764 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.764 INFO:teuthology.orchestra.run.smithi028.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-06T08:46:59.764 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-06T08:46:59.765 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.765 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.765 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.765 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "45", 2024-06-06T08:46:59.765 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.765 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.765 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.765 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.766 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.766 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.766 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.766 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.766 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ACCESS_KEY": { 2024-06-06T08:46:59.766 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-06T08:46:59.766 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.766 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.766 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.767 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.767 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.767 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.767 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.767 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.767 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.767 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.767 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.768 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.768 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-06T08:46:59.768 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-06T08:46:59.768 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.768 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.768 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.768 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-06-06T08:46:59.768 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.769 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.769 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.769 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.769 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.769 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.769 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.769 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.769 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SECRET_KEY": { 2024-06-06T08:46:59.770 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-06T08:46:59.770 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.770 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.770 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.770 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.770 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.770 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.770 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.771 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.771 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.771 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.771 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.771 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.771 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SSL_VERIFY": { 2024-06-06T08:46:59.771 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-06T08:46:59.771 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.771 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.772 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.772 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.772 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.772 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.772 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.772 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.772 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.772 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.773 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.773 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.773 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-06T08:46:59.773 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-06T08:46:59.773 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.773 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.773 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.773 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:46:59.774 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.774 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.774 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.774 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.774 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.774 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.774 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.774 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-06T08:46:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-06T08:46:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.775 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.776 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.776 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.776 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.776 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.776 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.776 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.776 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-06T08:46:59.777 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-06T08:46:59.777 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.777 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.777 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.777 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:46:59.777 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.777 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.777 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.778 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.778 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.778 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.778 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.778 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.778 INFO:teuthology.orchestra.run.smithi028.stdout: "cross_origin_url": { 2024-06-06T08:46:59.778 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cross_origin_url", 2024-06-06T08:46:59.778 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.779 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.779 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.779 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.779 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.779 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.779 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.779 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.779 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.780 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.780 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.780 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.780 INFO:teuthology.orchestra.run.smithi028.stdout: "crt_file": { 2024-06-06T08:46:59.780 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crt_file", 2024-06-06T08:46:59.780 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.780 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.780 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.781 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.781 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.781 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.781 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.781 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.781 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.781 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.781 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.781 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.782 INFO:teuthology.orchestra.run.smithi028.stdout: "debug": { 2024-06-06T08:46:59.782 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "debug", 2024-06-06T08:46:59.782 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.782 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.782 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.782 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.782 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.783 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.783 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.783 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable/disable debug options", 2024-06-06T08:46:59.783 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.783 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.783 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.783 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.783 INFO:teuthology.orchestra.run.smithi028.stdout: "jwt_token_ttl": { 2024-06-06T08:46:59.784 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "jwt_token_ttl", 2024-06-06T08:46:59.784 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.784 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.784 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.784 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "28800", 2024-06-06T08:46:59.784 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.784 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.784 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.784 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.785 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.785 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.785 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.785 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.785 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-06-06T08:46:59.785 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-06-06T08:46:59.785 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.785 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.786 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.786 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.786 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.786 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.786 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.786 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.786 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.786 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.787 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.787 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.787 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.787 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.787 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.787 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.787 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.787 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.787 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.788 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.788 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.788 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.788 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.788 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.788 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.788 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.788 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.788 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.789 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.789 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.789 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.789 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.789 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.789 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.789 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.790 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.790 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.790 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.790 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.790 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.790 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.790 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.790 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.791 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.791 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.791 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.791 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.791 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.791 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.791 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.791 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.792 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.792 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.792 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.792 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.792 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.792 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.792 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.792 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.792 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.793 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.793 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.793 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.793 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.793 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.793 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.793 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.793 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.794 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.794 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.794 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.794 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.794 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.794 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.794 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.794 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.795 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.795 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.795 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.795 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.795 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.795 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.795 INFO:teuthology.orchestra.run.smithi028.stdout: "motd": { 2024-06-06T08:46:59.795 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "motd", 2024-06-06T08:46:59.796 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.796 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.796 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.796 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.796 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.796 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.796 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.796 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "The message of the day", 2024-06-06T08:46:59.797 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.797 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.797 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.797 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.797 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect_resolve_ip_addr": { 2024-06-06T08:46:59.797 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "redirect_resolve_ip_addr", 2024-06-06T08:46:59.797 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.797 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.798 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.798 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.798 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.798 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.798 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.798 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.798 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.798 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.799 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.799 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.799 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-06-06T08:46:59.799 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-06-06T08:46:59.799 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.799 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.799 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.799 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-06-06T08:46:59.800 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.800 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.800 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.800 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.800 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.800 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.800 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.800 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.801 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-06-06T08:46:59.801 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-06-06T08:46:59.801 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.801 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.801 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.801 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8080", 2024-06-06T08:46:59.801 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.801 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.802 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.802 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.802 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.802 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.802 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.802 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.802 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-06-06T08:46:59.802 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-06-06T08:46:59.802 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.803 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.803 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.803 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.803 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.803 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.803 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.803 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.803 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.804 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.804 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.804 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.804 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl_server_port": { 2024-06-06T08:46:59.804 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl_server_port", 2024-06-06T08:46:59.804 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.804 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.804 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.805 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8443", 2024-06-06T08:46:59.805 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.805 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.805 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.805 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.805 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.805 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.805 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.806 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.806 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-06-06T08:46:59.806 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-06-06T08:46:59.806 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.806 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.806 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.806 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "redirect", 2024-06-06T08:46:59.806 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.806 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.807 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.807 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.807 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect" 2024-06-06T08:46:59.807 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.807 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.807 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.807 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.807 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.808 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.808 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-06-06T08:46:59.808 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-06-06T08:46:59.808 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.808 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.808 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.808 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-06-06T08:46:59.808 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-06-06T08:46:59.809 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-06-06T08:46:59.809 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.809 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.809 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.809 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.809 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.809 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.809 INFO:teuthology.orchestra.run.smithi028.stdout: "url_prefix": { 2024-06-06T08:46:59.810 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url_prefix", 2024-06-06T08:46:59.810 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.810 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.810 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.810 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.810 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.810 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.810 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.810 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.811 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.811 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.811 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.811 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.811 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.811 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.811 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.811 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "devicehealth", 2024-06-06T08:46:59.812 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.812 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.812 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.812 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_monitoring": { 2024-06-06T08:46:59.812 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_monitoring", 2024-06-06T08:46:59.812 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.812 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.812 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.813 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.813 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.813 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.813 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.813 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "monitor device health metrics", 2024-06-06T08:46:59.813 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.813 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.813 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.814 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.814 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.814 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.814 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.814 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.814 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.814 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.814 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.815 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.815 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.815 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.815 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.815 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.815 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.815 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.816 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.816 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.816 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.816 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.816 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.816 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.816 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.817 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.817 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.817 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.817 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.817 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.817 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.817 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.817 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.818 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.818 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.818 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.818 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.818 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.818 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.818 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.818 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.819 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.819 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.819 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.819 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.819 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.819 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.819 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.819 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.820 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.820 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.820 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.820 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.820 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.820 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.820 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.820 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.821 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.821 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.821 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.821 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.821 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.821 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.821 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.821 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.821 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.822 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.822 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.822 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.822 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.822 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.822 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.822 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.822 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.823 INFO:teuthology.orchestra.run.smithi028.stdout: "mark_out_threshold": { 2024-06-06T08:46:59.823 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mark_out_threshold", 2024-06-06T08:46:59.823 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.823 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.823 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.823 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2419200", 2024-06-06T08:46:59.823 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.823 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.824 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.824 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-06T08:46:59.824 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.824 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.824 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.824 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.824 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_name": { 2024-06-06T08:46:59.824 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_name", 2024-06-06T08:46:59.825 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.825 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.825 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.825 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "device_health_metrics", 2024-06-06T08:46:59.825 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.825 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.825 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.825 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-06T08:46:59.825 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.826 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.826 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.826 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.826 INFO:teuthology.orchestra.run.smithi028.stdout: "retention_period": { 2024-06-06T08:46:59.826 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retention_period", 2024-06-06T08:46:59.826 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.826 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.826 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.827 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15552000", 2024-06-06T08:46:59.827 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.827 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.827 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.827 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain device health metrics", 2024-06-06T08:46:59.827 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.827 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.827 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.828 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.828 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_frequency": { 2024-06-06T08:46:59.828 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_frequency", 2024-06-06T08:46:59.828 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.828 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.828 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.828 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-06-06T08:46:59.828 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.829 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.829 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.829 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-06T08:46:59.829 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.829 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.829 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.829 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.829 INFO:teuthology.orchestra.run.smithi028.stdout: "self_heal": { 2024-06-06T08:46:59.829 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "self_heal", 2024-06-06T08:46:59.830 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.830 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.830 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.830 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:46:59.830 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.830 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.830 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.830 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-06T08:46:59.831 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.831 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.831 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.831 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.831 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:46:59.831 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:46:59.831 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.831 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.832 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.832 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:46:59.832 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.832 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.832 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.832 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and check device health", 2024-06-06T08:46:59.832 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.832 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.832 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.833 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.833 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_threshold": { 2024-06-06T08:46:59.833 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_threshold", 2024-06-06T08:46:59.833 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.833 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.833 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.833 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7257600", 2024-06-06T08:46:59.833 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.834 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.834 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.834 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-06T08:46:59.834 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.834 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.834 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.834 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.834 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.835 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.835 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.835 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "diskprediction_local", 2024-06-06T08:46:59.835 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.835 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.835 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.835 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.835 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.836 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.836 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.836 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.836 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.836 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.836 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.836 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.836 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.836 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.837 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.837 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.837 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.837 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.837 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.837 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.837 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.837 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.838 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.838 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.838 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.838 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.838 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.838 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.838 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.838 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.839 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.839 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.839 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.839 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.839 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.839 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.839 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.839 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.840 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.840 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.840 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.840 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.840 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.840 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.840 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.840 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.841 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.841 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.841 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.841 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.841 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.841 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.841 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.841 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.842 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.842 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.842 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.842 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.842 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.842 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.842 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.842 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.843 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.843 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.843 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.843 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.843 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.843 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.843 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.843 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.843 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.844 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.844 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.844 INFO:teuthology.orchestra.run.smithi028.stdout: "predict_interval": { 2024-06-06T08:46:59.844 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predict_interval", 2024-06-06T08:46:59.844 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.844 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.844 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.844 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-06-06T08:46:59.844 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.845 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.845 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.845 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.845 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.845 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.845 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.845 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.845 INFO:teuthology.orchestra.run.smithi028.stdout: "predictor_model": { 2024-06-06T08:46:59.846 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predictor_model", 2024-06-06T08:46:59.846 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.846 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.846 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.846 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "prophetstor", 2024-06-06T08:46:59.846 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.846 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.846 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.847 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.847 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.847 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.847 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.847 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.847 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:46:59.847 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:46:59.847 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.847 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.847 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.848 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:46:59.848 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.848 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.848 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.848 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.848 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.848 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.848 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.848 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.849 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.849 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.849 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.849 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "influx", 2024-06-06T08:46:59.849 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": false, 2024-06-06T08:46:59.849 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "influxdb python module not found", 2024-06-06T08:46:59.849 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.849 INFO:teuthology.orchestra.run.smithi028.stdout: "batch_size": { 2024-06-06T08:46:59.849 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "batch_size", 2024-06-06T08:46:59.850 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.850 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.850 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.850 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5000", 2024-06-06T08:46:59.850 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.850 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.850 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.850 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-06T08:46:59.851 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.851 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.851 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.851 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.851 INFO:teuthology.orchestra.run.smithi028.stdout: "database": { 2024-06-06T08:46:59.851 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "database", 2024-06-06T08:46:59.851 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.851 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.851 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.852 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "ceph", 2024-06-06T08:46:59.852 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.852 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.852 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.852 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-06T08:46:59.852 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.852 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.852 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.853 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.853 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": { 2024-06-06T08:46:59.853 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hostname", 2024-06-06T08:46:59.853 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.853 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.853 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.853 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.853 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.854 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.854 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.854 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server hostname", 2024-06-06T08:46:59.854 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.854 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.854 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.854 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.855 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:46:59.855 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:46:59.855 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:46:59.855 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.855 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.855 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "30", 2024-06-06T08:46:59.855 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "5", 2024-06-06T08:46:59.855 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.855 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.856 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-06T08:46:59.856 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.856 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.856 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.856 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.856 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.856 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.856 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.857 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.857 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.857 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.857 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.857 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.857 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.857 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.857 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.857 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.857 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.858 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.858 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.858 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.858 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.858 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.858 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.858 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.858 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.859 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.859 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.859 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.859 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.859 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.859 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.859 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.859 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.859 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.860 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.860 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.860 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.860 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.860 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.860 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.860 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.860 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.861 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.861 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.861 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.861 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.861 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.861 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.861 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.861 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.862 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.862 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.862 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.862 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.862 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.862 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.862 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.863 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.863 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.863 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.863 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.863 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.863 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.863 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.863 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.863 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.864 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.864 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.864 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.864 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.864 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.864 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.864 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.864 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.865 INFO:teuthology.orchestra.run.smithi028.stdout: "password": { 2024-06-06T08:46:59.865 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "password", 2024-06-06T08:46:59.865 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.865 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.865 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.865 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.865 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.865 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.866 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.866 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "password of InfluxDB server user", 2024-06-06T08:46:59.866 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.866 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.866 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.866 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.866 INFO:teuthology.orchestra.run.smithi028.stdout: "port": { 2024-06-06T08:46:59.866 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "port", 2024-06-06T08:46:59.867 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.867 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.867 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.867 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8086", 2024-06-06T08:46:59.867 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.867 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.867 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.867 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server port", 2024-06-06T08:46:59.867 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.868 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.868 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.868 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.868 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-06-06T08:46:59.868 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-06-06T08:46:59.868 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.868 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.868 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.869 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "false", 2024-06-06T08:46:59.869 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.869 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.869 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.869 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T08:46:59.869 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.869 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.869 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.870 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.870 INFO:teuthology.orchestra.run.smithi028.stdout: "threads": { 2024-06-06T08:46:59.870 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threads", 2024-06-06T08:46:59.870 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.870 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.870 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.870 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:46:59.870 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:46:59.871 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "32", 2024-06-06T08:46:59.871 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.871 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-06T08:46:59.871 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.871 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.871 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.871 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.871 INFO:teuthology.orchestra.run.smithi028.stdout: "username": { 2024-06-06T08:46:59.872 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "username", 2024-06-06T08:46:59.872 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.872 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.872 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.872 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.872 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.872 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.872 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.872 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "username of InfluxDB server user", 2024-06-06T08:46:59.873 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.873 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.873 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.873 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.873 INFO:teuthology.orchestra.run.smithi028.stdout: "verify_ssl": { 2024-06-06T08:46:59.873 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "verify_ssl", 2024-06-06T08:46:59.873 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.873 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.873 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.874 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "true", 2024-06-06T08:46:59.874 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.874 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.874 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.874 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T08:46:59.874 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.874 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.875 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.875 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.875 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.875 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.875 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.875 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "insights", 2024-06-06T08:46:59.875 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.875 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.876 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.876 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.876 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.876 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.876 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.876 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.876 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.876 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.877 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.877 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.877 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.877 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.877 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.877 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.877 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.877 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.877 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.878 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.878 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.878 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.878 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.878 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.878 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.878 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.878 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.879 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.879 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.879 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.879 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.879 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.879 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.879 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.879 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.880 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.880 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.880 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.880 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.880 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.880 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.880 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.881 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.881 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.881 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.881 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.881 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.881 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.881 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.881 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.881 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.882 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.882 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.882 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.882 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.882 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.882 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.882 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.882 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.883 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.883 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.883 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.883 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.883 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.883 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.883 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.883 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.884 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.884 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.884 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.884 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.884 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.884 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.884 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.884 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.885 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.885 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "iostat", 2024-06-06T08:46:59.885 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.885 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.885 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.885 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.885 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.885 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.886 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.886 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.886 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.886 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.886 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.886 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.886 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.886 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.887 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.887 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.887 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.887 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.887 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.887 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.887 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.887 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.887 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.888 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.888 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.888 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.888 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.888 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.888 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.888 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.888 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.889 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.889 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.889 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.889 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.889 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.889 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.890 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.890 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.890 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.890 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.890 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.890 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.890 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.891 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.891 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.891 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.891 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.891 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.891 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.891 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.891 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.891 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.892 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.892 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.892 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.892 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.892 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.892 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.892 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.892 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.893 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.893 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.893 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.893 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.893 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.893 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.893 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.893 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.894 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.894 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.894 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.894 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.894 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.894 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.894 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.894 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "k8sevents", 2024-06-06T08:46:59.895 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.895 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.895 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.895 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_event_retention_days": { 2024-06-06T08:46:59.895 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ceph_event_retention_days", 2024-06-06T08:46:59.895 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.895 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.896 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.896 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7", 2024-06-06T08:46:59.896 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.896 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.896 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.896 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-06T08:46:59.896 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.896 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.897 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.897 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.897 INFO:teuthology.orchestra.run.smithi028.stdout: "config_check_secs": { 2024-06-06T08:46:59.897 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_check_secs", 2024-06-06T08:46:59.897 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.897 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.897 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.898 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:46:59.898 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "10", 2024-06-06T08:46:59.898 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.898 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.898 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-06T08:46:59.898 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.898 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.899 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.899 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.899 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.899 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.899 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.899 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.899 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.899 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.900 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.900 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.900 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.900 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.900 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.900 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.900 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.900 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.900 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.901 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.901 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.901 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.901 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.901 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.901 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.902 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.902 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.902 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.902 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.902 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.902 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.902 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.902 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.903 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.903 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.903 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.903 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.903 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.903 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.903 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.903 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.904 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.904 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.904 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.904 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.904 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.904 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.904 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.904 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.905 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.905 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.905 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.905 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.905 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.905 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.905 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.905 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.906 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.906 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.906 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.906 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.906 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.906 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.906 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.906 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.907 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.907 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.907 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.907 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.907 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.907 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.907 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.907 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.907 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.908 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.908 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.908 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.908 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "localpool", 2024-06-06T08:46:59.908 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.908 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.908 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.908 INFO:teuthology.orchestra.run.smithi028.stdout: "failure_domain": { 2024-06-06T08:46:59.908 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "failure_domain", 2024-06-06T08:46:59.909 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.909 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.909 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.909 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "host", 2024-06-06T08:46:59.909 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.909 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.909 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.909 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "failure domain for any created local pool", 2024-06-06T08:46:59.910 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-06T08:46:59.910 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.910 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.910 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.910 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.910 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.910 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.910 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.911 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.911 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.911 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.911 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.911 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.911 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.911 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.911 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.912 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.912 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.912 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.912 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.912 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.912 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.912 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.912 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.912 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.913 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.913 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.913 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.913 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.913 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.913 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.913 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.913 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.914 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.914 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.914 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.914 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.914 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.914 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.914 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.914 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.915 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.915 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.915 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.915 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.915 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.915 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.915 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.915 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.916 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.916 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.916 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.916 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.916 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.916 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.916 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.916 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.917 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.917 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.917 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.917 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.917 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.917 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.917 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.918 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.918 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.918 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.918 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.918 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.918 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.918 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.918 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.919 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.919 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.919 INFO:teuthology.orchestra.run.smithi028.stdout: "min_size": { 2024-06-06T08:46:59.919 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_size", 2024-06-06T08:46:59.919 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.919 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.919 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.919 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.920 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.920 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.920 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.920 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default min_size for any created local pool", 2024-06-06T08:46:59.920 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-06T08:46:59.920 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.920 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.921 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.921 INFO:teuthology.orchestra.run.smithi028.stdout: "num_rep": { 2024-06-06T08:46:59.921 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "num_rep", 2024-06-06T08:46:59.921 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.921 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.921 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.921 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3", 2024-06-06T08:46:59.921 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.921 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.922 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.922 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default replica count for any created local pool", 2024-06-06T08:46:59.922 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.922 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.922 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.922 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.922 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_num": { 2024-06-06T08:46:59.923 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_num", 2024-06-06T08:46:59.923 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:46:59.923 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.923 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.923 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "128", 2024-06-06T08:46:59.923 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.924 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.924 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.924 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default pg_num for any created local pool", 2024-06-06T08:46:59.924 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.924 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.924 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.924 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.924 INFO:teuthology.orchestra.run.smithi028.stdout: "prefix": { 2024-06-06T08:46:59.925 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prefix", 2024-06-06T08:46:59.925 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.925 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.925 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.925 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.925 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.925 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.926 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.926 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name prefix for any created local pool", 2024-06-06T08:46:59.926 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.926 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.926 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.926 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.926 INFO:teuthology.orchestra.run.smithi028.stdout: "subtree": { 2024-06-06T08:46:59.926 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "subtree", 2024-06-06T08:46:59.927 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.927 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.927 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.927 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "rack", 2024-06-06T08:46:59.927 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.927 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.927 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.927 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-06T08:46:59.927 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-06T08:46:59.928 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.928 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.928 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.928 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.928 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.928 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.928 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mds_autoscaler", 2024-06-06T08:46:59.928 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.928 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.929 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.929 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.929 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.929 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.929 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.929 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.929 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.929 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.930 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.930 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.930 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.930 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.930 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.930 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.930 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.931 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.931 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.931 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.931 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.931 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.931 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.931 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.932 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.932 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.932 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.932 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.932 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.932 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.932 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.932 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.933 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.933 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.933 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.933 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.933 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.933 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.933 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.933 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.934 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.934 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.934 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.934 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.934 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.934 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.934 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.934 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.935 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.935 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.935 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.935 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.935 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.935 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.935 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.935 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.936 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.936 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.936 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.936 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.936 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.936 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.936 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.936 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.936 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.937 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.937 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.937 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.937 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.937 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.937 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.937 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.937 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.938 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.938 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.938 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.938 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirroring", 2024-06-06T08:46:59.938 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.938 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.938 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.938 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.939 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.939 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.939 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.939 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.939 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.939 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.939 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.939 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.940 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.940 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.940 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.940 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.940 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.940 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.940 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.940 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.941 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.941 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.941 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.941 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.941 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.941 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.941 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.942 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.942 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.942 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.942 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.942 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.942 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.942 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.943 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.943 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.943 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.943 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.943 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.943 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.943 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.944 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.944 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.944 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.944 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.944 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.944 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.944 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.944 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.945 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.945 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.945 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.945 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.945 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.945 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.945 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.945 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.946 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.946 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.946 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.946 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.946 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.946 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.946 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.946 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.947 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.947 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.947 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.947 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.947 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.947 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.947 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.947 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.948 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.948 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.948 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.948 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "nfs", 2024-06-06T08:46:59.948 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.948 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.948 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.949 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.949 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.949 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.949 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.949 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.949 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.950 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.950 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.950 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.950 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.950 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.950 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.950 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.951 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.951 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.951 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.951 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.951 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.951 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.951 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.951 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.952 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.952 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.952 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.952 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.952 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.952 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.952 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.952 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.952 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.953 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.953 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.953 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.953 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.953 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.953 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.953 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.953 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.954 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.954 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.954 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.954 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.954 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.954 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.954 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.954 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.955 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.955 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.955 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.955 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.955 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.955 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.955 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.956 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.956 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.956 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.956 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.956 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.956 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.956 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.957 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.957 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.957 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.957 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.957 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.957 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.957 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.957 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.957 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.958 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.958 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.958 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.958 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.958 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-06-06T08:46:59.958 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.958 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.958 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.959 INFO:teuthology.orchestra.run.smithi028.stdout: "fail_fs": { 2024-06-06T08:46:59.959 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "fail_fs", 2024-06-06T08:46:59.959 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.959 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.959 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:46:59.959 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.959 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.959 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.960 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.960 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-06T08:46:59.960 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.960 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.960 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.960 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.960 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.961 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.961 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.961 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.961 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.961 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.961 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.961 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.961 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.962 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.962 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.962 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.962 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.962 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.962 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.962 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.962 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.963 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.963 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.963 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.963 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.963 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.963 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.963 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.963 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.965 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.966 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.966 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.966 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.966 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.966 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.966 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.966 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.966 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.967 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.967 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.967 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.967 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.967 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.967 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.967 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.967 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.968 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.968 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.968 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.968 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.968 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.968 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.968 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.968 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.969 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.969 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.969 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.969 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.969 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.969 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.969 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.969 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.969 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.970 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.970 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.970 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.970 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.970 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.970 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.970 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.970 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.971 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.971 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.971 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.971 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator": { 2024-06-06T08:46:59.971 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-06-06T08:46:59.971 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.971 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.971 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.971 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.972 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.972 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.972 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.972 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm", 2024-06-06T08:46:59.972 INFO:teuthology.orchestra.run.smithi028.stdout: "rook", 2024-06-06T08:46:59.972 INFO:teuthology.orchestra.run.smithi028.stdout: "test_orchestrator" 2024-06-06T08:46:59.972 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.972 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Orchestrator backend", 2024-06-06T08:46:59.972 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.973 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.973 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.973 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.973 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.973 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.973 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.973 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_perf_query", 2024-06-06T08:46:59.973 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.973 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.974 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.974 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.974 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.974 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.974 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.974 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.974 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.974 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.975 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.975 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.975 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.975 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.975 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.975 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.975 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.975 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.976 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.976 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.976 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.976 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.976 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.976 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.976 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.976 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.977 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.977 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.977 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.977 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.977 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.977 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.977 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.977 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.978 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.978 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.978 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.978 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.978 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.978 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.978 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.978 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.979 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.979 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.979 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.979 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.979 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.979 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.979 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.979 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.980 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.980 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.980 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.980 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.980 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.980 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.980 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.980 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.981 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.981 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.981 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.981 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.981 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.981 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.981 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.981 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.982 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.982 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.982 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.982 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.982 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.982 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.982 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.982 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.983 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.983 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.983 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_support", 2024-06-06T08:46:59.983 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.983 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.983 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.983 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.983 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.984 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.984 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.984 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.984 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.984 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.984 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.984 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.984 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.985 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.985 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.985 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.985 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.985 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.985 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.985 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.985 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.986 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.986 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.986 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.986 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.986 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.986 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.986 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.986 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.987 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.987 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.987 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.987 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.987 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.987 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.987 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.987 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.988 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.988 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.988 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.988 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.988 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.988 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.988 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.988 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.989 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.989 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.989 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.989 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.989 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.989 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.989 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.989 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.990 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.990 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.990 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.990 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.990 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.990 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.990 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:46:59.990 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:46:59.991 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.991 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.991 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.991 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.991 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.991 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.991 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.991 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.992 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.992 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.992 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.992 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.992 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:46:59.992 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.992 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:46:59.992 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_autoscaler", 2024-06-06T08:46:59.992 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:46:59.993 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:46:59.993 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:46:59.993 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:46:59.993 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:46:59.993 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.993 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.993 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.993 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:46:59.994 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.994 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.994 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.994 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.994 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.995 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:46:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:46:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:46:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:46:59.996 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.997 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.997 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:46:59.997 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:46:59.997 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:46:59.997 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:46:59.997 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:46:59.997 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:46:59.997 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:46:59.998 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:46:59.998 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:46:59.998 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:46:59.998 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:46:59.998 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:46:59.998 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:46:59.998 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:46:59.998 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:46:59.999 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:46:59.999 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:46:59.999 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:46:59.999 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:46:59.999 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:46:59.999 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:46:59.999 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:46:59.999 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.000 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.000 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.000 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.000 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.000 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.000 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.000 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.000 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.000 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.001 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.001 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.001 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.001 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.001 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.001 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.001 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.001 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.001 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.002 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:47:00.002 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:47:00.002 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.002 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.002 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.002 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:47:00.002 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.002 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.003 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.003 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.003 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.003 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.003 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.003 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.003 INFO:teuthology.orchestra.run.smithi028.stdout: "threshold": { 2024-06-06T08:47:00.003 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threshold", 2024-06-06T08:47:00.003 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:47:00.004 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.004 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.004 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-06-06T08:47:00.004 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1.0", 2024-06-06T08:47:00.004 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.004 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.005 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "scaling threshold", 2024-06-06T08:47:00.005 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-06T08:47:00.005 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.005 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.005 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.005 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.005 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.006 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.006 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "progress", 2024-06-06T08:47:00.006 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.006 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.006 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.006 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_pg_recovery_event": { 2024-06-06T08:47:00.006 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_pg_recovery_event", 2024-06-06T08:47:00.006 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.007 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.007 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.007 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.007 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.007 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.007 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.007 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-06T08:47:00.007 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.008 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.008 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.008 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.008 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-06-06T08:47:00.008 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-06-06T08:47:00.008 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.008 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.008 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.009 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.009 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.009 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.009 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.009 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.009 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.009 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.009 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.009 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.010 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.010 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.010 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.010 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.010 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.010 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.010 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.010 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.011 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.011 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.011 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.011 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.011 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.011 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.011 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.011 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.012 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.012 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.012 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.012 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.012 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.012 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.012 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.012 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.013 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.013 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.013 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.013 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.013 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.013 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.013 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.013 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.013 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.014 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.014 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.014 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.014 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.014 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.014 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.014 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.015 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.015 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.015 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.015 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.015 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.015 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.015 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.015 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.016 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.016 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.016 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.016 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.016 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.016 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.016 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.017 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.017 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.017 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.017 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.017 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.017 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.017 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.017 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.017 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.018 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.018 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.018 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.018 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.018 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.018 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.018 INFO:teuthology.orchestra.run.smithi028.stdout: "max_completed_events": { 2024-06-06T08:47:00.018 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_completed_events", 2024-06-06T08:47:00.019 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.019 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.019 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.019 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "50", 2024-06-06T08:47:00.019 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.019 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.019 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.019 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "number of past completed events to remember", 2024-06-06T08:47:00.020 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.020 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.020 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.020 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.020 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:47:00.020 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:47:00.020 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.020 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.021 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.021 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:47:00.021 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.021 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.021 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.021 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long the module is going to sleep", 2024-06-06T08:47:00.021 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.021 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.021 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.022 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.022 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.022 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.022 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.022 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus", 2024-06-06T08:47:00.022 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.022 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.023 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.023 INFO:teuthology.orchestra.run.smithi028.stdout: "cache": { 2024-06-06T08:47:00.023 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cache", 2024-06-06T08:47:00.023 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.023 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.023 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.023 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.023 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.024 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.024 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.024 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.024 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.024 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.024 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.024 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.024 INFO:teuthology.orchestra.run.smithi028.stdout: "exclude_perf_counters": { 2024-06-06T08:47:00.024 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "exclude_perf_counters", 2024-06-06T08:47:00.025 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.025 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.025 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.025 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.025 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.025 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.025 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.025 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-06T08:47:00.026 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-06T08:47:00.026 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.026 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.026 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.026 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.026 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.026 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.027 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.027 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.027 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.027 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.027 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.027 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.027 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.028 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.028 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.028 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.028 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.028 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.028 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.028 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.028 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.029 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.029 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.029 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.029 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.029 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.029 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.029 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.029 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.030 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.030 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.030 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.030 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.030 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.030 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.030 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.030 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.030 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.031 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.031 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.031 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.031 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.031 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.031 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.031 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.031 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.032 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.032 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.032 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.032 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.032 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.032 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.032 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.032 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.032 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.033 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.033 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.033 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.033 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.033 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.033 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.033 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.033 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.034 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.034 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.034 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.034 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.034 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.034 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.034 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.034 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.035 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.035 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.035 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools": { 2024-06-06T08:47:00.035 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools", 2024-06-06T08:47:00.035 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.035 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.035 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.036 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.036 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.036 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.036 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.036 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.036 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.036 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.037 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.037 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.037 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-06T08:47:00.037 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-06T08:47:00.037 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.037 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.037 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.037 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "300", 2024-06-06T08:47:00.038 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.038 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.038 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.038 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.038 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.038 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.038 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.038 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.039 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_interval": { 2024-06-06T08:47:00.039 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_interval", 2024-06-06T08:47:00.039 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:47:00.039 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.039 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.039 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15.0", 2024-06-06T08:47:00.039 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.039 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.039 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.040 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.040 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.040 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.040 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.040 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.040 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-06-06T08:47:00.040 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-06-06T08:47:00.040 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.041 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.041 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.041 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-06-06T08:47:00.041 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.041 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.041 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.041 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-06T08:47:00.041 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.041 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.042 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.042 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.042 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-06-06T08:47:00.042 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-06-06T08:47:00.042 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.042 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.042 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.042 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "9283", 2024-06-06T08:47:00.043 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.043 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.043 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.043 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-06T08:47:00.043 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.043 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.043 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.043 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.044 INFO:teuthology.orchestra.run.smithi028.stdout: "stale_cache_strategy": { 2024-06-06T08:47:00.044 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stale_cache_strategy", 2024-06-06T08:47:00.044 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.044 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.044 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.044 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "log", 2024-06-06T08:47:00.044 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.044 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.044 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.045 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.045 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.045 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.045 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.045 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.045 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-06-06T08:47:00.045 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-06-06T08:47:00.046 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.046 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.046 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.046 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "default", 2024-06-06T08:47:00.046 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.046 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.046 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.046 INFO:teuthology.orchestra.run.smithi028.stdout: "default", 2024-06-06T08:47:00.047 INFO:teuthology.orchestra.run.smithi028.stdout: "error" 2024-06-06T08:47:00.047 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.047 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.047 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.047 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.047 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.047 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.047 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-06-06T08:47:00.048 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-06-06T08:47:00.048 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.048 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.048 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.048 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-06-06T08:47:00.048 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-06-06T08:47:00.048 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-06-06T08:47:00.048 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.049 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.049 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.049 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.049 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.049 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.049 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.049 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.049 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.050 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_support", 2024-06-06T08:47:00.050 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.050 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.050 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.050 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.050 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.050 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.050 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.051 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.051 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.051 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.051 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.051 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.051 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.051 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.051 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.052 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.052 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.052 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.052 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.052 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.052 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.052 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.052 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.053 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.053 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.053 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.053 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.053 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.053 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.053 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.053 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.053 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.054 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.054 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.054 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.054 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.054 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.054 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.054 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.054 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.055 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.055 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.055 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.055 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.055 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.055 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.055 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.055 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.056 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.056 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.056 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.056 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.056 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.056 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.056 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.056 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.057 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.057 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.057 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.057 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.057 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.057 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.057 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.057 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.058 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.058 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.058 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.058 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.058 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.058 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.058 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.058 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.058 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.059 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_snap_create": { 2024-06-06T08:47:00.059 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_snap_create", 2024-06-06T08:47:00.059 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.059 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.059 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.059 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:47:00.059 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.059 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.060 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.060 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.060 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.060 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.060 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.060 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.060 INFO:teuthology.orchestra.run.smithi028.stdout: "mirror_snapshot_schedule": { 2024-06-06T08:47:00.060 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirror_snapshot_schedule", 2024-06-06T08:47:00.061 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.061 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.061 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.061 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.061 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.061 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.061 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.061 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.061 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.062 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.062 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.062 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.062 INFO:teuthology.orchestra.run.smithi028.stdout: "trash_purge_schedule": { 2024-06-06T08:47:00.062 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "trash_purge_schedule", 2024-06-06T08:47:00.062 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.062 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.062 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.063 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.063 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.063 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.063 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.063 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.063 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.063 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.063 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.064 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.064 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.064 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.064 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.064 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "restful", 2024-06-06T08:47:00.064 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.064 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.064 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.065 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_auth": { 2024-06-06T08:47:00.065 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_auth", 2024-06-06T08:47:00.065 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.065 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.065 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.065 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.065 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.065 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.065 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.066 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.066 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.066 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.066 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.066 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.066 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-06-06T08:47:00.066 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-06-06T08:47:00.066 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.067 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.067 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.067 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.067 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.067 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.067 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.067 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.067 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.068 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.068 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.068 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.068 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.068 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.068 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.068 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.068 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.068 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.069 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.069 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.069 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.069 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.069 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.069 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.069 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.070 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.070 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.070 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.070 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.070 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.070 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.070 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.070 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.071 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.071 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.071 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.071 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.071 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.071 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.071 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.071 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.072 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.072 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.072 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.072 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.072 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.072 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.072 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.072 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.072 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.073 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.073 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.073 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.073 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.073 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.073 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.073 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.074 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.074 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.074 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.074 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.074 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.074 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.074 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.074 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.075 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.075 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.075 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.075 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.075 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.075 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.075 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.075 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.076 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.076 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.076 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.076 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.076 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.076 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.076 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.076 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.076 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.077 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-06-06T08:47:00.077 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-06-06T08:47:00.077 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.077 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.077 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.077 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.077 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.077 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.078 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.078 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.078 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.078 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.078 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.078 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.078 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-06-06T08:47:00.079 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-06-06T08:47:00.079 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.079 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.079 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.079 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.079 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.079 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.079 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.079 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.080 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.080 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.080 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.080 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.080 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.080 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.080 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.080 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rgw", 2024-06-06T08:47:00.081 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.081 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.081 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.081 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.081 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.081 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.081 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.082 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.082 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.082 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.082 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.082 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.082 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.082 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.082 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.083 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.083 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.083 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.083 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.083 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.083 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.083 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.084 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.084 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.084 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.084 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.084 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.084 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.085 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.085 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.085 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.085 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.085 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.085 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.085 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.086 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.086 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.086 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.086 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.086 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.086 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.086 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.086 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.087 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.087 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.087 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.087 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.087 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.087 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.087 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.088 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.088 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.088 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.088 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.088 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.088 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.088 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.088 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.088 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.089 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.089 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.089 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.089 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.089 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.089 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.089 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.089 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.090 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.090 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.090 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.090 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.090 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.090 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.090 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.090 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.090 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.091 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rook", 2024-06-06T08:47:00.091 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.091 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.091 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.091 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.091 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.091 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.091 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.092 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.092 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.092 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.092 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.092 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.092 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.092 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.092 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.093 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.093 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.093 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.093 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.093 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.093 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.093 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.093 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.094 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.094 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.094 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.094 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.094 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.094 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.094 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.094 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.095 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.095 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.095 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.095 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.095 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.095 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.095 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.095 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.096 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.096 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.096 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.096 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.096 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.096 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.096 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.096 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.097 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.097 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.097 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.097 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.097 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.097 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.097 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.097 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.098 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.098 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.098 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.098 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.098 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.098 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.098 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.098 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.099 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.099 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.099 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.099 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.099 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.099 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.099 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.099 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.099 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.100 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.100 INFO:teuthology.orchestra.run.smithi028.stdout: "storage_class": { 2024-06-06T08:47:00.100 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "storage_class", 2024-06-06T08:47:00.100 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.100 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.100 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.100 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "local", 2024-06-06T08:47:00.100 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.101 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.101 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.101 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-06T08:47:00.101 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.101 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.101 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.101 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.102 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.102 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.102 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.102 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "selftest", 2024-06-06T08:47:00.102 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.102 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.102 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.102 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.103 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.103 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.103 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.103 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.103 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.103 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.103 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.103 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.104 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.104 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.104 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.104 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.104 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.104 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.104 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.104 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.104 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.105 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.105 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.105 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.105 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.105 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.105 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.105 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.105 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.106 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.106 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.106 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.106 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.106 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.106 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.106 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.106 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.107 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.107 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.107 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.107 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.107 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.107 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.107 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.107 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.108 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.108 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.108 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.108 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.108 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.108 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.108 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.108 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.108 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.109 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.109 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.109 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.109 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.109 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.109 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.109 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.109 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.110 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.110 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.110 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.110 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.110 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.110 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.110 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.110 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.111 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.111 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.111 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.111 INFO:teuthology.orchestra.run.smithi028.stdout: "roption1": { 2024-06-06T08:47:00.111 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption1", 2024-06-06T08:47:00.111 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.111 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.111 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.112 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.112 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.112 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.112 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.112 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.112 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.112 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.113 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.113 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.113 INFO:teuthology.orchestra.run.smithi028.stdout: "roption2": { 2024-06-06T08:47:00.113 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption2", 2024-06-06T08:47:00.113 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.113 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.113 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.113 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "xyz", 2024-06-06T08:47:00.114 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.114 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.114 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.114 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.114 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.114 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.114 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.114 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.115 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption1": { 2024-06-06T08:47:00.115 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption1", 2024-06-06T08:47:00.115 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.115 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.115 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.115 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.115 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.115 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.115 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.116 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.116 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.116 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.116 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.116 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.116 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption2": { 2024-06-06T08:47:00.116 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption2", 2024-06-06T08:47:00.116 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.117 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.117 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.117 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.117 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.117 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.117 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.117 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.117 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.117 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.118 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.118 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.118 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption3": { 2024-06-06T08:47:00.118 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption3", 2024-06-06T08:47:00.118 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:47:00.118 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.118 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.119 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.119 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.119 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.119 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.119 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.119 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.119 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.119 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.120 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.120 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption4": { 2024-06-06T08:47:00.120 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption4", 2024-06-06T08:47:00.120 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.120 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.120 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.120 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.120 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.121 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.121 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.121 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.121 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.121 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.121 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.121 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.121 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption5": { 2024-06-06T08:47:00.121 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption5", 2024-06-06T08:47:00.122 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.122 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.122 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.122 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.122 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.122 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.122 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.122 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.123 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.123 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.123 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.123 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.123 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption6": { 2024-06-06T08:47:00.123 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption6", 2024-06-06T08:47:00.123 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.123 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.124 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.124 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.124 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.124 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.124 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.124 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.124 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.124 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.125 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.125 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.125 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption7": { 2024-06-06T08:47:00.125 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption7", 2024-06-06T08:47:00.125 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.125 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.125 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.125 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.126 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:47:00.126 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "42", 2024-06-06T08:47:00.126 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.126 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.126 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.126 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.126 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.126 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.127 INFO:teuthology.orchestra.run.smithi028.stdout: "testkey": { 2024-06-06T08:47:00.127 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testkey", 2024-06-06T08:47:00.127 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.127 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.127 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.127 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.127 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.128 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.128 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.128 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.128 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.128 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.128 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.128 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.128 INFO:teuthology.orchestra.run.smithi028.stdout: "testlkey": { 2024-06-06T08:47:00.128 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testlkey", 2024-06-06T08:47:00.129 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.129 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.129 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.129 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.129 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.129 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.129 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.129 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.130 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.130 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.130 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.130 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.130 INFO:teuthology.orchestra.run.smithi028.stdout: "testnewline": { 2024-06-06T08:47:00.130 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testnewline", 2024-06-06T08:47:00.130 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.130 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.131 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.131 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.131 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.131 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.131 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.131 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.131 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.131 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.131 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.132 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.132 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.132 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.132 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.132 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snap_schedule", 2024-06-06T08:47:00.132 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.132 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.132 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.133 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_m_granularity": { 2024-06-06T08:47:00.133 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_m_granularity", 2024-06-06T08:47:00.133 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.133 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.133 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.133 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.133 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.133 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.134 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.134 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow minute scheduled snapshots", 2024-06-06T08:47:00.134 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.134 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.134 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.134 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.134 INFO:teuthology.orchestra.run.smithi028.stdout: "dump_on_update": { 2024-06-06T08:47:00.134 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dump_on_update", 2024-06-06T08:47:00.135 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.135 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.135 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.135 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.135 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.135 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.135 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.135 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "dump database to debug log on update", 2024-06-06T08:47:00.136 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.136 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.136 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.136 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.136 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.136 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.136 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.136 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.137 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.137 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.137 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.137 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.137 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.137 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.137 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.137 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.137 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.138 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.138 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.138 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.138 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.138 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.138 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.138 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.138 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.139 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.139 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.139 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.139 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.139 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.139 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.139 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.139 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.140 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.140 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.140 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.140 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.140 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.140 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.140 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.140 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.141 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.141 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.141 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.141 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.141 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.141 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.141 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.141 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.142 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.142 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.142 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.142 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.142 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.142 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.142 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.142 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.143 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.143 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.143 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.143 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.143 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.143 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.143 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.143 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.144 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.144 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.144 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.144 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.144 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.144 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.144 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.144 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.145 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.145 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.145 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.145 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.145 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stats", 2024-06-06T08:47:00.145 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.145 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.145 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.146 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.146 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.146 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.146 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.146 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.146 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.146 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.146 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.147 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.147 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.147 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.147 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.147 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.147 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.147 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.147 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.148 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.148 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.148 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.148 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.148 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.148 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.148 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.148 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.148 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.149 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.149 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.149 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.149 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.149 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.149 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.149 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.149 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.150 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.150 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.150 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.150 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.150 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.150 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.150 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.150 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.151 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.151 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.151 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.151 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.151 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.151 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.151 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.151 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.152 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.152 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.152 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.152 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.152 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.152 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.152 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.152 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.153 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.153 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.153 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.153 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.153 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.153 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.153 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.153 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.154 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.154 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.154 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.154 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.154 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.154 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.154 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.154 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.155 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "status", 2024-06-06T08:47:00.155 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.155 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.155 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.155 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.155 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.155 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.156 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.156 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.156 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.156 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.156 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.156 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.156 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.156 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.156 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.157 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.157 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.157 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.157 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.157 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.157 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.157 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.157 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.158 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.158 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.158 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.158 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.158 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.158 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.158 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.159 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.159 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.159 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.159 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.159 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.159 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.159 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.159 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.160 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.160 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.160 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.160 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.160 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.160 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.160 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.160 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.161 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.161 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.161 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.161 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.161 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.161 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.161 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.161 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.162 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.162 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.162 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.162 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.162 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.162 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.162 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.162 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.163 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.163 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.163 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.163 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.163 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.163 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.163 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.163 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.164 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.164 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.164 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.164 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.164 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.164 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.164 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telegraf", 2024-06-06T08:47:00.165 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.165 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.165 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.165 INFO:teuthology.orchestra.run.smithi028.stdout: "address": { 2024-06-06T08:47:00.165 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "address", 2024-06-06T08:47:00.165 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.165 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.165 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.166 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-06T08:47:00.166 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.166 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.166 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.166 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.166 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.166 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.166 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.166 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.167 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:47:00.167 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:47:00.167 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.167 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.167 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.167 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15", 2024-06-06T08:47:00.167 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.169 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.169 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.169 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.169 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.169 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.170 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.170 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.170 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.170 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.170 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.170 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.170 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.170 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.171 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.171 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.171 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.171 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.171 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.171 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.171 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.171 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.171 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.172 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.172 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.172 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.172 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.172 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.172 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.172 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.172 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.173 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.173 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.173 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.173 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.173 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.173 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.173 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.173 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.174 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.174 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.174 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.174 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.174 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.174 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.174 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.174 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.175 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.175 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.175 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.175 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.175 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.175 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.175 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.175 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.175 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.176 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.176 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.176 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.176 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.176 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.176 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.176 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.176 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.177 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.177 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.177 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.177 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.177 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.177 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.177 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.177 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.178 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.178 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.178 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.178 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.178 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.178 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.178 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.178 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.179 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.179 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telemetry", 2024-06-06T08:47:00.179 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.179 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.179 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.179 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_basic": { 2024-06-06T08:47:00.179 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_basic", 2024-06-06T08:47:00.179 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.179 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.180 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.180 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.180 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.180 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.180 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.180 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-06T08:47:00.180 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.181 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.181 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.181 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.181 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_crash": { 2024-06-06T08:47:00.181 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_crash", 2024-06-06T08:47:00.181 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.181 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.181 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.181 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.182 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.182 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.182 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.182 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-06T08:47:00.182 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.182 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.182 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.182 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.183 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_device": { 2024-06-06T08:47:00.183 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_device", 2024-06-06T08:47:00.183 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.183 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.183 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.184 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.184 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.184 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.184 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.184 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-06T08:47:00.184 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.184 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.185 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.185 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.185 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_ident": { 2024-06-06T08:47:00.185 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_ident", 2024-06-06T08:47:00.185 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.185 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.185 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.186 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.186 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.186 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.186 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.186 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-06T08:47:00.186 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.186 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.186 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.187 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.187 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_perf": { 2024-06-06T08:47:00.187 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_perf", 2024-06-06T08:47:00.187 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.187 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.187 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.187 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.187 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.188 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.188 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.188 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-06T08:47:00.188 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.188 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.188 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.188 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.189 INFO:teuthology.orchestra.run.smithi028.stdout: "contact": { 2024-06-06T08:47:00.189 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "contact", 2024-06-06T08:47:00.189 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.189 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.189 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.189 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.189 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.189 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.189 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.190 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.190 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.190 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.190 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.190 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.190 INFO:teuthology.orchestra.run.smithi028.stdout: "description": { 2024-06-06T08:47:00.190 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "description", 2024-06-06T08:47:00.191 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.191 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.191 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.191 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.191 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.191 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.191 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.191 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.191 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.192 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.192 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.192 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.192 INFO:teuthology.orchestra.run.smithi028.stdout: "device_url": { 2024-06-06T08:47:00.192 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_url", 2024-06-06T08:47:00.192 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.192 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.193 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.193 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-06T08:47:00.193 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.193 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.193 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.193 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.193 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.193 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.194 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.194 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.194 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-06-06T08:47:00.194 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-06-06T08:47:00.194 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.194 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.194 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.194 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.195 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.195 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.195 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.195 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.195 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.195 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.195 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.195 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.196 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:47:00.196 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:47:00.196 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.196 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.196 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.196 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "24", 2024-06-06T08:47:00.196 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "8", 2024-06-06T08:47:00.197 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.197 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.197 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.197 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.197 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.197 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.197 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.197 INFO:teuthology.orchestra.run.smithi028.stdout: "last_opt_revision": { 2024-06-06T08:47:00.197 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "last_opt_revision", 2024-06-06T08:47:00.198 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.198 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.198 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.198 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1", 2024-06-06T08:47:00.198 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.198 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.198 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.199 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.199 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.199 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.199 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.199 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.199 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard": { 2024-06-06T08:47:00.199 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard", 2024-06-06T08:47:00.199 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.199 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.200 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.200 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.200 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.200 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.200 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.200 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.200 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.200 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.201 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.201 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.201 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard_description": { 2024-06-06T08:47:00.201 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard_description", 2024-06-06T08:47:00.201 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.201 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.201 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.201 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.202 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.202 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.202 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.202 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.202 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.202 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.202 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.202 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.203 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.203 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.203 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.203 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.203 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.203 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.203 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.203 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.203 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.204 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.204 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.204 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.204 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.204 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.204 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.204 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.204 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.205 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.205 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.205 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.205 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.205 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.205 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.205 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.205 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.206 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.206 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.206 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.206 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.206 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.206 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.206 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.206 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.207 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.207 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.207 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.207 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.207 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.207 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.207 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.207 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.207 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.208 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.208 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.208 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.208 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.208 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.208 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.208 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.208 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.208 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.209 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.209 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.209 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.209 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.209 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.209 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.209 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.209 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.210 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.210 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.210 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.210 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.210 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.210 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.210 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.210 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.211 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.211 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.211 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.211 INFO:teuthology.orchestra.run.smithi028.stdout: "organization": { 2024-06-06T08:47:00.211 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "organization", 2024-06-06T08:47:00.211 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.211 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.211 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.211 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.212 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.212 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.212 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.212 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.212 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.212 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.212 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.212 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.213 INFO:teuthology.orchestra.run.smithi028.stdout: "proxy": { 2024-06-06T08:47:00.213 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "proxy", 2024-06-06T08:47:00.213 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.213 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.213 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.213 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.213 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.213 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.213 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.214 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.214 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.214 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.214 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.214 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.214 INFO:teuthology.orchestra.run.smithi028.stdout: "url": { 2024-06-06T08:47:00.214 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url", 2024-06-06T08:47:00.214 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.215 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.215 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.215 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-06T08:47:00.215 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.215 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.215 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.215 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.216 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.216 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.216 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.216 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.216 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.216 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.216 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.216 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "test_orchestrator", 2024-06-06T08:47:00.217 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.217 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.217 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.217 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.217 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.217 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.217 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.218 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.218 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.218 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.218 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.218 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.218 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.218 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.218 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.219 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.219 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.219 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.219 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.219 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.219 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.220 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.220 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.220 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.220 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.220 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.220 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.220 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.220 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.220 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.221 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.221 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.221 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.221 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.222 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.222 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.222 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.222 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.222 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.222 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.223 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.223 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.223 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.223 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.223 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.223 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.223 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.223 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.224 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.224 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.224 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.224 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.224 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.224 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.225 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.225 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.225 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.225 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.225 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.225 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.225 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.225 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.226 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.226 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.226 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.226 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.226 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.226 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.227 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.227 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.227 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.227 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.227 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.227 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.227 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.227 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.228 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "volumes", 2024-06-06T08:47:00.228 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.228 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.228 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.228 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.228 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.228 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.229 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.229 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.229 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.229 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.229 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.229 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.229 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.230 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.230 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.230 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.230 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.230 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.230 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.230 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.230 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.231 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.231 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.231 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.231 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.231 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.231 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.231 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.232 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.232 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.232 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.232 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.232 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.232 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.232 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.232 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.233 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.233 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.233 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.233 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.233 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.233 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.233 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.234 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.234 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.234 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.234 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.234 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.234 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.235 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.235 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.235 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.235 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.235 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.235 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.235 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.236 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.236 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.236 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.236 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.236 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.236 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.236 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.237 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.237 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.237 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.237 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.237 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.237 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.238 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.238 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.238 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.238 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.238 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_clones": { 2024-06-06T08:47:00.238 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_clones", 2024-06-06T08:47:00.238 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.238 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.239 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.239 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4", 2024-06-06T08:47:00.239 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.239 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.239 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.239 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-06T08:47:00.239 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.239 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.240 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.240 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.240 INFO:teuthology.orchestra.run.smithi028.stdout: "periodic_async_work": { 2024-06-06T08:47:00.240 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "periodic_async_work", 2024-06-06T08:47:00.240 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.240 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.240 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.241 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.241 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.241 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.241 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.241 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Periodically check for async work", 2024-06-06T08:47:00.241 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.241 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.242 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.242 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.242 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_delay": { 2024-06-06T08:47:00.242 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_delay", 2024-06-06T08:47:00.242 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.242 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.243 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.243 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:47:00.243 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.243 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.243 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.243 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-06T08:47:00.243 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.243 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.244 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.244 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.244 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_no_wait": { 2024-06-06T08:47:00.244 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_no_wait", 2024-06-06T08:47:00.244 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.244 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.244 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.245 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.245 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.245 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.245 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.245 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-06T08:47:00.245 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.245 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.246 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.246 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.246 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.246 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.246 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.246 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix", 2024-06-06T08:47:00.246 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.247 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.247 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.247 INFO:teuthology.orchestra.run.smithi028.stdout: "discovery_interval": { 2024-06-06T08:47:00.247 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "discovery_interval", 2024-06-06T08:47:00.247 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:47:00.247 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.247 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.248 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "100", 2024-06-06T08:47:00.248 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.248 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.248 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.248 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.248 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.248 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.249 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.249 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.249 INFO:teuthology.orchestra.run.smithi028.stdout: "identifier": { 2024-06-06T08:47:00.249 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "identifier", 2024-06-06T08:47:00.249 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.249 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.249 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.250 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.250 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.250 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.250 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.250 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.250 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.250 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.251 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.251 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.251 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:47:00.251 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:47:00.251 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.251 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.252 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.252 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:47:00.252 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.252 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.252 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.252 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.252 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.252 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.252 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.253 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.253 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.253 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.253 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.253 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.253 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.254 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.254 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.254 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.254 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.254 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.254 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.254 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.254 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.255 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.255 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.255 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.255 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.255 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.255 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.256 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.256 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.256 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.256 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.256 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.256 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.256 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.257 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.257 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.257 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.257 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.257 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.257 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.258 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.258 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.258 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.258 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.258 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.258 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.258 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.258 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.259 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.259 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.259 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.259 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.259 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.259 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.259 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.260 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.260 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.260 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.260 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.260 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.260 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.260 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.260 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.260 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.261 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.261 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.261 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.261 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.261 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.261 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.261 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.261 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.262 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.262 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.262 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.262 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.262 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.262 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.262 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_host": { 2024-06-06T08:47:00.263 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_host", 2024-06-06T08:47:00.263 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.263 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.263 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.263 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.263 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.263 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.264 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.264 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.264 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.264 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.264 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.264 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.264 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_port": { 2024-06-06T08:47:00.265 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_port", 2024-06-06T08:47:00.265 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.265 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.265 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.265 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10051", 2024-06-06T08:47:00.265 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.265 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.265 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.266 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.266 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.266 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.266 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.266 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.266 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_sender": { 2024-06-06T08:47:00.267 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_sender", 2024-06-06T08:47:00.267 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.267 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.267 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.267 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-06T08:47:00.267 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.267 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.267 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.267 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.268 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.268 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.268 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.268 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.268 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.268 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.268 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-06-06T08:47:00.269 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.269 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.269 INFO:teuthology.orchestra.run.smithi028.stdout: "modules": [ 2024-06-06T08:47:00.269 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm", 2024-06-06T08:47:00.269 INFO:teuthology.orchestra.run.smithi028.stdout: "dashboard", 2024-06-06T08:47:00.269 INFO:teuthology.orchestra.run.smithi028.stdout: "iostat", 2024-06-06T08:47:00.269 INFO:teuthology.orchestra.run.smithi028.stdout: "nfs", 2024-06-06T08:47:00.269 INFO:teuthology.orchestra.run.smithi028.stdout: "restful" 2024-06-06T08:47:00.270 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.270 INFO:teuthology.orchestra.run.smithi028.stdout: "available_modules": [ 2024-06-06T08:47:00.270 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.270 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "alerts", 2024-06-06T08:47:00.270 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.270 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.270 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:47:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:47:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:47:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.272 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.272 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How frequently to reexamine health status", 2024-06-06T08:47:00.272 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.272 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.272 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.272 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.273 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.273 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.273 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.273 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.273 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.273 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.273 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.273 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.273 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.274 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.274 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.274 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.274 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.274 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.274 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.275 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.275 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.275 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.275 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.275 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.275 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.275 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.275 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.276 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.276 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.276 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.276 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.276 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.276 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.277 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.277 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.277 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.277 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.277 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.277 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.277 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.277 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.277 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.278 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.278 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.278 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.278 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.278 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.278 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.279 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.279 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.279 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.279 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.279 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.279 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.279 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.279 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.280 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.280 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.280 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.280 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.280 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.280 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.280 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.280 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.281 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.281 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.281 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.281 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.281 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.281 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.281 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.282 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.282 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.282 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.282 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_destination": { 2024-06-06T08:47:00.282 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_destination", 2024-06-06T08:47:00.282 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.282 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.282 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.283 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.283 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.283 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.283 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.283 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email address to send alerts to", 2024-06-06T08:47:00.283 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.283 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.284 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.284 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.284 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_from_name": { 2024-06-06T08:47:00.284 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_from_name", 2024-06-06T08:47:00.284 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.284 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.284 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.285 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "Ceph", 2024-06-06T08:47:00.285 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.285 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.285 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.285 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Email From: name", 2024-06-06T08:47:00.285 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.285 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.285 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.286 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.286 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_host": { 2024-06-06T08:47:00.286 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_host", 2024-06-06T08:47:00.286 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.286 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.286 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.286 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.287 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.287 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.287 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.287 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP server", 2024-06-06T08:47:00.287 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.287 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.287 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.288 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.288 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_password": { 2024-06-06T08:47:00.288 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_password", 2024-06-06T08:47:00.288 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.288 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.288 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.288 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.288 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.289 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.289 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.289 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Password to authenticate with", 2024-06-06T08:47:00.289 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.289 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.289 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.289 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.289 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_port": { 2024-06-06T08:47:00.290 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_port", 2024-06-06T08:47:00.290 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.290 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.290 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.290 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "465", 2024-06-06T08:47:00.290 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.290 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.291 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.291 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP port", 2024-06-06T08:47:00.291 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.291 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.291 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.291 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.291 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_sender": { 2024-06-06T08:47:00.291 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_sender", 2024-06-06T08:47:00.292 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.292 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.292 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.292 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.292 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.292 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.292 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.293 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SMTP envelope sender", 2024-06-06T08:47:00.293 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.293 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.293 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.293 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.293 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_ssl": { 2024-06-06T08:47:00.293 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_ssl", 2024-06-06T08:47:00.293 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.294 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.294 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.294 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.294 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.294 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.294 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.294 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-06T08:47:00.294 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.295 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.295 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.295 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.295 INFO:teuthology.orchestra.run.smithi028.stdout: "smtp_user": { 2024-06-06T08:47:00.295 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "smtp_user", 2024-06-06T08:47:00.295 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.295 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.295 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.295 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.296 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.296 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.296 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.296 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "User to authenticate as", 2024-06-06T08:47:00.296 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.296 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.296 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.296 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.297 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.297 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.297 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.297 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "balancer", 2024-06-06T08:47:00.297 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.297 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.297 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.297 INFO:teuthology.orchestra.run.smithi028.stdout: "active": { 2024-06-06T08:47:00.298 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "active", 2024-06-06T08:47:00.298 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.298 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.298 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.298 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.298 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.298 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.298 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.298 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically balance PGs across cluster", 2024-06-06T08:47:00.299 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.299 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.299 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.299 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.299 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_time": { 2024-06-06T08:47:00.299 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_time", 2024-06-06T08:47:00.299 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.299 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.300 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.300 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0000", 2024-06-06T08:47:00.300 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.300 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.300 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.300 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "beginning time of day to automatically balance", 2024-06-06T08:47:00.300 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T08:47:00.300 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.301 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.301 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.301 INFO:teuthology.orchestra.run.smithi028.stdout: "begin_weekday": { 2024-06-06T08:47:00.301 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "begin_weekday", 2024-06-06T08:47:00.301 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:47:00.301 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.301 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.301 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:47:00.302 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-06-06T08:47:00.302 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-06-06T08:47:00.302 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.302 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-06T08:47:00.302 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T08:47:00.302 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.302 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.302 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.303 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_max_iterations": { 2024-06-06T08:47:00.303 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_max_iterations", 2024-06-06T08:47:00.303 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:47:00.303 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.303 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.303 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "25", 2024-06-06T08:47:00.303 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:47:00.303 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "250", 2024-06-06T08:47:00.304 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.304 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-06T08:47:00.304 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.304 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.304 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.304 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.304 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_metrics": { 2024-06-06T08:47:00.304 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_metrics", 2024-06-06T08:47:00.305 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.305 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.305 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.305 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "pgs,objects,bytes", 2024-06-06T08:47:00.305 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.305 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.305 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.305 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-06T08:47:00.306 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-06T08:47:00.306 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.306 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.306 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.306 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_compat_step": { 2024-06-06T08:47:00.306 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crush_compat_step", 2024-06-06T08:47:00.306 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:47:00.306 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.307 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.307 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.5", 2024-06-06T08:47:00.307 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0.001", 2024-06-06T08:47:00.307 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "0.999", 2024-06-06T08:47:00.307 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.307 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "aggressiveness of optimization", 2024-06-06T08:47:00.307 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-06T08:47:00.307 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.307 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.308 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.308 INFO:teuthology.orchestra.run.smithi028.stdout: "end_time": { 2024-06-06T08:47:00.308 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_time", 2024-06-06T08:47:00.308 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.308 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.308 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.308 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2359", 2024-06-06T08:47:00.308 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.309 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.309 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.309 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ending time of day to automatically balance", 2024-06-06T08:47:00.309 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T08:47:00.309 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.309 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.309 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.309 INFO:teuthology.orchestra.run.smithi028.stdout: "end_weekday": { 2024-06-06T08:47:00.309 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "end_weekday", 2024-06-06T08:47:00.310 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:47:00.310 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.310 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.310 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:47:00.310 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "0", 2024-06-06T08:47:00.310 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "6", 2024-06-06T08:47:00.310 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.311 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-06T08:47:00.311 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T08:47:00.311 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.311 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.311 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.311 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.311 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.311 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.312 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.312 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.312 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.312 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.312 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.312 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.312 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.313 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.313 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.313 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.313 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.313 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.313 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.313 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.313 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.314 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.314 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.314 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.314 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.314 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.314 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.314 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.314 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.315 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.315 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.315 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.315 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.315 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.315 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.315 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.315 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.316 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.316 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.316 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.316 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.316 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.316 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.316 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.316 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.317 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.317 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.317 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.317 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.317 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.317 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.317 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.317 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.317 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.318 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.318 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.318 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.318 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.318 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.318 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.318 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.318 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.319 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.319 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.319 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.319 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.319 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.319 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.319 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.319 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.319 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.320 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.320 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.320 INFO:teuthology.orchestra.run.smithi028.stdout: "min_score": { 2024-06-06T08:47:00.320 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_score", 2024-06-06T08:47:00.320 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:47:00.320 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.320 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.320 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:47:00.321 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.321 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.321 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.321 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-06T08:47:00.321 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.321 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.321 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.321 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.321 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-06-06T08:47:00.322 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-06-06T08:47:00.322 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.322 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.322 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.322 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "upmap", 2024-06-06T08:47:00.322 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.322 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.322 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.323 INFO:teuthology.orchestra.run.smithi028.stdout: "crush-compat", 2024-06-06T08:47:00.323 INFO:teuthology.orchestra.run.smithi028.stdout: "none", 2024-06-06T08:47:00.323 INFO:teuthology.orchestra.run.smithi028.stdout: "read", 2024-06-06T08:47:00.323 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap", 2024-06-06T08:47:00.323 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap-read" 2024-06-06T08:47:00.323 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.323 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Balancer mode", 2024-06-06T08:47:00.323 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.324 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.324 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.324 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.324 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_ids": { 2024-06-06T08:47:00.324 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_ids", 2024-06-06T08:47:00.324 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.324 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.324 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.325 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.325 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.325 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.325 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.325 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-06T08:47:00.325 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.325 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.326 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.326 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.326 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:47:00.326 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:47:00.326 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.326 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.326 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.326 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:47:00.327 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.327 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.327 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.327 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-06T08:47:00.327 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.327 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.327 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.327 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.327 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_deviation": { 2024-06-06T08:47:00.328 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_deviation", 2024-06-06T08:47:00.328 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.328 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.328 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.328 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:47:00.328 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:47:00.328 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.328 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.329 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-06T08:47:00.329 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-06T08:47:00.329 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.329 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.329 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.329 INFO:teuthology.orchestra.run.smithi028.stdout: "upmap_max_optimizations": { 2024-06-06T08:47:00.329 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "upmap_max_optimizations", 2024-06-06T08:47:00.329 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:47:00.330 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.330 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.330 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:47:00.330 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.330 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.330 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.330 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-06T08:47:00.330 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.331 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.331 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.331 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.331 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.331 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.331 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.331 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm", 2024-06-06T08:47:00.331 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.332 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.332 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.332 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_down_multiplier": { 2024-06-06T08:47:00.332 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_down_multiplier", 2024-06-06T08:47:00.332 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:47:00.332 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.332 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.332 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-06-06T08:47:00.333 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.333 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.333 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.333 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-06T08:47:00.333 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.333 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.333 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.333 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.334 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_refresh_rate": { 2024-06-06T08:47:00.334 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_refresh_rate", 2024-06-06T08:47:00.334 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.334 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.334 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.334 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "20", 2024-06-06T08:47:00.334 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.334 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.335 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.335 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-06T08:47:00.335 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.335 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.335 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.335 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.335 INFO:teuthology.orchestra.run.smithi028.stdout: "agent_starting_port": { 2024-06-06T08:47:00.335 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "agent_starting_port", 2024-06-06T08:47:00.336 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.336 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.336 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.336 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4721", 2024-06-06T08:47:00.336 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.336 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.336 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.336 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-06T08:47:00.337 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.337 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.337 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.337 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.337 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_ptrace": { 2024-06-06T08:47:00.337 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_ptrace", 2024-06-06T08:47:00.337 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.337 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.338 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.338 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.338 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.338 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.338 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.338 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-06T08:47:00.338 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-06T08:47:00.338 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.339 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.339 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.339 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_interval": { 2024-06-06T08:47:00.339 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_interval", 2024-06-06T08:47:00.339 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.339 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.339 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.339 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:47:00.340 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.340 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.340 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.340 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-06T08:47:00.340 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.340 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.340 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.340 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.341 INFO:teuthology.orchestra.run.smithi028.stdout: "autotune_memory_target_ratio": { 2024-06-06T08:47:00.341 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "autotune_memory_target_ratio", 2024-06-06T08:47:00.341 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:47:00.341 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.341 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.341 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0.7", 2024-06-06T08:47:00.341 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.341 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.342 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.342 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-06T08:47:00.342 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.342 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.342 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.342 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.342 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm_log_destination": { 2024-06-06T08:47:00.343 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cephadm_log_destination", 2024-06-06T08:47:00.343 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.343 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.343 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.343 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.343 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.343 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.343 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.344 INFO:teuthology.orchestra.run.smithi028.stdout: "file", 2024-06-06T08:47:00.344 INFO:teuthology.orchestra.run.smithi028.stdout: "file,syslog", 2024-06-06T08:47:00.344 INFO:teuthology.orchestra.run.smithi028.stdout: "syslog" 2024-06-06T08:47:00.344 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.344 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-06T08:47:00.344 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.344 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.344 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.345 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.345 INFO:teuthology.orchestra.run.smithi028.stdout: "cgroups_split": { 2024-06-06T08:47:00.345 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cgroups_split", 2024-06-06T08:47:00.345 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.345 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.345 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.345 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.345 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.346 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.346 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.346 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-06T08:47:00.346 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.346 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.346 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.346 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.347 INFO:teuthology.orchestra.run.smithi028.stdout: "config_checks_enabled": { 2024-06-06T08:47:00.347 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_checks_enabled", 2024-06-06T08:47:00.347 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.347 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.347 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.347 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.347 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.347 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.347 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.348 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-06T08:47:00.348 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.348 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.348 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.348 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.348 INFO:teuthology.orchestra.run.smithi028.stdout: "config_dashboard": { 2024-06-06T08:47:00.348 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_dashboard", 2024-06-06T08:47:00.348 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.349 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.349 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.349 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.349 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.349 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.349 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.349 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-06T08:47:00.349 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.349 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.350 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.350 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.350 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_alertmanager": { 2024-06-06T08:47:00.350 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_alertmanager", 2024-06-06T08:47:00.350 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.350 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.350 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.350 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-06T08:47:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:47:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.351 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_base": { 2024-06-06T08:47:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_base", 2024-06-06T08:47:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-06T08:47:00.352 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Container image name, without the tag", 2024-06-06T08:47:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.353 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_elasticsearch": { 2024-06-06T08:47:00.354 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_elasticsearch", 2024-06-06T08:47:00.354 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.354 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.354 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.354 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-06T08:47:00.354 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.354 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.355 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.355 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "elasticsearch container image", 2024-06-06T08:47:00.355 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.355 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.355 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.355 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.355 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_grafana": { 2024-06-06T08:47:00.355 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_grafana", 2024-06-06T08:47:00.355 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.356 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.356 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.356 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-06T08:47:00.356 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.356 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.356 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.356 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:47:00.356 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.357 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.357 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.357 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.357 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_haproxy": { 2024-06-06T08:47:00.357 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_haproxy", 2024-06-06T08:47:00.357 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.357 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.357 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.358 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-06T08:47:00.358 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.358 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.358 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.358 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "HAproxy container image", 2024-06-06T08:47:00.358 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.358 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.358 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.359 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.359 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_agent": { 2024-06-06T08:47:00.359 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_agent", 2024-06-06T08:47:00.359 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.359 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.359 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.359 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-06T08:47:00.360 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.360 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.360 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.360 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger agent container image", 2024-06-06T08:47:00.360 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.360 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.360 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.360 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.361 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_collector": { 2024-06-06T08:47:00.361 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_collector", 2024-06-06T08:47:00.361 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.361 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.361 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.361 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-06T08:47:00.361 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.361 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.362 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.362 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger collector container image", 2024-06-06T08:47:00.362 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.362 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.362 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.362 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.362 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_jaeger_query": { 2024-06-06T08:47:00.362 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_jaeger_query", 2024-06-06T08:47:00.363 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.363 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.363 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.363 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-06T08:47:00.363 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.363 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.363 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.363 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Jaeger query container image", 2024-06-06T08:47:00.364 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.364 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.364 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.364 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.364 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_keepalived": { 2024-06-06T08:47:00.364 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_keepalived", 2024-06-06T08:47:00.364 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.364 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.365 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.365 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-06T08:47:00.365 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.365 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.365 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.365 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Keepalived container image", 2024-06-06T08:47:00.365 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.365 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.366 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.366 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.366 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_loki": { 2024-06-06T08:47:00.366 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_loki", 2024-06-06T08:47:00.366 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.366 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.366 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.366 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-06T08:47:00.367 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.367 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.367 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.367 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Loki container image", 2024-06-06T08:47:00.367 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.367 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.367 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.367 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.368 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_node_exporter": { 2024-06-06T08:47:00.368 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_node_exporter", 2024-06-06T08:47:00.368 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.368 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.368 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.368 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-06T08:47:00.368 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.368 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.369 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.369 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:47:00.369 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.369 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.369 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.369 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.369 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_nvmeof": { 2024-06-06T08:47:00.369 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_nvmeof", 2024-06-06T08:47:00.369 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.370 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.370 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.370 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-06T08:47:00.370 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.370 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.370 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.370 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Nvme-of container image", 2024-06-06T08:47:00.370 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.371 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.371 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.371 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.371 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_prometheus": { 2024-06-06T08:47:00.371 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_prometheus", 2024-06-06T08:47:00.371 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.371 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.371 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.373 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-06T08:47:00.373 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.373 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.373 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.374 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Prometheus container image", 2024-06-06T08:47:00.374 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.374 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.374 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.374 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.374 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_promtail": { 2024-06-06T08:47:00.375 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_promtail", 2024-06-06T08:47:00.375 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.375 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.375 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.375 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-06T08:47:00.375 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.375 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.375 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.376 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Promtail container image", 2024-06-06T08:47:00.376 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.376 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.376 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.376 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.376 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_samba": { 2024-06-06T08:47:00.376 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_samba", 2024-06-06T08:47:00.376 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.376 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.377 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.377 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-06T08:47:00.377 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.377 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.377 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.377 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Samba/SMB container image", 2024-06-06T08:47:00.377 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.377 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.377 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.377 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.378 INFO:teuthology.orchestra.run.smithi028.stdout: "container_image_snmp_gateway": { 2024-06-06T08:47:00.378 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_image_snmp_gateway", 2024-06-06T08:47:00.378 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.378 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.378 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.378 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-06T08:47:00.378 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.378 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.378 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.379 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "SNMP Gateway container image", 2024-06-06T08:47:00.379 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.379 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.379 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.379 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.379 INFO:teuthology.orchestra.run.smithi028.stdout: "container_init": { 2024-06-06T08:47:00.379 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "container_init", 2024-06-06T08:47:00.379 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.380 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.380 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.380 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.380 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.380 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.380 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.380 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Run podman/docker with `--init`", 2024-06-06T08:47:00.380 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.380 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.381 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.381 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.381 INFO:teuthology.orchestra.run.smithi028.stdout: "daemon_cache_timeout": { 2024-06-06T08:47:00.381 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "daemon_cache_timeout", 2024-06-06T08:47:00.381 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.381 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.381 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.381 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:47:00.381 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.382 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.382 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.382 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-06T08:47:00.382 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.382 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.382 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.382 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.382 INFO:teuthology.orchestra.run.smithi028.stdout: "default_cephadm_command_timeout": { 2024-06-06T08:47:00.383 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_cephadm_command_timeout", 2024-06-06T08:47:00.383 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.383 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.383 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.383 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "900", 2024-06-06T08:47:00.383 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.383 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.383 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.384 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-06T08:47:00.384 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.384 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.384 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.384 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.384 INFO:teuthology.orchestra.run.smithi028.stdout: "default_registry": { 2024-06-06T08:47:00.384 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "default_registry", 2024-06-06T08:47:00.384 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.384 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.385 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.385 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "docker.io", 2024-06-06T08:47:00.385 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.385 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.385 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.385 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-06T08:47:00.385 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.385 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.386 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.386 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.386 INFO:teuthology.orchestra.run.smithi028.stdout: "device_cache_timeout": { 2024-06-06T08:47:00.386 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_cache_timeout", 2024-06-06T08:47:00.386 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.386 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.386 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.386 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1800", 2024-06-06T08:47:00.387 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.387 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.387 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.387 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache device inventory", 2024-06-06T08:47:00.387 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.387 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.387 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.387 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.387 INFO:teuthology.orchestra.run.smithi028.stdout: "device_enhanced_scan": { 2024-06-06T08:47:00.387 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_enhanced_scan", 2024-06-06T08:47:00.388 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.388 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.388 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.388 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.388 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.388 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.388 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.388 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-06T08:47:00.389 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.389 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.389 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.389 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.389 INFO:teuthology.orchestra.run.smithi028.stdout: "facts_cache_timeout": { 2024-06-06T08:47:00.389 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "facts_cache_timeout", 2024-06-06T08:47:00.389 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.389 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.389 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.389 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:47:00.390 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.390 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.390 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.390 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "seconds to cache host facts data", 2024-06-06T08:47:00.390 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.390 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.390 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.390 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.391 INFO:teuthology.orchestra.run.smithi028.stdout: "grafana_dashboards_path": { 2024-06-06T08:47:00.391 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "grafana_dashboards_path", 2024-06-06T08:47:00.391 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.391 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.391 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.391 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-06T08:47:00.391 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.391 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.392 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.392 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-06T08:47:00.392 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.392 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.392 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.392 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.392 INFO:teuthology.orchestra.run.smithi028.stdout: "host_check_interval": { 2024-06-06T08:47:00.392 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "host_check_interval", 2024-06-06T08:47:00.392 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.393 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.393 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.393 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:47:00.393 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.393 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.393 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.393 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to perform a host check", 2024-06-06T08:47:00.393 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.393 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.394 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.394 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.394 INFO:teuthology.orchestra.run.smithi028.stdout: "hw_monitoring": { 2024-06-06T08:47:00.394 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hw_monitoring", 2024-06-06T08:47:00.394 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.394 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.394 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.394 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.395 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.395 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.395 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.395 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-06T08:47:00.395 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.395 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.395 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.395 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.396 INFO:teuthology.orchestra.run.smithi028.stdout: "inventory_list_all": { 2024-06-06T08:47:00.396 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "inventory_list_all", 2024-06-06T08:47:00.396 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.396 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.396 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.396 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.396 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.396 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.396 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.396 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-06T08:47:00.397 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.397 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.397 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.397 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.397 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.397 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.397 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.397 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.398 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.398 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.398 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.398 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.398 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.398 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.398 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.398 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.399 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.399 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.399 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.399 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.399 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.399 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.399 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.399 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.399 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.400 INFO:teuthology.orchestra.run.smithi028.stdout: "log_refresh_metadata": { 2024-06-06T08:47:00.400 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_refresh_metadata", 2024-06-06T08:47:00.400 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.400 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.400 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.400 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.400 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.400 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.401 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.401 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-06T08:47:00.401 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.401 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.401 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.401 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.401 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.401 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.402 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.402 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.402 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.402 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.402 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.402 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.402 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.402 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-06T08:47:00.403 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.403 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.403 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.403 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.403 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.403 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.403 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.403 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.404 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.404 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.404 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.404 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.404 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.404 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.404 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.404 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.405 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.405 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.405 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.405 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.405 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.405 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.405 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.405 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.406 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.406 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.406 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.406 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.406 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.406 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.406 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.407 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.407 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.407 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.407 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.407 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.407 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.407 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.407 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.408 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-06T08:47:00.408 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-06T08:47:00.408 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.408 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.408 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.408 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.408 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.409 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.409 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.409 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-06T08:47:00.409 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.409 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.409 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.409 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.409 INFO:teuthology.orchestra.run.smithi028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-06T08:47:00.410 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-06T08:47:00.410 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.410 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.410 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.410 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "*", 2024-06-06T08:47:00.410 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.410 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.410 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.411 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-06T08:47:00.411 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.411 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.411 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.411 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.411 INFO:teuthology.orchestra.run.smithi028.stdout: "max_count_per_host": { 2024-06-06T08:47:00.411 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_count_per_host", 2024-06-06T08:47:00.412 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.412 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.412 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.412 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:47:00.412 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.412 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.412 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.412 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of daemons per service per host", 2024-06-06T08:47:00.413 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.413 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.413 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.413 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.413 INFO:teuthology.orchestra.run.smithi028.stdout: "max_osd_draining_count": { 2024-06-06T08:47:00.413 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_osd_draining_count", 2024-06-06T08:47:00.413 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.414 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.414 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.414 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:47:00.414 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.414 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.414 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.414 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-06T08:47:00.415 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.415 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.415 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.415 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.415 INFO:teuthology.orchestra.run.smithi028.stdout: "migration_current": { 2024-06-06T08:47:00.415 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "migration_current", 2024-06-06T08:47:00.415 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.415 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.416 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.416 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.416 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.416 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.416 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.416 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "internal - do not modify", 2024-06-06T08:47:00.416 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.416 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.417 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.417 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.417 INFO:teuthology.orchestra.run.smithi028.stdout: "mode": { 2024-06-06T08:47:00.417 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mode", 2024-06-06T08:47:00.417 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.417 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.417 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.417 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "root", 2024-06-06T08:47:00.418 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.418 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.418 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.418 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm-package", 2024-06-06T08:47:00.418 INFO:teuthology.orchestra.run.smithi028.stdout: "root" 2024-06-06T08:47:00.418 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.418 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "mode for remote execution of cephadm", 2024-06-06T08:47:00.419 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.419 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.419 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.419 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.419 INFO:teuthology.orchestra.run.smithi028.stdout: "oob_default_addr": { 2024-06-06T08:47:00.419 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "oob_default_addr", 2024-06-06T08:47:00.419 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.419 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.420 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.420 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "169.254.1.1", 2024-06-06T08:47:00.420 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.420 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.420 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.420 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-06T08:47:00.420 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.420 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.421 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.421 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.421 INFO:teuthology.orchestra.run.smithi028.stdout: "prometheus_alerts_path": { 2024-06-06T08:47:00.421 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus_alerts_path", 2024-06-06T08:47:00.421 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.421 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.421 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.421 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-06T08:47:00.422 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.422 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.422 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.422 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-06T08:47:00.422 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.422 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.422 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.422 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.423 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_insecure": { 2024-06-06T08:47:00.423 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_insecure", 2024-06-06T08:47:00.423 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.423 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.423 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.423 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.423 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.423 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.423 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.424 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-06T08:47:00.424 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.424 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.424 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.424 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.424 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_password": { 2024-06-06T08:47:00.424 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_password", 2024-06-06T08:47:00.424 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.425 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.425 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.425 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.425 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.425 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.425 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.425 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-06T08:47:00.425 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.426 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.426 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.426 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.426 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_url": { 2024-06-06T08:47:00.426 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_url", 2024-06-06T08:47:00.426 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.426 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.426 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.427 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.427 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.427 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.427 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.427 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-06T08:47:00.427 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.427 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.427 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.428 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.428 INFO:teuthology.orchestra.run.smithi028.stdout: "registry_username": { 2024-06-06T08:47:00.428 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "registry_username", 2024-06-06T08:47:00.428 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.428 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.428 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.428 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.428 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.428 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.429 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.429 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-06T08:47:00.429 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.429 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.429 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.429 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.429 INFO:teuthology.orchestra.run.smithi028.stdout: "secure_monitoring_stack": { 2024-06-06T08:47:00.429 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "secure_monitoring_stack", 2024-06-06T08:47:00.429 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.430 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.430 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.430 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.430 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.430 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.430 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.430 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-06T08:47:00.430 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.431 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.431 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.431 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.431 INFO:teuthology.orchestra.run.smithi028.stdout: "service_discovery_port": { 2024-06-06T08:47:00.431 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "service_discovery_port", 2024-06-06T08:47:00.431 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.431 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.431 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.431 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8765", 2024-06-06T08:47:00.432 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.432 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.432 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.432 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "cephadm service discovery port", 2024-06-06T08:47:00.432 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.432 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.432 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.432 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.433 INFO:teuthology.orchestra.run.smithi028.stdout: "ssh_config_file": { 2024-06-06T08:47:00.433 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssh_config_file", 2024-06-06T08:47:00.433 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.433 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.433 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.433 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.433 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.433 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.434 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.434 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-06T08:47:00.434 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.434 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.434 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.434 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.434 INFO:teuthology.orchestra.run.smithi028.stdout: "use_agent": { 2024-06-06T08:47:00.434 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_agent", 2024-06-06T08:47:00.435 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.435 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.435 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.435 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.435 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.435 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.435 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.435 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-06T08:47:00.436 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.436 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.436 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.436 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.436 INFO:teuthology.orchestra.run.smithi028.stdout: "use_repo_digest": { 2024-06-06T08:47:00.436 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "use_repo_digest", 2024-06-06T08:47:00.436 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.437 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.437 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.437 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.437 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.437 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.437 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.437 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-06T08:47:00.437 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.438 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.438 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.438 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.438 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_failed_host_check": { 2024-06-06T08:47:00.438 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_failed_host_check", 2024-06-06T08:47:00.438 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.438 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.438 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.438 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.439 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.439 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.439 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.439 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if the host check fails", 2024-06-06T08:47:00.439 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.439 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.439 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.439 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.440 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_daemons": { 2024-06-06T08:47:00.440 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_daemons", 2024-06-06T08:47:00.440 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.440 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.440 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.440 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.440 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.440 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.441 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.441 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-06T08:47:00.441 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.441 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.441 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.441 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.441 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_on_stray_hosts": { 2024-06-06T08:47:00.441 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_on_stray_hosts", 2024-06-06T08:47:00.442 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.442 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.442 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.442 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.442 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.442 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.443 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.443 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-06T08:47:00.443 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.443 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.443 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.443 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.443 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.443 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.444 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.444 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crash", 2024-06-06T08:47:00.444 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.444 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.444 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.444 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.444 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.445 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.445 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.445 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.445 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.445 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.445 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.445 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.445 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.446 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.446 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.446 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.446 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.446 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.446 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.447 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.447 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.447 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.447 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.447 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.447 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.447 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.448 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.448 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.448 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.448 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.448 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.448 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.448 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.449 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.449 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.449 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.449 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.449 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.449 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.450 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.450 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.450 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.450 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.450 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.450 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.450 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.451 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.451 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.451 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.451 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.451 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.451 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.451 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.451 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.452 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.452 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.452 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.452 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.452 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.452 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.452 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.453 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.453 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.453 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.453 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.453 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.453 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.453 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.454 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.454 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.454 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.454 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.454 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.454 INFO:teuthology.orchestra.run.smithi028.stdout: "retain_interval": { 2024-06-06T08:47:00.455 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retain_interval", 2024-06-06T08:47:00.455 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.455 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.455 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.455 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "31536000", 2024-06-06T08:47:00.455 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.455 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.455 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.456 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-06T08:47:00.456 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.456 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.456 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.456 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.456 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_recent_interval": { 2024-06-06T08:47:00.457 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_recent_interval", 2024-06-06T08:47:00.457 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.457 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.457 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.457 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1209600", 2024-06-06T08:47:00.457 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.457 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.457 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.458 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-06T08:47:00.458 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.458 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.458 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.458 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.458 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.458 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.458 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.459 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dashboard", 2024-06-06T08:47:00.459 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.459 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.459 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.459 INFO:teuthology.orchestra.run.smithi028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-06T08:47:00.459 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-06T08:47:00.459 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.459 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.460 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.460 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:47:00.460 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.460 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.460 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.460 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.460 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.461 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.461 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.461 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.461 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_HOST": { 2024-06-06T08:47:00.461 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-06T08:47:00.461 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.461 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.461 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.461 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.462 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.462 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.462 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.462 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.462 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.462 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.462 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.463 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.463 INFO:teuthology.orchestra.run.smithi028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-06T08:47:00.463 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-06T08:47:00.463 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.463 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.463 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.463 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.463 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.464 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.464 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.464 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.464 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.464 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.464 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.464 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.464 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_ENABLED": { 2024-06-06T08:47:00.465 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_ENABLED", 2024-06-06T08:47:00.465 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.465 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.465 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.465 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.465 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.465 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.465 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.466 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.466 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.466 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.466 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.466 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.466 INFO:teuthology.orchestra.run.smithi028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-06T08:47:00.466 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-06T08:47:00.467 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.467 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.467 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.467 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.467 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.467 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.467 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.467 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.468 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.468 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.468 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.468 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.468 INFO:teuthology.orchestra.run.smithi028.stdout: "ENABLE_BROWSABLE_API": { 2024-06-06T08:47:00.468 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-06T08:47:00.468 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.468 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.468 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.469 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.469 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.469 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.469 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.469 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.469 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.469 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.469 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.470 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.470 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-06T08:47:00.470 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-06T08:47:00.470 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.470 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.470 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.470 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.470 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.471 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.471 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.471 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.471 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.471 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.471 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.471 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.471 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-06T08:47:00.471 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-06T08:47:00.472 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.472 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.472 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.472 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.472 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.472 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.472 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.472 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.473 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.473 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.473 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.473 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.473 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-06T08:47:00.473 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-06T08:47:00.473 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.473 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.474 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.474 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.474 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.474 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.474 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.474 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.474 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.474 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.475 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.475 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.475 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-06T08:47:00.475 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-06T08:47:00.475 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.475 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.475 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.475 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.476 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.476 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.476 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.476 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.476 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.476 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.476 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.476 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.476 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-06T08:47:00.477 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-06T08:47:00.477 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.477 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.477 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.477 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.477 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.477 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.477 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.478 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.478 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.478 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.478 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.478 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.478 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-06T08:47:00.478 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-06T08:47:00.478 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.479 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.479 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.479 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.479 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.479 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.479 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.479 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.479 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.480 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.480 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.480 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.480 INFO:teuthology.orchestra.run.smithi028.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-06T08:47:00.480 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-06T08:47:00.480 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.480 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.481 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.481 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.481 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.481 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.481 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.481 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.481 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.481 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.482 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.482 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.482 INFO:teuthology.orchestra.run.smithi028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-06T08:47:00.482 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-06T08:47:00.482 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.482 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.482 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.483 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.483 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.483 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.483 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.483 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.483 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.483 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.483 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.483 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.484 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_PASSWORD": { 2024-06-06T08:47:00.484 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-06T08:47:00.484 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.484 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.484 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.484 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-06-06T08:47:00.484 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.485 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.485 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.485 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.485 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.485 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.485 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.485 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.485 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-06T08:47:00.486 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-06T08:47:00.486 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.486 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.486 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.486 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.486 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.487 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.487 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.487 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.487 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.487 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.487 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.487 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.487 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_URL": { 2024-06-06T08:47:00.487 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_URL", 2024-06-06T08:47:00.488 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.488 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.488 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.488 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.488 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.488 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.488 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.489 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.489 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.489 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.489 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.489 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.489 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_API_USERNAME": { 2024-06-06T08:47:00.489 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-06T08:47:00.489 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.489 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.490 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.490 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-06-06T08:47:00.490 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.490 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.490 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.490 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.490 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.490 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.491 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.491 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.491 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-06T08:47:00.491 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-06T08:47:00.491 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.491 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.491 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.491 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.492 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.492 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.492 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.492 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.492 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.492 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.492 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.493 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.493 INFO:teuthology.orchestra.run.smithi028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-06T08:47:00.493 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-06T08:47:00.493 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.493 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.493 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.493 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.493 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.494 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.494 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.494 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.494 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.494 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.494 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.494 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.495 INFO:teuthology.orchestra.run.smithi028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-06T08:47:00.495 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-06T08:47:00.495 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.495 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.495 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.495 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.495 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.496 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.496 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.496 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.496 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.496 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.496 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.496 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.497 INFO:teuthology.orchestra.run.smithi028.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-06T08:47:00.497 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-06T08:47:00.497 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.497 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.497 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.497 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.497 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.497 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.498 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.498 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.498 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.498 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.498 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.498 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.498 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_HOST": { 2024-06-06T08:47:00.499 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-06T08:47:00.499 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.499 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.499 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.499 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.499 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.499 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.500 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.500 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.500 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.500 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.500 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.500 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.500 INFO:teuthology.orchestra.run.smithi028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-06T08:47:00.501 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-06T08:47:00.501 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.501 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.501 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.501 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.501 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.501 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.501 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.502 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.502 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.502 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.502 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.502 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.502 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-06T08:47:00.502 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-06T08:47:00.502 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.503 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.503 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.503 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.503 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.503 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.503 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.503 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.503 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.504 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.504 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.504 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.504 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-06T08:47:00.504 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-06T08:47:00.504 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.504 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.505 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.505 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.505 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.505 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.505 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.505 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.505 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.505 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.506 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.506 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.506 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-06T08:47:00.506 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-06T08:47:00.506 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.506 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.506 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.506 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.507 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.507 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.507 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.507 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.507 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.507 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.507 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.507 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.508 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-06T08:47:00.508 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-06T08:47:00.508 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.508 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.508 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.508 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.508 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.509 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.509 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.509 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.509 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.509 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.509 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.509 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.509 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-06T08:47:00.509 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-06T08:47:00.510 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.510 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.510 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.510 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.510 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.510 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.510 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.510 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.511 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.511 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.511 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.511 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.511 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-06T08:47:00.511 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-06T08:47:00.511 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.511 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.511 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.512 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.512 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.512 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.512 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.512 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.512 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.512 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.512 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.513 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.513 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-06T08:47:00.513 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-06T08:47:00.513 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.513 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.513 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.513 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.513 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.514 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.514 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.514 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.514 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.514 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.514 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.514 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.515 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_ENABLED": { 2024-06-06T08:47:00.515 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-06T08:47:00.515 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.515 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.515 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.515 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.515 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.515 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.516 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.516 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.516 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.516 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.516 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.516 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.516 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-06T08:47:00.516 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-06T08:47:00.517 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.517 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.517 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.517 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-06T08:47:00.517 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.517 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.517 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.517 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.517 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.518 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.518 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.518 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.518 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-06T08:47:00.518 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-06T08:47:00.518 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.518 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.518 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.519 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:47:00.519 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.519 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.519 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.519 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.519 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.519 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.519 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.519 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.520 INFO:teuthology.orchestra.run.smithi028.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-06T08:47:00.520 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-06T08:47:00.520 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.520 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.520 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.520 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8", 2024-06-06T08:47:00.520 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.520 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.521 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.521 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.521 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.521 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.521 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.521 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.521 INFO:teuthology.orchestra.run.smithi028.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-06T08:47:00.521 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-06T08:47:00.522 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.522 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.522 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.522 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "45", 2024-06-06T08:47:00.522 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.522 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.522 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.522 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.523 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.523 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.523 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.523 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.523 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ACCESS_KEY": { 2024-06-06T08:47:00.523 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-06T08:47:00.523 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.523 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.523 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.524 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.524 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.524 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.524 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.524 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.524 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.524 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.524 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-06T08:47:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-06T08:47:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "admin", 2024-06-06T08:47:00.525 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.526 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.526 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.526 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.526 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.526 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.526 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.526 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.526 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SECRET_KEY": { 2024-06-06T08:47:00.526 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-06T08:47:00.527 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.527 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.527 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.527 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.527 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.527 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.527 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.527 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.527 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.528 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.528 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.528 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.528 INFO:teuthology.orchestra.run.smithi028.stdout: "RGW_API_SSL_VERIFY": { 2024-06-06T08:47:00.528 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-06T08:47:00.528 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.528 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.529 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.529 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.529 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.529 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.529 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.529 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.529 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.529 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.529 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.530 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.530 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-06T08:47:00.530 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-06T08:47:00.530 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.530 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.530 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.530 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:47:00.530 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.530 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.531 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.531 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.531 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.531 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.531 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.531 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.531 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-06T08:47:00.531 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-06T08:47:00.532 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.532 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.532 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.532 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:47:00.532 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.532 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.532 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.532 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.533 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.533 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.533 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.533 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.533 INFO:teuthology.orchestra.run.smithi028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-06T08:47:00.533 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-06T08:47:00.533 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.533 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.534 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.534 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:47:00.534 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.534 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.534 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.534 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.534 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.534 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.534 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.535 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.535 INFO:teuthology.orchestra.run.smithi028.stdout: "cross_origin_url": { 2024-06-06T08:47:00.535 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cross_origin_url", 2024-06-06T08:47:00.535 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.535 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.535 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.535 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.535 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.536 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.536 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.536 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.536 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.536 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.536 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.536 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.536 INFO:teuthology.orchestra.run.smithi028.stdout: "crt_file": { 2024-06-06T08:47:00.537 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "crt_file", 2024-06-06T08:47:00.537 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.537 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.537 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.537 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.537 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.537 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.537 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.537 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.538 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.538 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.538 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.538 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.538 INFO:teuthology.orchestra.run.smithi028.stdout: "debug": { 2024-06-06T08:47:00.538 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "debug", 2024-06-06T08:47:00.538 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.538 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.539 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.539 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.539 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.539 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.539 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.539 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Enable/disable debug options", 2024-06-06T08:47:00.539 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.539 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.539 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.540 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.540 INFO:teuthology.orchestra.run.smithi028.stdout: "jwt_token_ttl": { 2024-06-06T08:47:00.540 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "jwt_token_ttl", 2024-06-06T08:47:00.540 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.540 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.540 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.540 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "28800", 2024-06-06T08:47:00.540 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.541 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.541 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.541 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.541 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.541 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.541 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.541 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.541 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-06-06T08:47:00.541 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-06-06T08:47:00.542 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.542 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.542 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.542 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.542 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.542 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.542 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.542 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.542 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.543 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.543 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.543 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.543 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.543 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.543 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.543 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.543 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.543 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.544 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.544 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.544 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.544 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.544 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.544 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.544 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.544 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.545 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.545 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.545 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.545 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.545 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.545 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.545 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.545 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.546 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.546 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.546 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.546 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.546 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.546 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.546 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.546 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.546 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.547 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.547 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.547 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.547 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.547 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.547 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.547 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.547 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.548 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.548 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.548 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.548 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.548 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.548 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.548 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.548 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.549 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.549 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.549 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.549 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.549 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.549 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.549 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.549 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.550 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.550 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.550 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.550 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.550 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.550 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.550 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.550 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.551 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.551 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.551 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.551 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.551 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.551 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.551 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.551 INFO:teuthology.orchestra.run.smithi028.stdout: "motd": { 2024-06-06T08:47:00.551 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "motd", 2024-06-06T08:47:00.552 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.552 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.552 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.552 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.552 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.552 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.552 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.552 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "The message of the day", 2024-06-06T08:47:00.553 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.553 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.553 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.553 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.553 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect_resolve_ip_addr": { 2024-06-06T08:47:00.553 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "redirect_resolve_ip_addr", 2024-06-06T08:47:00.553 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.553 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.554 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.554 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.554 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.554 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.554 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.554 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.554 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.554 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.555 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.555 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.555 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-06-06T08:47:00.555 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-06-06T08:47:00.555 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.555 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.555 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.555 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-06-06T08:47:00.556 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.556 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.556 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.556 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.556 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.556 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.556 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.556 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.557 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-06-06T08:47:00.557 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-06-06T08:47:00.557 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.557 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.557 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.557 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8080", 2024-06-06T08:47:00.557 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.557 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.558 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.558 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.558 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.558 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.558 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.558 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.558 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-06-06T08:47:00.558 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-06-06T08:47:00.558 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.559 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.559 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.559 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.559 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.559 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.559 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.559 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.559 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.559 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.560 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.560 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.560 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl_server_port": { 2024-06-06T08:47:00.560 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl_server_port", 2024-06-06T08:47:00.560 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.560 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.560 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.560 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8443", 2024-06-06T08:47:00.561 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.561 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.561 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.561 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.561 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.561 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.561 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.561 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.561 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-06-06T08:47:00.562 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-06-06T08:47:00.562 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.562 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.562 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.562 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "redirect", 2024-06-06T08:47:00.562 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.562 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.562 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.563 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.563 INFO:teuthology.orchestra.run.smithi028.stdout: "redirect" 2024-06-06T08:47:00.563 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.563 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.563 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.563 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.563 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.563 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.563 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-06-06T08:47:00.564 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-06-06T08:47:00.564 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.564 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.564 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.564 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-06-06T08:47:00.564 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-06-06T08:47:00.564 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-06-06T08:47:00.564 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: "url_prefix": { 2024-06-06T08:47:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url_prefix", 2024-06-06T08:47:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "devicehealth", 2024-06-06T08:47:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.568 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_monitoring": { 2024-06-06T08:47:00.568 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_monitoring", 2024-06-06T08:47:00.568 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.568 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.568 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.568 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.568 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.568 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.569 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.569 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "monitor device health metrics", 2024-06-06T08:47:00.569 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.569 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.569 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.569 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.569 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.569 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.569 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.570 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.570 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.570 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.570 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.570 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.570 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.570 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.570 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.571 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.571 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.571 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.571 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.571 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.571 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.571 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.571 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.571 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.572 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.572 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.572 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.572 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.572 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.572 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.572 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.572 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.573 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.573 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.573 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.573 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.573 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.573 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.573 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.573 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.573 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.574 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.574 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.574 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.574 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.574 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.574 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.574 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.574 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.575 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.575 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.575 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.575 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.575 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.575 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.575 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.575 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.575 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.576 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.577 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.577 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.577 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.577 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.577 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.578 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.578 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.578 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.578 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.578 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.578 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.578 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.579 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.579 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.579 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.579 INFO:teuthology.orchestra.run.smithi028.stdout: "mark_out_threshold": { 2024-06-06T08:47:00.579 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mark_out_threshold", 2024-06-06T08:47:00.579 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.579 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.579 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.579 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "2419200", 2024-06-06T08:47:00.580 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.580 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.580 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.580 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-06T08:47:00.580 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.580 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.580 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.580 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.581 INFO:teuthology.orchestra.run.smithi028.stdout: "pool_name": { 2024-06-06T08:47:00.581 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pool_name", 2024-06-06T08:47:00.581 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.581 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.581 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.581 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "device_health_metrics", 2024-06-06T08:47:00.581 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.581 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.582 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.582 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-06T08:47:00.582 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.582 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.582 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.582 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.582 INFO:teuthology.orchestra.run.smithi028.stdout: "retention_period": { 2024-06-06T08:47:00.582 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "retention_period", 2024-06-06T08:47:00.583 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.583 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.583 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.583 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15552000", 2024-06-06T08:47:00.583 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.583 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.583 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.583 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long to retain device health metrics", 2024-06-06T08:47:00.584 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.584 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.584 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.584 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.584 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_frequency": { 2024-06-06T08:47:00.584 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_frequency", 2024-06-06T08:47:00.584 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.584 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.585 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.585 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-06-06T08:47:00.585 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.585 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.585 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.585 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-06T08:47:00.585 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.585 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.586 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.586 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.586 INFO:teuthology.orchestra.run.smithi028.stdout: "self_heal": { 2024-06-06T08:47:00.586 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "self_heal", 2024-06-06T08:47:00.586 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.586 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.586 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.587 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.587 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.587 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.587 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.587 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-06T08:47:00.587 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.587 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.587 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.588 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.588 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:47:00.588 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:47:00.588 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.588 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.588 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.588 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:47:00.589 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.589 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.589 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.589 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how frequently to wake up and check device health", 2024-06-06T08:47:00.589 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.589 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.589 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.589 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.589 INFO:teuthology.orchestra.run.smithi028.stdout: "warn_threshold": { 2024-06-06T08:47:00.590 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "warn_threshold", 2024-06-06T08:47:00.590 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.590 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.590 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.590 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7257600", 2024-06-06T08:47:00.590 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.590 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.591 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.591 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-06T08:47:00.591 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.591 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.591 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.591 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.591 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.591 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.592 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.592 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "diskprediction_local", 2024-06-06T08:47:00.592 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.592 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.592 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.592 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.592 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.593 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.593 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.593 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.593 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.593 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.593 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.593 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.593 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.593 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.594 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.594 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.594 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.594 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.594 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.594 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.594 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.595 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.595 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.595 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.595 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.595 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.595 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.595 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.595 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.595 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.596 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.596 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.596 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.596 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.596 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.596 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.596 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.597 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.597 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.597 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.597 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.597 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.597 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.597 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.597 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.598 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.598 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.598 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.598 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.598 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.598 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.599 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.599 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.599 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.599 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.599 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.599 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.599 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.599 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.599 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.600 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.600 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.600 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.600 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.600 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.601 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.601 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.601 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.601 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.601 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.601 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.601 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.602 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.602 INFO:teuthology.orchestra.run.smithi028.stdout: "predict_interval": { 2024-06-06T08:47:00.602 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predict_interval", 2024-06-06T08:47:00.602 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.603 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.603 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.603 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "86400", 2024-06-06T08:47:00.603 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.603 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.604 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.604 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.604 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.604 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.604 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.604 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.604 INFO:teuthology.orchestra.run.smithi028.stdout: "predictor_model": { 2024-06-06T08:47:00.604 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "predictor_model", 2024-06-06T08:47:00.604 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.605 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.605 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.605 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "prophetstor", 2024-06-06T08:47:00.605 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.605 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.605 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.605 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.605 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.606 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.606 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.606 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.606 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:47:00.606 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:47:00.606 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.606 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.606 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.606 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "600", 2024-06-06T08:47:00.607 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.607 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.607 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.607 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.607 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.607 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.607 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.607 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.608 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.608 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.608 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.608 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "influx", 2024-06-06T08:47:00.608 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": false, 2024-06-06T08:47:00.608 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "influxdb python module not found", 2024-06-06T08:47:00.608 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.608 INFO:teuthology.orchestra.run.smithi028.stdout: "batch_size": { 2024-06-06T08:47:00.609 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "batch_size", 2024-06-06T08:47:00.609 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.609 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.609 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.609 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5000", 2024-06-06T08:47:00.609 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.609 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.609 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.610 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-06T08:47:00.610 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.610 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.610 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.610 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.610 INFO:teuthology.orchestra.run.smithi028.stdout: "database": { 2024-06-06T08:47:00.610 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "database", 2024-06-06T08:47:00.610 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.611 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.611 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.611 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "ceph", 2024-06-06T08:47:00.611 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.611 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.611 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.611 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-06T08:47:00.611 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.612 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.612 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.612 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.612 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": { 2024-06-06T08:47:00.612 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "hostname", 2024-06-06T08:47:00.612 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.612 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.612 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.613 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.613 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.613 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.613 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.613 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server hostname", 2024-06-06T08:47:00.613 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.613 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.613 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.614 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.614 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:47:00.614 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:47:00.614 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.614 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.614 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.614 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "30", 2024-06-06T08:47:00.615 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "5", 2024-06-06T08:47:00.615 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.615 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.615 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-06T08:47:00.615 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.615 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.615 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.615 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.616 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.616 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.616 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.616 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.616 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.616 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.616 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.616 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.617 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.617 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.617 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.617 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.617 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.617 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.617 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.617 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.617 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.618 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.618 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.618 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.618 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.618 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.618 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.618 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.618 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.619 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.619 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.619 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.619 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.619 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.619 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.619 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.620 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.620 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.620 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.620 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.620 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.620 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.620 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.620 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.620 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.621 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.621 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.621 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.621 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.621 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.621 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.621 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.621 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.621 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.622 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.622 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.622 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.622 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.622 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.622 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.622 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.622 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.623 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.623 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.623 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.623 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.623 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.623 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.623 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.623 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.623 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.624 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.624 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.624 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.624 INFO:teuthology.orchestra.run.smithi028.stdout: "password": { 2024-06-06T08:47:00.624 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "password", 2024-06-06T08:47:00.624 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.624 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.624 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.624 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.625 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.625 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.625 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.625 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "password of InfluxDB server user", 2024-06-06T08:47:00.625 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.625 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.625 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.625 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.626 INFO:teuthology.orchestra.run.smithi028.stdout: "port": { 2024-06-06T08:47:00.626 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "port", 2024-06-06T08:47:00.626 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.626 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.626 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.626 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "8086", 2024-06-06T08:47:00.626 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.627 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.627 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.627 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "InfluxDB server port", 2024-06-06T08:47:00.627 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.627 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.627 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.627 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.627 INFO:teuthology.orchestra.run.smithi028.stdout: "ssl": { 2024-06-06T08:47:00.627 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ssl", 2024-06-06T08:47:00.628 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.628 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.628 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.628 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "false", 2024-06-06T08:47:00.628 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.628 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.628 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.629 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T08:47:00.629 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.629 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.629 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.629 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.629 INFO:teuthology.orchestra.run.smithi028.stdout: "threads": { 2024-06-06T08:47:00.629 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threads", 2024-06-06T08:47:00.629 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.630 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.630 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.630 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:47:00.630 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:47:00.630 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "32", 2024-06-06T08:47:00.630 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.630 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-06T08:47:00.630 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.631 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.631 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.631 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.631 INFO:teuthology.orchestra.run.smithi028.stdout: "username": { 2024-06-06T08:47:00.631 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "username", 2024-06-06T08:47:00.631 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.631 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.631 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.631 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.632 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.632 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.632 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.632 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "username of InfluxDB server user", 2024-06-06T08:47:00.632 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.632 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.632 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.632 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.633 INFO:teuthology.orchestra.run.smithi028.stdout: "verify_ssl": { 2024-06-06T08:47:00.633 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "verify_ssl", 2024-06-06T08:47:00.633 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.633 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.633 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.633 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "true", 2024-06-06T08:47:00.633 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.633 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.634 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.634 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T08:47:00.634 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.634 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.634 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.634 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.634 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.634 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.635 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.635 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "insights", 2024-06-06T08:47:00.635 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.635 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.635 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.635 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.635 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.635 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.636 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.636 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.636 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.636 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.636 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.636 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.636 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.636 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.637 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.637 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.637 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.637 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.637 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.637 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.637 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.637 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.638 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.638 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.638 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.638 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.638 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.638 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.638 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.638 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.639 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.639 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.639 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.639 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.639 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.639 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.639 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.639 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.639 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.640 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.640 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.640 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.640 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.640 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.640 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.640 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.640 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.641 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.641 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.641 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.641 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.641 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.641 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.641 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.641 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.642 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.642 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.642 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.642 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.642 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.642 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.642 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.642 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.643 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.643 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.643 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.643 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.643 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.643 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.643 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.643 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.644 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.644 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.644 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.644 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.644 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.644 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "iostat", 2024-06-06T08:47:00.644 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.644 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.644 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.645 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.645 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.645 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.645 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.645 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.645 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.645 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.645 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.646 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.646 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.646 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.646 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.646 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.646 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.646 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.646 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.647 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.647 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.647 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.647 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.647 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.647 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.647 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.647 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.648 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.648 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.648 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.648 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.648 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.648 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.648 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.648 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.649 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.649 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.649 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.649 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.649 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.649 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.649 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.649 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.650 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.650 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.650 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.650 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.650 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.650 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.650 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.650 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.651 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.651 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.651 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.651 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.651 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.651 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.651 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.651 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.652 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.652 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.652 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.652 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.652 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.652 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.652 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.652 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.653 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.653 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.653 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.653 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.653 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.653 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.653 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.653 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.653 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.654 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "k8sevents", 2024-06-06T08:47:00.654 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.654 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.654 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.654 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_event_retention_days": { 2024-06-06T08:47:00.654 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "ceph_event_retention_days", 2024-06-06T08:47:00.654 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.654 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.655 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.655 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "7", 2024-06-06T08:47:00.655 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.655 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.655 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.655 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-06T08:47:00.655 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.655 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.656 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.656 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.656 INFO:teuthology.orchestra.run.smithi028.stdout: "config_check_secs": { 2024-06-06T08:47:00.656 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "config_check_secs", 2024-06-06T08:47:00.656 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.656 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.656 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.656 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:47:00.656 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "10", 2024-06-06T08:47:00.656 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.657 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.657 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-06T08:47:00.657 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.657 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.657 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.657 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.657 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.657 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.657 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.658 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.658 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.658 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.658 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.658 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.658 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.658 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.658 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.659 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.659 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.659 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.659 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.659 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.659 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.659 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.659 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.660 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.660 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.660 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.660 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.660 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.660 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.660 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.660 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.661 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.661 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.661 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.661 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.661 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.661 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.661 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.661 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.661 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.661 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.662 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.662 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.662 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.662 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.662 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.662 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.662 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.662 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.663 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.663 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.663 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.663 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.663 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.663 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.663 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.663 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.664 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.664 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.664 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.664 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.664 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.664 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.664 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.664 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.664 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.665 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.665 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.665 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.665 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.665 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.665 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.665 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.665 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.665 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.666 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.666 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.666 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "localpool", 2024-06-06T08:47:00.666 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.666 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.666 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.666 INFO:teuthology.orchestra.run.smithi028.stdout: "failure_domain": { 2024-06-06T08:47:00.666 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "failure_domain", 2024-06-06T08:47:00.667 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.667 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.667 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.667 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "host", 2024-06-06T08:47:00.667 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.667 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.667 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.667 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "failure domain for any created local pool", 2024-06-06T08:47:00.667 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-06T08:47:00.667 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.668 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.668 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.668 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.668 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.668 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.668 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.668 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.668 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.668 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.669 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.669 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.669 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.669 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.669 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.669 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.669 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.669 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.669 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.669 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.670 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.670 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.670 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.670 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.670 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.670 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.670 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.670 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.671 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.671 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.671 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.671 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.671 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.671 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.671 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.671 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.671 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.672 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.672 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.672 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.672 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.672 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.672 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.672 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.672 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.672 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.673 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.673 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.673 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.673 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.673 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.673 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.673 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.673 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.673 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.674 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.674 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.674 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.674 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.674 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.674 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.674 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.674 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.675 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.675 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.675 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.675 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.675 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.675 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.675 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.676 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.676 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.676 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.676 INFO:teuthology.orchestra.run.smithi028.stdout: "min_size": { 2024-06-06T08:47:00.676 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "min_size", 2024-06-06T08:47:00.676 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.676 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.676 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.676 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.676 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.677 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.677 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.677 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default min_size for any created local pool", 2024-06-06T08:47:00.677 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-06T08:47:00.677 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.677 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.677 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.677 INFO:teuthology.orchestra.run.smithi028.stdout: "num_rep": { 2024-06-06T08:47:00.677 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "num_rep", 2024-06-06T08:47:00.678 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.678 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.678 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.678 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3", 2024-06-06T08:47:00.678 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.678 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.678 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.678 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default replica count for any created local pool", 2024-06-06T08:47:00.678 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.679 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.679 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.679 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.679 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_num": { 2024-06-06T08:47:00.679 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_num", 2024-06-06T08:47:00.679 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.679 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.679 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.679 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "128", 2024-06-06T08:47:00.680 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.680 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.680 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.680 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "default pg_num for any created local pool", 2024-06-06T08:47:00.680 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.680 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.680 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.680 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.681 INFO:teuthology.orchestra.run.smithi028.stdout: "prefix": { 2024-06-06T08:47:00.681 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prefix", 2024-06-06T08:47:00.681 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.681 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.681 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.681 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.681 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.681 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.682 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.682 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "name prefix for any created local pool", 2024-06-06T08:47:00.682 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.682 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.682 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.682 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.682 INFO:teuthology.orchestra.run.smithi028.stdout: "subtree": { 2024-06-06T08:47:00.683 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "subtree", 2024-06-06T08:47:00.683 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.683 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.683 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.683 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "rack", 2024-06-06T08:47:00.683 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.683 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.683 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.684 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-06T08:47:00.684 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-06T08:47:00.684 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.684 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.684 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.684 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.684 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.685 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.685 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mds_autoscaler", 2024-06-06T08:47:00.685 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.685 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.685 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.685 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.685 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.685 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.686 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.686 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.686 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.686 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.686 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.686 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.686 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.687 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.687 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.687 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.687 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.687 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.687 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.688 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.688 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.688 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.688 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.688 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.688 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.689 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.689 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.689 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.689 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.689 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.689 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.689 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.689 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.690 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.690 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.690 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.690 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.690 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.690 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.690 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.690 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.691 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.691 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.691 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.691 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.691 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.691 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.691 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.691 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.691 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.692 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.692 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.692 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.692 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.692 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.692 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.692 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.692 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.693 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.693 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.693 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.693 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.693 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.693 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.693 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.693 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.693 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.694 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.694 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.694 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.694 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.694 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.694 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.694 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.694 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.695 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.695 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirroring", 2024-06-06T08:47:00.695 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.695 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.695 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.695 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.695 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.695 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.695 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.696 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.696 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.696 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.696 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.696 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.696 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.696 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.696 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.697 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.697 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.697 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.697 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.697 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.697 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.697 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.698 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.698 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.698 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.698 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.698 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.698 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.698 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.698 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.699 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.699 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.699 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.699 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.699 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.699 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.699 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.699 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.700 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.700 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.700 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.700 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.700 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.700 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.700 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.700 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.700 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.700 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.701 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.701 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.701 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.701 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.701 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.701 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.701 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.701 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.702 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.702 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.702 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.702 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.702 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.702 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.702 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.703 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.703 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.703 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.703 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.703 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.703 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.703 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.703 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.703 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.704 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.704 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.704 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.704 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.704 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "nfs", 2024-06-06T08:47:00.704 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.704 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.704 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.704 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.705 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.705 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.705 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.705 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.705 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.705 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.705 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.705 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.706 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.706 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.706 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.706 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.706 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.706 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.706 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.706 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.707 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.707 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.707 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.707 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.707 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.707 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.707 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.707 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.707 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.708 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.708 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.708 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.708 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.708 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.708 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.708 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.708 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.708 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.709 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.709 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.709 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.709 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.709 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.709 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.709 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.709 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.709 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.710 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.710 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.710 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.710 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.710 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.710 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.710 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.710 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.711 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.711 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.711 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.711 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.711 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.711 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.711 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.711 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.711 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.712 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.712 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.712 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.712 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.712 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.712 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.712 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.712 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.713 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.713 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.713 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.713 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.713 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-06-06T08:47:00.713 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.713 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.713 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.713 INFO:teuthology.orchestra.run.smithi028.stdout: "fail_fs": { 2024-06-06T08:47:00.714 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "fail_fs", 2024-06-06T08:47:00.714 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.714 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.714 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.714 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.714 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.714 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.714 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.715 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-06T08:47:00.715 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.715 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.715 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.715 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.715 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.715 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.715 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.715 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.716 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.716 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.716 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.716 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.716 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.716 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.716 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.716 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.716 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.717 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.717 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.717 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.717 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.717 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.717 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.717 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.717 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.717 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.718 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.718 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.718 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.718 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.718 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.718 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.718 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.719 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.719 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.719 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.719 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.719 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.719 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.719 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.719 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.719 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.720 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.720 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.720 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.720 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.720 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.720 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.720 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.720 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.720 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.721 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.721 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.721 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.721 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.721 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.721 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.721 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.721 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.721 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.722 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.722 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.722 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.722 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.722 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.722 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.722 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.723 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.723 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.723 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.723 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.723 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.723 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.723 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.723 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator": { 2024-06-06T08:47:00.724 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "orchestrator", 2024-06-06T08:47:00.724 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.724 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.724 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.724 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.724 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.724 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.724 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.725 INFO:teuthology.orchestra.run.smithi028.stdout: "cephadm", 2024-06-06T08:47:00.725 INFO:teuthology.orchestra.run.smithi028.stdout: "rook", 2024-06-06T08:47:00.725 INFO:teuthology.orchestra.run.smithi028.stdout: "test_orchestrator" 2024-06-06T08:47:00.725 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.725 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Orchestrator backend", 2024-06-06T08:47:00.725 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.725 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.726 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.726 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.726 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.726 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.726 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.726 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_perf_query", 2024-06-06T08:47:00.726 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.727 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.727 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.727 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.727 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.727 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.727 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.727 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.727 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.728 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.728 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.728 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.728 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.728 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.728 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.728 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.729 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.729 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.729 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.729 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.729 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.729 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.729 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.729 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.730 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.730 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.730 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.730 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.730 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.730 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.730 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.730 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.731 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.731 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.731 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.731 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.731 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.731 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.731 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.731 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.732 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.732 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.732 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.732 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.732 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.732 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.732 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.733 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.733 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.733 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.733 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.733 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.733 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.733 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.733 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.734 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.734 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.734 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.734 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.734 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.734 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.734 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.734 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.735 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.735 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.735 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.735 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.735 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.735 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.735 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.735 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.736 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.736 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.736 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.736 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.736 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.736 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "osd_support", 2024-06-06T08:47:00.736 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.736 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.736 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.737 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.737 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.737 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.737 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.737 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.737 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.737 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.737 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.737 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.738 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.738 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.738 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.738 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.738 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.738 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.738 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.739 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.739 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.739 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.739 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.739 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.739 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.739 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.739 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.739 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.740 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.740 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.740 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.740 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.740 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.740 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.740 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.740 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.741 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.741 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.741 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.741 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.741 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.741 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.741 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.741 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.741 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.742 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.742 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.742 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.742 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.742 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.742 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.742 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.743 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.743 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.743 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.743 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.743 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.743 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.743 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.743 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.744 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.744 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.744 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.744 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.744 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.744 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.744 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.745 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.745 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.745 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.745 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.745 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.745 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.745 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.746 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.746 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.746 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "pg_autoscaler", 2024-06-06T08:47:00.746 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.746 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.746 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.746 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.747 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.747 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.747 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.747 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.747 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.747 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.747 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.748 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.748 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.748 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.748 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.748 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.748 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.748 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.749 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.749 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.749 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.749 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.749 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.749 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.750 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.750 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.750 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.750 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.750 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.750 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.750 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.751 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.751 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.751 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.751 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.751 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.751 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.751 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.752 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.752 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.752 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.752 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.752 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.752 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.752 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.753 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.753 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.753 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.753 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.753 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.753 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.754 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.754 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.754 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.754 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.754 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.754 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.754 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.754 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.755 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.755 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.755 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.755 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.755 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.755 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.756 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.756 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.756 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.756 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.756 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.756 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.756 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.756 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.757 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:47:00.757 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:47:00.757 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.757 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.757 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.758 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:47:00.758 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.758 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.758 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.758 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.758 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.758 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.758 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.759 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.759 INFO:teuthology.orchestra.run.smithi028.stdout: "threshold": { 2024-06-06T08:47:00.759 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "threshold", 2024-06-06T08:47:00.759 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:47:00.759 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.759 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.760 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "3.0", 2024-06-06T08:47:00.760 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1.0", 2024-06-06T08:47:00.760 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.760 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.760 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "scaling threshold", 2024-06-06T08:47:00.760 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-06T08:47:00.760 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.760 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.761 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.761 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.761 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.761 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.761 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "progress", 2024-06-06T08:47:00.762 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.762 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.762 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.762 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_pg_recovery_event": { 2024-06-06T08:47:00.762 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_pg_recovery_event", 2024-06-06T08:47:00.762 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.762 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.763 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.763 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.763 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.763 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.763 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.763 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-06T08:47:00.763 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.764 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.764 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.764 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.764 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-06-06T08:47:00.764 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-06-06T08:47:00.764 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.764 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.765 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.765 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.765 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.765 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.765 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.765 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.765 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.766 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.766 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.766 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.766 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.766 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.766 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.767 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.767 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.767 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.767 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.767 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.767 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.767 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.767 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.768 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.768 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.768 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.768 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.768 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.768 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.768 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.768 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.769 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.769 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.769 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.769 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.769 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.769 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.769 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.769 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.769 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.770 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.770 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.770 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.770 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.770 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.771 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.771 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.771 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.771 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.771 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.771 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.771 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.771 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.772 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.772 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.772 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.772 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.772 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.772 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.772 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.772 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.772 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.773 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.773 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.773 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.773 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.773 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.773 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.773 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.774 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.774 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.774 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.774 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.774 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.774 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.774 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.774 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.775 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.775 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.775 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.775 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.775 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.775 INFO:teuthology.orchestra.run.smithi028.stdout: "max_completed_events": { 2024-06-06T08:47:00.775 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_completed_events", 2024-06-06T08:47:00.776 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.776 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.776 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.776 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "50", 2024-06-06T08:47:00.776 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.776 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.776 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.776 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "number of past completed events to remember", 2024-06-06T08:47:00.777 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.777 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.777 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.777 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.777 INFO:teuthology.orchestra.run.smithi028.stdout: "sleep_interval": { 2024-06-06T08:47:00.777 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "sleep_interval", 2024-06-06T08:47:00.777 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.778 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.778 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.778 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "5", 2024-06-06T08:47:00.778 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.778 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.778 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.778 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "how long the module is going to sleep", 2024-06-06T08:47:00.779 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.779 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.779 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.779 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.779 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.779 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.779 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.779 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "prometheus", 2024-06-06T08:47:00.781 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.781 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.781 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.781 INFO:teuthology.orchestra.run.smithi028.stdout: "cache": { 2024-06-06T08:47:00.781 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "cache", 2024-06-06T08:47:00.781 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.782 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.782 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.782 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.782 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.782 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.782 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.782 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.782 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.783 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.783 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.783 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.783 INFO:teuthology.orchestra.run.smithi028.stdout: "exclude_perf_counters": { 2024-06-06T08:47:00.783 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "exclude_perf_counters", 2024-06-06T08:47:00.783 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.783 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.783 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.784 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.784 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.784 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.784 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.784 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-06T08:47:00.784 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-06T08:47:00.784 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.784 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.785 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.785 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.785 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.785 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.785 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.785 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.785 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.785 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.785 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.786 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.786 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.786 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.786 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.786 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.786 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.786 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.786 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.787 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.787 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.787 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.787 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.787 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.787 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.787 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.787 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.787 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.788 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.788 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.788 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.788 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.788 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.788 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.788 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.788 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.789 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.789 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.789 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.789 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.789 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.789 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.789 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.789 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.790 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.790 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.790 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.790 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.790 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.790 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.790 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.790 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.790 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.791 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.791 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.791 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.791 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.791 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.791 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.791 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.791 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.792 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.792 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.792 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.792 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.792 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.792 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.792 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.793 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.793 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.793 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.793 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.793 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.793 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools": { 2024-06-06T08:47:00.793 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools", 2024-06-06T08:47:00.794 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.794 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.794 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.794 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.794 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.794 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.794 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.794 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.795 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.795 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.795 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.795 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.795 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-06T08:47:00.795 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-06T08:47:00.795 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.796 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.796 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.796 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "300", 2024-06-06T08:47:00.796 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.796 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.796 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.796 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.796 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.797 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.797 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.797 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.797 INFO:teuthology.orchestra.run.smithi028.stdout: "scrape_interval": { 2024-06-06T08:47:00.797 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "scrape_interval", 2024-06-06T08:47:00.797 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:47:00.797 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.798 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.798 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15.0", 2024-06-06T08:47:00.798 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.798 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.798 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.798 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.799 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.799 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.799 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.799 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.799 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-06-06T08:47:00.799 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-06-06T08:47:00.799 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.799 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.800 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.800 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "::", 2024-06-06T08:47:00.800 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.800 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.800 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.800 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-06T08:47:00.800 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.800 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.801 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.801 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.801 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-06-06T08:47:00.801 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-06-06T08:47:00.801 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.801 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.801 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.801 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "9283", 2024-06-06T08:47:00.802 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.802 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.802 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.802 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-06T08:47:00.802 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.802 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.802 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.802 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.803 INFO:teuthology.orchestra.run.smithi028.stdout: "stale_cache_strategy": { 2024-06-06T08:47:00.803 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stale_cache_strategy", 2024-06-06T08:47:00.803 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.803 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.803 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.803 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "log", 2024-06-06T08:47:00.803 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.804 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.804 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.804 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.804 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.804 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.804 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.804 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.804 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_behaviour": { 2024-06-06T08:47:00.805 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_behaviour", 2024-06-06T08:47:00.805 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.805 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.805 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.805 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "default", 2024-06-06T08:47:00.805 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.805 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.805 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.806 INFO:teuthology.orchestra.run.smithi028.stdout: "default", 2024-06-06T08:47:00.806 INFO:teuthology.orchestra.run.smithi028.stdout: "error" 2024-06-06T08:47:00.806 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.806 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.806 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.806 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.806 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.807 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.807 INFO:teuthology.orchestra.run.smithi028.stdout: "standby_error_status_code": { 2024-06-06T08:47:00.807 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "standby_error_status_code", 2024-06-06T08:47:00.807 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.807 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.807 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.807 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "500", 2024-06-06T08:47:00.807 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "400", 2024-06-06T08:47:00.807 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "599", 2024-06-06T08:47:00.808 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.808 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.808 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.808 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.808 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.808 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.808 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.808 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.809 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.809 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_support", 2024-06-06T08:47:00.809 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.809 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.809 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.809 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.809 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.809 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.810 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.810 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.810 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.810 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.810 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.810 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.810 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.810 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.810 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.811 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.811 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.811 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.811 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.811 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.811 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.811 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.811 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.812 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.812 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.812 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.812 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.812 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.812 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.812 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.812 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.812 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.813 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.813 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.813 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.813 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.813 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.813 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.813 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.813 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.814 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.814 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.814 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.814 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.814 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.814 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.814 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.814 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.815 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.815 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.815 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.815 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.815 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.815 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.815 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.815 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.816 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.816 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.816 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.816 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.816 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.816 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.816 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.816 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.817 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.817 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.817 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.817 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.817 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.817 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.817 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.817 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.817 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.818 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_snap_create": { 2024-06-06T08:47:00.818 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_snap_create", 2024-06-06T08:47:00.818 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.818 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.818 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.818 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10", 2024-06-06T08:47:00.818 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.819 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.819 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.819 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.819 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.819 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.819 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.819 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.820 INFO:teuthology.orchestra.run.smithi028.stdout: "mirror_snapshot_schedule": { 2024-06-06T08:47:00.820 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "mirror_snapshot_schedule", 2024-06-06T08:47:00.820 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.820 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.820 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.820 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.820 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.820 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.820 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.821 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.821 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.821 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.821 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.821 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.821 INFO:teuthology.orchestra.run.smithi028.stdout: "trash_purge_schedule": { 2024-06-06T08:47:00.821 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "trash_purge_schedule", 2024-06-06T08:47:00.821 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.822 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.822 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.822 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.822 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.822 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.822 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.822 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.822 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.823 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.823 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.823 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.823 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.823 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.823 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.823 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "restful", 2024-06-06T08:47:00.823 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.823 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.824 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.824 INFO:teuthology.orchestra.run.smithi028.stdout: "enable_auth": { 2024-06-06T08:47:00.824 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enable_auth", 2024-06-06T08:47:00.824 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.824 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.824 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.824 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.824 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.825 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.825 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.825 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.825 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.825 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.825 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.825 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.825 INFO:teuthology.orchestra.run.smithi028.stdout: "key_file": { 2024-06-06T08:47:00.826 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "key_file", 2024-06-06T08:47:00.826 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.826 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.826 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.826 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.826 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.826 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.826 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.827 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.827 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.827 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.827 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.827 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.827 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.827 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.827 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.828 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.828 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.828 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.828 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.828 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.828 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.828 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.828 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.828 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.829 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.829 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.829 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.829 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.829 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.829 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.829 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.829 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.830 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.830 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.830 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.830 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.830 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.830 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.830 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.830 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.831 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.831 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.831 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.831 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.831 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.831 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.831 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.831 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.832 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.832 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.832 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.832 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.832 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.832 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.832 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.832 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.832 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.833 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.833 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.833 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.833 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.833 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.833 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.833 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.833 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.834 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.834 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.834 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.834 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.834 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.834 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.834 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.835 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.835 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.835 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.835 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.835 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.835 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.835 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.835 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.835 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.836 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.836 INFO:teuthology.orchestra.run.smithi028.stdout: "server_addr": { 2024-06-06T08:47:00.836 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_addr", 2024-06-06T08:47:00.836 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.836 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.836 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.836 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.836 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.836 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.837 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.837 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.837 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.837 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.837 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.837 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.837 INFO:teuthology.orchestra.run.smithi028.stdout: "server_port": { 2024-06-06T08:47:00.837 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "server_port", 2024-06-06T08:47:00.838 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.838 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.838 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.838 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.838 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.838 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.838 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.838 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.838 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.839 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.839 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.839 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.839 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.839 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.839 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.839 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rgw", 2024-06-06T08:47:00.839 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.839 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.840 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.840 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.840 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.840 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.840 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.840 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.840 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.840 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.840 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.841 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.841 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.841 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.841 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.841 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.841 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.841 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.841 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.842 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.842 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.842 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.842 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.842 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.842 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.842 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.842 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.842 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.843 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.843 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.843 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.843 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.843 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.843 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.843 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.843 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.843 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.844 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.844 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.844 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.844 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.844 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.844 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.844 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.845 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.845 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.845 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.845 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.845 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.845 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.845 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.845 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.845 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.846 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.846 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.846 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.846 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.846 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.846 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.846 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.846 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.847 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.847 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.847 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.847 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.847 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.847 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.847 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.847 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.848 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.848 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.848 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.848 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.848 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.848 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.848 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.848 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rook", 2024-06-06T08:47:00.849 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.849 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.849 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.849 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.849 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.849 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.849 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.849 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.849 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.850 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.850 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.850 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.850 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.850 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.850 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.850 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.850 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.851 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.851 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.851 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.851 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.851 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.851 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.851 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.851 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.852 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.852 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.852 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.852 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.852 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.852 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.852 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.852 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.853 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.853 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.853 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.853 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.853 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.853 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.853 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.853 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.854 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.854 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.854 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.854 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.854 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.854 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.854 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.854 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.855 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.855 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.855 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.855 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.855 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.855 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.855 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.855 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.856 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.856 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.856 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.856 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.856 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.856 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.856 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.857 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.857 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.857 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.857 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.857 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.857 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.857 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.857 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.857 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.858 INFO:teuthology.orchestra.run.smithi028.stdout: "storage_class": { 2024-06-06T08:47:00.858 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "storage_class", 2024-06-06T08:47:00.858 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.858 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.858 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.858 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "local", 2024-06-06T08:47:00.858 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.858 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.859 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.859 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-06T08:47:00.859 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.859 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.859 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.859 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.859 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.859 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.860 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.860 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "selftest", 2024-06-06T08:47:00.860 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.860 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.860 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.860 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.860 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.860 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.860 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.861 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.861 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.861 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.861 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.861 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.861 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.861 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.861 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.861 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.862 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.862 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.862 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.862 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.862 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.862 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.862 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.862 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.863 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.863 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.863 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.863 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.863 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.863 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.863 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.863 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.864 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.864 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.864 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.864 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.864 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.864 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.864 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.864 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.864 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.865 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.865 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.865 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.865 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.865 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.865 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.865 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.865 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.866 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.866 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.866 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.866 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.866 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.866 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.866 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.866 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.867 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.867 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.867 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.867 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.867 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.867 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.867 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.867 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.867 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.868 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.868 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.868 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.868 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.868 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.868 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.868 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.868 INFO:teuthology.orchestra.run.smithi028.stdout: "roption1": { 2024-06-06T08:47:00.869 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption1", 2024-06-06T08:47:00.869 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.869 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.869 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.869 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.869 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.869 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.869 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.869 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.870 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.870 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.870 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.870 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.870 INFO:teuthology.orchestra.run.smithi028.stdout: "roption2": { 2024-06-06T08:47:00.870 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "roption2", 2024-06-06T08:47:00.870 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.870 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.871 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.871 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "xyz", 2024-06-06T08:47:00.871 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.871 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.871 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.871 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.871 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.871 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.871 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.872 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.872 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption1": { 2024-06-06T08:47:00.872 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption1", 2024-06-06T08:47:00.872 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.872 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.872 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.872 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.872 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.873 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.873 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.873 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.873 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.873 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.873 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.873 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.873 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption2": { 2024-06-06T08:47:00.874 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption2", 2024-06-06T08:47:00.874 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.874 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.874 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.874 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.874 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.874 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.874 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.875 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.875 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.875 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.875 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.875 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.875 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption3": { 2024-06-06T08:47:00.875 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption3", 2024-06-06T08:47:00.876 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "float", 2024-06-06T08:47:00.876 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.876 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.876 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.876 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.876 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.876 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.876 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.877 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.877 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.877 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.877 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.877 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption4": { 2024-06-06T08:47:00.877 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption4", 2024-06-06T08:47:00.877 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.877 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.877 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.878 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.878 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.878 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.878 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.878 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.878 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.878 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.878 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.879 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.879 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption5": { 2024-06-06T08:47:00.879 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption5", 2024-06-06T08:47:00.879 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.879 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.879 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.879 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.879 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.879 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.880 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.880 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.880 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.880 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.880 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.880 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.880 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption6": { 2024-06-06T08:47:00.880 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption6", 2024-06-06T08:47:00.880 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.881 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.881 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.881 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.881 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.881 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.881 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.881 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.881 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.882 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.882 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.882 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.882 INFO:teuthology.orchestra.run.smithi028.stdout: "rwoption7": { 2024-06-06T08:47:00.882 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rwoption7", 2024-06-06T08:47:00.882 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.882 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.882 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.883 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.883 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "1", 2024-06-06T08:47:00.883 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "42", 2024-06-06T08:47:00.883 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.883 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.883 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.883 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.883 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.883 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.884 INFO:teuthology.orchestra.run.smithi028.stdout: "testkey": { 2024-06-06T08:47:00.884 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testkey", 2024-06-06T08:47:00.884 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.884 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.884 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.884 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.884 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.884 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.884 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.885 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.885 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.885 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.885 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.885 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.885 INFO:teuthology.orchestra.run.smithi028.stdout: "testlkey": { 2024-06-06T08:47:00.885 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testlkey", 2024-06-06T08:47:00.885 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.886 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.886 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.886 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.886 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.886 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.886 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.886 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.886 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.887 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.887 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.887 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.887 INFO:teuthology.orchestra.run.smithi028.stdout: "testnewline": { 2024-06-06T08:47:00.887 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "testnewline", 2024-06-06T08:47:00.887 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.887 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.887 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.888 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.888 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.888 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.888 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.888 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.888 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.888 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.888 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.889 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.889 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.889 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.889 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.889 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snap_schedule", 2024-06-06T08:47:00.889 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.889 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.889 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.889 INFO:teuthology.orchestra.run.smithi028.stdout: "allow_m_granularity": { 2024-06-06T08:47:00.889 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "allow_m_granularity", 2024-06-06T08:47:00.890 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.890 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.890 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.890 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.890 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.890 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.890 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.891 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "allow minute scheduled snapshots", 2024-06-06T08:47:00.891 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.891 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.891 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.891 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.891 INFO:teuthology.orchestra.run.smithi028.stdout: "dump_on_update": { 2024-06-06T08:47:00.891 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "dump_on_update", 2024-06-06T08:47:00.891 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.891 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.892 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.892 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.892 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.892 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.892 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.892 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "dump database to debug log on update", 2024-06-06T08:47:00.892 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.892 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.892 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.893 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.893 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.893 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.893 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.893 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.893 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.893 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.893 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.893 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.894 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.894 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.894 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.894 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.894 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.894 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.894 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.894 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.895 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.895 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.895 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.895 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.895 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.895 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.895 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.895 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.896 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.896 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.896 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.896 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.896 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.896 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.896 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.896 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.897 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.897 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.897 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.897 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.897 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.897 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.897 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.897 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.898 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.898 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.898 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.898 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.898 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.898 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.898 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.898 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.898 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.899 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.899 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.900 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.901 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.901 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.901 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.901 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.901 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.901 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.901 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.902 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.902 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.902 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.902 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.902 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.902 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.902 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.902 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.903 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.903 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.903 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.903 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.903 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.903 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.903 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "stats", 2024-06-06T08:47:00.903 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.903 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.904 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.904 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.904 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.904 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.904 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.904 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.904 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.904 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.905 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.905 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.905 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.905 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.905 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.905 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.905 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.905 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.905 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.906 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.906 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.906 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.906 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.906 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.906 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.906 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.907 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.907 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.907 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.907 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.907 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.907 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.907 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.907 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.907 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.908 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.908 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.908 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.908 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.908 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.908 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.908 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.908 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.909 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.909 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.909 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.909 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.909 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.909 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.909 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.910 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.910 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.910 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.910 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.910 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.910 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.910 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.910 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.911 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.911 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.911 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.911 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.911 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.911 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.911 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.911 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.912 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.912 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.912 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.912 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.912 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.912 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.912 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.912 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.912 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.913 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.913 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "status", 2024-06-06T08:47:00.913 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.913 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.913 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.913 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.913 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.913 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.914 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.914 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.914 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.914 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.914 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.914 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.914 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.914 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.914 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.915 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.915 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.915 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.915 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.915 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.915 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.915 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.915 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.915 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.916 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.916 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.916 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.916 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.916 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.916 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.916 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.916 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.917 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.917 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.917 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.917 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.917 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.917 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.917 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.917 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.917 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.918 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.918 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.918 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.918 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.918 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.918 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.918 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.918 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.919 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.919 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.919 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.919 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.919 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.919 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.919 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.919 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.920 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.920 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.920 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.920 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.920 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.920 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.920 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.920 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.920 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.921 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.921 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.921 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.921 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.921 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.921 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.921 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.921 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.921 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.922 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.922 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telegraf", 2024-06-06T08:47:00.922 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.922 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.922 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.922 INFO:teuthology.orchestra.run.smithi028.stdout: "address": { 2024-06-06T08:47:00.922 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "address", 2024-06-06T08:47:00.922 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.923 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.923 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.923 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-06T08:47:00.923 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.923 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.923 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.923 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.923 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.923 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.924 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.924 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.924 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:47:00.924 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:47:00.924 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:00.924 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.924 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.924 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "15", 2024-06-06T08:47:00.924 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.925 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.925 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.925 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.925 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.925 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.925 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.925 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.925 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.926 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.926 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.926 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.926 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.926 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.926 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.926 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.926 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.927 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.927 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.927 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.927 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.927 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.927 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.927 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.927 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.927 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.928 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.928 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.928 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.928 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.928 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.928 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.928 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.929 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.929 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.929 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.929 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.929 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.929 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.929 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.929 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.929 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.930 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.930 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.930 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.930 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.930 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.930 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.930 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.931 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.931 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.931 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.931 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.931 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.931 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.931 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.932 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.932 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.932 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.932 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.932 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.932 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.932 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.933 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.933 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.933 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.933 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.933 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.933 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.933 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.934 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.934 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.934 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.934 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.934 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.934 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.935 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.935 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.935 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.935 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.935 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.935 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "telemetry", 2024-06-06T08:47:00.935 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.935 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.936 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.936 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_basic": { 2024-06-06T08:47:00.936 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_basic", 2024-06-06T08:47:00.936 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.936 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.936 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.936 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.937 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.937 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.937 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.937 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-06T08:47:00.937 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.937 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.937 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.938 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.938 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_crash": { 2024-06-06T08:47:00.938 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_crash", 2024-06-06T08:47:00.938 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.938 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.938 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.939 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.939 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.939 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.939 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.939 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-06T08:47:00.939 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.939 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.939 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.940 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.940 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_device": { 2024-06-06T08:47:00.940 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_device", 2024-06-06T08:47:00.940 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.940 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.940 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.940 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:00.941 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.941 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.941 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.941 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-06T08:47:00.941 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.941 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.941 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.941 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.942 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_ident": { 2024-06-06T08:47:00.942 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_ident", 2024-06-06T08:47:00.942 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.942 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.942 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.942 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.942 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.942 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.943 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.943 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-06T08:47:00.943 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.943 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.943 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.944 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.944 INFO:teuthology.orchestra.run.smithi028.stdout: "channel_perf": { 2024-06-06T08:47:00.944 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "channel_perf", 2024-06-06T08:47:00.944 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.944 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.944 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.944 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.944 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.945 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.945 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.945 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-06T08:47:00.945 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.945 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.945 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.946 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.946 INFO:teuthology.orchestra.run.smithi028.stdout: "contact": { 2024-06-06T08:47:00.946 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "contact", 2024-06-06T08:47:00.946 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.946 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.946 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.946 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.946 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.947 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.947 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.947 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.947 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.947 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.947 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.947 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.948 INFO:teuthology.orchestra.run.smithi028.stdout: "description": { 2024-06-06T08:47:00.948 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "description", 2024-06-06T08:47:00.948 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.948 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.948 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.948 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.948 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.948 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.948 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.949 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.949 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.949 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.949 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.949 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.949 INFO:teuthology.orchestra.run.smithi028.stdout: "device_url": { 2024-06-06T08:47:00.949 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "device_url", 2024-06-06T08:47:00.950 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.950 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.950 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.950 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-06T08:47:00.950 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.950 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.950 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.950 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.951 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.951 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.951 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.951 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.951 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": { 2024-06-06T08:47:00.951 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "enabled", 2024-06-06T08:47:00.951 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.952 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.952 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.952 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.952 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.952 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.952 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.952 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.952 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.952 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.953 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.953 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.953 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:47:00.953 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:47:00.953 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.953 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.953 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.953 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "24", 2024-06-06T08:47:00.954 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "8", 2024-06-06T08:47:00.954 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.954 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.954 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.954 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.954 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.954 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.955 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.955 INFO:teuthology.orchestra.run.smithi028.stdout: "last_opt_revision": { 2024-06-06T08:47:00.955 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "last_opt_revision", 2024-06-06T08:47:00.955 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.955 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.955 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.955 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "1", 2024-06-06T08:47:00.955 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.956 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.956 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.956 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.956 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.956 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.956 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.956 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.956 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard": { 2024-06-06T08:47:00.957 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard", 2024-06-06T08:47:00.957 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.957 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.957 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.957 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.957 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.957 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.958 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.958 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.958 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.958 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.958 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.958 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.958 INFO:teuthology.orchestra.run.smithi028.stdout: "leaderboard_description": { 2024-06-06T08:47:00.959 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "leaderboard_description", 2024-06-06T08:47:00.959 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.959 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.959 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.959 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.960 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.960 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.960 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.960 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.960 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.960 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.960 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.961 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.961 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.961 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.961 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.961 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.961 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.961 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.962 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.962 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.962 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.962 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.962 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.962 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.962 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.963 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.963 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.963 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.963 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.963 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.963 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.963 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.964 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.964 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.964 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.964 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.964 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.964 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.964 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.964 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.964 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.965 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.965 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.965 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.965 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.965 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.965 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.965 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.965 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.966 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.966 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.966 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.966 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.966 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.966 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.966 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.966 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.966 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.967 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.967 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.967 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.967 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.967 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.967 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.967 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.967 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.968 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.968 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.968 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.968 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.968 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.969 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.969 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.969 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.969 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.969 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.969 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.969 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.969 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.969 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.970 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.970 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.970 INFO:teuthology.orchestra.run.smithi028.stdout: "organization": { 2024-06-06T08:47:00.970 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "organization", 2024-06-06T08:47:00.970 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.970 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.971 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.971 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.971 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.971 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.971 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.971 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.971 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.972 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.972 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.972 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.972 INFO:teuthology.orchestra.run.smithi028.stdout: "proxy": { 2024-06-06T08:47:00.972 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "proxy", 2024-06-06T08:47:00.972 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.972 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.972 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.973 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.973 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.973 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.973 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.973 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.973 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.974 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.974 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.974 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.974 INFO:teuthology.orchestra.run.smithi028.stdout: "url": { 2024-06-06T08:47:00.974 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "url", 2024-06-06T08:47:00.974 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.974 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.974 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.975 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-06T08:47:00.975 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.975 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.975 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.975 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.975 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.975 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.976 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.976 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.976 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.976 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.976 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.976 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "test_orchestrator", 2024-06-06T08:47:00.976 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.976 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.977 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.977 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.977 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.977 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.977 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.977 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.977 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.977 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.978 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.978 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.978 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.978 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.978 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.978 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.979 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.979 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.979 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.979 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.979 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.979 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.980 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.980 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.980 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.980 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.980 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.980 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.980 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.981 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.981 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.981 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.981 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.981 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.981 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.981 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.981 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.982 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.982 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.982 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.982 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.982 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.982 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.982 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.982 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.983 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.983 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.983 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.983 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.983 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.983 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.983 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.983 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.983 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.984 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.984 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.984 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.984 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.984 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.984 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.984 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.984 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.984 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.985 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.985 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.985 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.985 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.985 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.985 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.985 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.986 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.986 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.986 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.986 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:00.986 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.986 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:00.987 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "volumes", 2024-06-06T08:47:00.987 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:00.987 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:00.987 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:00.987 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:00.987 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:00.987 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.987 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.987 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.988 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:00.988 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.988 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.988 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.988 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.988 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.988 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.989 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.989 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.989 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.989 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.989 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.989 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.989 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.989 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.989 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.990 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:00.990 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:00.990 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.990 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.990 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.990 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.991 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.991 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.991 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.991 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.991 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.991 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.991 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.991 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.991 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:00.992 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:00.992 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:00.992 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.992 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.992 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:00.992 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.992 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.993 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:00.993 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:00.993 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:00.993 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:00.993 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:00.993 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:00.993 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:00.993 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:00.993 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.994 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.994 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.994 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.994 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.994 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:00.994 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:00.994 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.995 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.995 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:00.995 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.995 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.995 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.995 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.995 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:00.995 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.996 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.996 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.996 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.996 INFO:teuthology.orchestra.run.smithi028.stdout: "max_concurrent_clones": { 2024-06-06T08:47:00.996 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "max_concurrent_clones", 2024-06-06T08:47:00.996 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:00.996 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.997 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.997 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "4", 2024-06-06T08:47:00.997 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.997 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.997 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.997 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-06T08:47:00.997 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:00.997 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:00.997 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:00.998 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:00.998 INFO:teuthology.orchestra.run.smithi028.stdout: "periodic_async_work": { 2024-06-06T08:47:00.998 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "periodic_async_work", 2024-06-06T08:47:00.998 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:00.998 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:00.998 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:00.998 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:00.999 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:00.999 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:00.999 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:00.999 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Periodically check for async work", 2024-06-06T08:47:00.999 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.000 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.000 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.000 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.000 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_delay": { 2024-06-06T08:47:01.000 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_delay", 2024-06-06T08:47:01.000 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:01.000 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.000 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:01.001 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "0", 2024-06-06T08:47:01.001 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.001 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.001 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:01.001 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-06T08:47:01.001 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.001 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.001 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.001 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.002 INFO:teuthology.orchestra.run.smithi028.stdout: "snapshot_clone_no_wait": { 2024-06-06T08:47:01.002 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "snapshot_clone_no_wait", 2024-06-06T08:47:01.002 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:01.002 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.002 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:01.002 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "True", 2024-06-06T08:47:01.002 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.003 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.003 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:01.003 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-06T08:47:01.003 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.003 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.003 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.004 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:01.004 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:01.004 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.004 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:01.004 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix", 2024-06-06T08:47:01.004 INFO:teuthology.orchestra.run.smithi028.stdout: "can_run": true, 2024-06-06T08:47:01.004 INFO:teuthology.orchestra.run.smithi028.stdout: "error_string": "", 2024-06-06T08:47:01.004 INFO:teuthology.orchestra.run.smithi028.stdout: "module_options": { 2024-06-06T08:47:01.005 INFO:teuthology.orchestra.run.smithi028.stdout: "discovery_interval": { 2024-06-06T08:47:01.005 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "discovery_interval", 2024-06-06T08:47:01.005 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "uint", 2024-06-06T08:47:01.005 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.005 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:01.005 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "100", 2024-06-06T08:47:01.005 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.006 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.006 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:01.006 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:01.006 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.006 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.006 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.006 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.006 INFO:teuthology.orchestra.run.smithi028.stdout: "identifier": { 2024-06-06T08:47:01.007 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "identifier", 2024-06-06T08:47:01.007 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:01.007 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.007 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:01.007 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:01.007 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.007 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.008 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:01.008 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:01.008 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.008 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.008 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.008 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.008 INFO:teuthology.orchestra.run.smithi028.stdout: "interval": { 2024-06-06T08:47:01.008 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "interval", 2024-06-06T08:47:01.009 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "secs", 2024-06-06T08:47:01.009 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.009 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:01.009 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "60", 2024-06-06T08:47:01.009 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.009 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.009 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:01.010 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:01.010 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.010 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.010 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.010 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.010 INFO:teuthology.orchestra.run.smithi028.stdout: "log_level": { 2024-06-06T08:47:01.010 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_level", 2024-06-06T08:47:01.010 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:01.011 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.011 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:01.011 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:01.011 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.011 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.012 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:01.012 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:01.012 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:01.012 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:01.012 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:01.012 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:01.012 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:01.012 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:01.013 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:01.013 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.013 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.013 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.013 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.013 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster": { 2024-06-06T08:47:01.013 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster", 2024-06-06T08:47:01.014 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:01.014 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.014 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:01.014 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:01.014 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.014 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.014 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:01.014 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:01.015 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.015 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.015 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.015 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.015 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_cluster_level": { 2024-06-06T08:47:01.015 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_cluster_level", 2024-06-06T08:47:01.015 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:01.015 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.016 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:01.016 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "info", 2024-06-06T08:47:01.016 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.016 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.016 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [ 2024-06-06T08:47:01.016 INFO:teuthology.orchestra.run.smithi028.stdout: "", 2024-06-06T08:47:01.016 INFO:teuthology.orchestra.run.smithi028.stdout: "critical", 2024-06-06T08:47:01.016 INFO:teuthology.orchestra.run.smithi028.stdout: "debug", 2024-06-06T08:47:01.017 INFO:teuthology.orchestra.run.smithi028.stdout: "error", 2024-06-06T08:47:01.017 INFO:teuthology.orchestra.run.smithi028.stdout: "info", 2024-06-06T08:47:01.017 INFO:teuthology.orchestra.run.smithi028.stdout: "warning" 2024-06-06T08:47:01.017 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:01.017 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:01.017 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.017 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.017 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.018 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.018 INFO:teuthology.orchestra.run.smithi028.stdout: "log_to_file": { 2024-06-06T08:47:01.018 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "log_to_file", 2024-06-06T08:47:01.018 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "bool", 2024-06-06T08:47:01.018 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.018 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 1, 2024-06-06T08:47:01.018 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "False", 2024-06-06T08:47:01.018 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.019 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.019 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:01.019 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:01.019 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.019 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.019 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.019 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.019 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_host": { 2024-06-06T08:47:01.020 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_host", 2024-06-06T08:47:01.020 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:01.020 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.020 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:01.020 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "", 2024-06-06T08:47:01.020 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.020 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.020 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:01.021 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:01.021 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.021 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.021 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.021 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.021 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_port": { 2024-06-06T08:47:01.021 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_port", 2024-06-06T08:47:01.021 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "int", 2024-06-06T08:47:01.022 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.022 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:01.022 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "10051", 2024-06-06T08:47:01.022 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.022 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.022 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:01.022 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:01.022 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.022 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.023 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.023 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.023 INFO:teuthology.orchestra.run.smithi028.stdout: "zabbix_sender": { 2024-06-06T08:47:01.023 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "zabbix_sender", 2024-06-06T08:47:01.023 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "str", 2024-06-06T08:47:01.023 INFO:teuthology.orchestra.run.smithi028.stdout: "level": "advanced", 2024-06-06T08:47:01.023 INFO:teuthology.orchestra.run.smithi028.stdout: "flags": 0, 2024-06-06T08:47:01.023 INFO:teuthology.orchestra.run.smithi028.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-06T08:47:01.024 INFO:teuthology.orchestra.run.smithi028.stdout: "min": "", 2024-06-06T08:47:01.024 INFO:teuthology.orchestra.run.smithi028.stdout: "max": "", 2024-06-06T08:47:01.024 INFO:teuthology.orchestra.run.smithi028.stdout: "enum_allowed": [], 2024-06-06T08:47:01.024 INFO:teuthology.orchestra.run.smithi028.stdout: "desc": "", 2024-06-06T08:47:01.024 INFO:teuthology.orchestra.run.smithi028.stdout: "long_desc": "", 2024-06-06T08:47:01.024 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-06-06T08:47:01.024 INFO:teuthology.orchestra.run.smithi028.stdout: "see_also": [] 2024-06-06T08:47:01.024 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:01.025 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:01.025 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:01.025 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:01.025 INFO:teuthology.orchestra.run.smithi028.stdout: "services": { 2024-06-06T08:47:01.025 INFO:teuthology.orchestra.run.smithi028.stdout: "dashboard": "https://172.21.15.28:8443/" 2024-06-06T08:47:01.025 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.025 INFO:teuthology.orchestra.run.smithi028.stdout: "always_on_modules": { 2024-06-06T08:47:01.025 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus": [ 2024-06-06T08:47:01.025 INFO:teuthology.orchestra.run.smithi028.stdout: "balancer", 2024-06-06T08:47:01.026 INFO:teuthology.orchestra.run.smithi028.stdout: "crash", 2024-06-06T08:47:01.026 INFO:teuthology.orchestra.run.smithi028.stdout: "devicehealth", 2024-06-06T08:47:01.026 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator", 2024-06-06T08:47:01.026 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_autoscaler", 2024-06-06T08:47:01.026 INFO:teuthology.orchestra.run.smithi028.stdout: "progress", 2024-06-06T08:47:01.026 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_support", 2024-06-06T08:47:01.026 INFO:teuthology.orchestra.run.smithi028.stdout: "status", 2024-06-06T08:47:01.026 INFO:teuthology.orchestra.run.smithi028.stdout: "telemetry", 2024-06-06T08:47:01.027 INFO:teuthology.orchestra.run.smithi028.stdout: "volumes" 2024-06-06T08:47:01.027 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:01.027 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific": [ 2024-06-06T08:47:01.027 INFO:teuthology.orchestra.run.smithi028.stdout: "balancer", 2024-06-06T08:47:01.027 INFO:teuthology.orchestra.run.smithi028.stdout: "crash", 2024-06-06T08:47:01.027 INFO:teuthology.orchestra.run.smithi028.stdout: "devicehealth", 2024-06-06T08:47:01.027 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator", 2024-06-06T08:47:01.027 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_autoscaler", 2024-06-06T08:47:01.028 INFO:teuthology.orchestra.run.smithi028.stdout: "progress", 2024-06-06T08:47:01.028 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_support", 2024-06-06T08:47:01.028 INFO:teuthology.orchestra.run.smithi028.stdout: "status", 2024-06-06T08:47:01.028 INFO:teuthology.orchestra.run.smithi028.stdout: "telemetry", 2024-06-06T08:47:01.028 INFO:teuthology.orchestra.run.smithi028.stdout: "volumes" 2024-06-06T08:47:01.028 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:01.028 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy": [ 2024-06-06T08:47:01.028 INFO:teuthology.orchestra.run.smithi028.stdout: "balancer", 2024-06-06T08:47:01.028 INFO:teuthology.orchestra.run.smithi028.stdout: "crash", 2024-06-06T08:47:01.029 INFO:teuthology.orchestra.run.smithi028.stdout: "devicehealth", 2024-06-06T08:47:01.029 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator", 2024-06-06T08:47:01.029 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_autoscaler", 2024-06-06T08:47:01.029 INFO:teuthology.orchestra.run.smithi028.stdout: "progress", 2024-06-06T08:47:01.029 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_support", 2024-06-06T08:47:01.029 INFO:teuthology.orchestra.run.smithi028.stdout: "status", 2024-06-06T08:47:01.029 INFO:teuthology.orchestra.run.smithi028.stdout: "telemetry", 2024-06-06T08:47:01.029 INFO:teuthology.orchestra.run.smithi028.stdout: "volumes" 2024-06-06T08:47:01.030 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:01.030 INFO:teuthology.orchestra.run.smithi028.stdout: "reef": [ 2024-06-06T08:47:01.030 INFO:teuthology.orchestra.run.smithi028.stdout: "balancer", 2024-06-06T08:47:01.030 INFO:teuthology.orchestra.run.smithi028.stdout: "crash", 2024-06-06T08:47:01.030 INFO:teuthology.orchestra.run.smithi028.stdout: "devicehealth", 2024-06-06T08:47:01.030 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator", 2024-06-06T08:47:01.030 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_autoscaler", 2024-06-06T08:47:01.030 INFO:teuthology.orchestra.run.smithi028.stdout: "progress", 2024-06-06T08:47:01.031 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_support", 2024-06-06T08:47:01.031 INFO:teuthology.orchestra.run.smithi028.stdout: "status", 2024-06-06T08:47:01.031 INFO:teuthology.orchestra.run.smithi028.stdout: "telemetry", 2024-06-06T08:47:01.031 INFO:teuthology.orchestra.run.smithi028.stdout: "volumes" 2024-06-06T08:47:01.031 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-06-06T08:47:01.032 INFO:teuthology.orchestra.run.smithi028.stdout: "squid": [ 2024-06-06T08:47:01.032 INFO:teuthology.orchestra.run.smithi028.stdout: "balancer", 2024-06-06T08:47:01.032 INFO:teuthology.orchestra.run.smithi028.stdout: "crash", 2024-06-06T08:47:01.032 INFO:teuthology.orchestra.run.smithi028.stdout: "devicehealth", 2024-06-06T08:47:01.032 INFO:teuthology.orchestra.run.smithi028.stdout: "orchestrator", 2024-06-06T08:47:01.032 INFO:teuthology.orchestra.run.smithi028.stdout: "pg_autoscaler", 2024-06-06T08:47:01.032 INFO:teuthology.orchestra.run.smithi028.stdout: "progress", 2024-06-06T08:47:01.033 INFO:teuthology.orchestra.run.smithi028.stdout: "rbd_support", 2024-06-06T08:47:01.033 INFO:teuthology.orchestra.run.smithi028.stdout: "status", 2024-06-06T08:47:01.033 INFO:teuthology.orchestra.run.smithi028.stdout: "telemetry", 2024-06-06T08:47:01.033 INFO:teuthology.orchestra.run.smithi028.stdout: "volumes" 2024-06-06T08:47:01.033 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-06-06T08:47:01.033 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.033 INFO:teuthology.orchestra.run.smithi028.stdout: "last_failure_osd_epoch": 3, 2024-06-06T08:47:01.033 INFO:teuthology.orchestra.run.smithi028.stdout: "active_clients": [ 2024-06-06T08:47:01.034 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:01.034 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "devicehealth", 2024-06-06T08:47:01.034 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-06-06T08:47:01.034 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:01.034 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-06-06T08:47:01.034 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:0", 2024-06-06T08:47:01.034 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 4187213908 2024-06-06T08:47:01.034 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:01.035 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-06-06T08:47:01.035 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.035 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:01.035 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "libcephsqlite", 2024-06-06T08:47:01.035 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-06-06T08:47:01.035 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:01.035 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-06-06T08:47:01.035 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:0", 2024-06-06T08:47:01.035 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 1020264644 2024-06-06T08:47:01.036 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:01.036 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-06-06T08:47:01.036 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.036 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:01.036 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "rbd_support", 2024-06-06T08:47:01.036 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-06-06T08:47:01.036 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:01.036 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-06-06T08:47:01.037 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:0", 2024-06-06T08:47:01.037 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 393570134 2024-06-06T08:47:01.037 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:01.037 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-06-06T08:47:01.037 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:01.037 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:01.037 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "volumes", 2024-06-06T08:47:01.037 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-06-06T08:47:01.038 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-06-06T08:47:01.038 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-06-06T08:47:01.038 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:0", 2024-06-06T08:47:01.038 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 2055894821 2024-06-06T08:47:01.038 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:01.038 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-06-06T08:47:01.038 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:01.038 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-06-06T08:47:01.038 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:47:01.040 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:58 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/845312481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T08:47:01.040 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:58 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/4159885130' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-06T08:47:01.040 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:46:59 smithi059 ceph-mon[36684]: pgmap v541: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 297 KiB/s wr, 80 op/s 2024-06-06T08:47:01.041 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:58 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/845312481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T08:47:01.041 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:58 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/4159885130' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-06T08:47:01.041 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:46:59 smithi037 ceph-mon[36609]: pgmap v541: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 297 KiB/s wr, 80 op/s 2024-06-06T08:47:01.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.773+0000 7f910be00640 1 -- 172.21.15.28:0/4159885130 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f90f00a2c00 msgr2=0x7f90f00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:01.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.773+0000 7f910be00640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f90f00a2c00 0x7f90f00a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f90fc011440 tx=0x7f90fc009500 comp rx=0 tx=0).stop 2024-06-06T08:47:01.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.773+0000 7f910be00640 1 -- 172.21.15.28:0/4159885130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f910c104c90 msgr2=0x7f910c19a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:01.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.773+0000 7f910be00640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f910c104c90 0x7f910c19a320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f90f4005fd0 tx=0x7f90f400dde0 comp rx=0 tx=0).stop 2024-06-06T08:47:01.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.773+0000 7f910be00640 1 -- 172.21.15.28:0/4159885130 shutdown_connections 2024-06-06T08:47:01.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.773+0000 7f910be00640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f910c1075c0 0x7f910c1a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:01.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.773+0000 7f910be00640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f90f00a2c00 0x7f90f00a50c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:01.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.774+0000 7f910be00640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f910c104c90 0x7f910c19a320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:01.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.774+0000 7f910be00640 1 --2- 172.21.15.28:0/4159885130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910c102360 0x7f910c199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:01.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.774+0000 7f910be00640 1 -- 172.21.15.28:0/4159885130 >> 172.21.15.28:0/4159885130 conn(0x7f910c0fbd70 msgr2=0x7f910c101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:47:01.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.774+0000 7f910be00640 1 -- 172.21.15.28:0/4159885130 shutdown_connections 2024-06-06T08:47:01.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:46:58.774+0000 7f910be00640 1 -- 172.21.15.28:0/4159885130 wait complete. 2024-06-06T08:47:01.050 DEBUG:tasks.check_counter:Getting stats from a 2024-06-06T08:47:01.050 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.a perf dump 2024-06-06T08:47:01.051 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:58 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/845312481' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T08:47:01.051 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:58 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/4159885130' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-06T08:47:01.051 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:46:59 smithi028 ceph-mon[31564]: pgmap v541: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 297 KiB/s wr, 80 op/s 2024-06-06T08:47:01.541 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:47:01.942 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:01 smithi028 ceph-mon[31564]: pgmap v542: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 292 KiB/s wr, 79 op/s 2024-06-06T08:47:02.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:01 smithi037 ceph-mon[36609]: pgmap v542: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 292 KiB/s wr, 79 op/s 2024-06-06T08:47:02.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:01 smithi059 ceph-mon[36684]: pgmap v542: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 292 KiB/s wr, 79 op/s 2024-06-06T08:47:03.869 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:47:03.869 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:03.869 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 542, 2024-06-06T08:47:03.869 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 531, 2024-06-06T08:47:03.870 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 645840, 2024-06-06T08:47:03.870 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 202836, 2024-06-06T08:47:03.870 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 5, 2024-06-06T08:47:03.870 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 1, 2024-06-06T08:47:03.870 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.133772667, 2024-06-06T08:47:03.870 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.049603137, 2024-06-06T08:47:03.870 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.048433810, 2024-06-06T08:47:03.871 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.027538982, 2024-06-06T08:47:03.871 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:03.871 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 531, 2024-06-06T08:47:03.871 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.051532151, 2024-06-06T08:47:03.871 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000097047 2024-06-06T08:47:03.871 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.871 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:03.871 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.872 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.872 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.872 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.872 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 512112, 2024-06-06T08:47:03.872 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 76272 2024-06-06T08:47:03.872 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.872 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:03.873 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 176, 2024-06-06T08:47:03.873 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 267, 2024-06-06T08:47:03.873 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 43862, 2024-06-06T08:47:03.873 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 286614, 2024-06-06T08:47:03.873 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 5, 2024-06-06T08:47:03.873 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 4, 2024-06-06T08:47:03.873 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.053389867, 2024-06-06T08:47:03.873 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.024069361, 2024-06-06T08:47:03.873 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.012523403, 2024-06-06T08:47:03.873 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.011392798, 2024-06-06T08:47:03.874 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:03.874 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 265, 2024-06-06T08:47:03.874 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.022927369, 2024-06-06T08:47:03.874 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000086518 2024-06-06T08:47:03.874 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.874 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:03.874 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.874 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.875 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.875 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.875 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T08:47:03.875 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 230896 2024-06-06T08:47:03.875 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.875 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:03.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 416, 2024-06-06T08:47:03.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 417, 2024-06-06T08:47:03.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 2803601, 2024-06-06T08:47:03.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 131971, 2024-06-06T08:47:03.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 5, 2024-06-06T08:47:03.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 4, 2024-06-06T08:47:03.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.085553282, 2024-06-06T08:47:03.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.026585312, 2024-06-06T08:47:03.877 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.030706367, 2024-06-06T08:47:03.877 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.020197754, 2024-06-06T08:47:03.877 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:03.877 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 415, 2024-06-06T08:47:03.877 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.034369144, 2024-06-06T08:47:03.877 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000082817 2024-06-06T08:47:03.877 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.877 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:03.877 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.878 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.878 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.878 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.878 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T08:47:03.878 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T08:47:03.878 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.878 INFO:teuthology.orchestra.run.smithi028.stdout: "cct": { 2024-06-06T08:47:03.878 INFO:teuthology.orchestra.run.smithi028.stdout: "total_workers": 1, 2024-06-06T08:47:03.879 INFO:teuthology.orchestra.run.smithi028.stdout: "unhealthy_workers": 0 2024-06-06T08:47:03.879 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.879 INFO:teuthology.orchestra.run.smithi028.stdout: "finisher-MDSRank": { 2024-06-06T08:47:03.879 INFO:teuthology.orchestra.run.smithi028.stdout: "queue_len": 0, 2024-06-06T08:47:03.879 INFO:teuthology.orchestra.run.smithi028.stdout: "complete_latency": { 2024-06-06T08:47:03.879 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 1767, 2024-06-06T08:47:03.879 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.092301985, 2024-06-06T08:47:03.879 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000052236 2024-06-06T08:47:03.879 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:03.880 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.880 INFO:teuthology.orchestra.run.smithi028.stdout: "finisher-PurgeQueue": { 2024-06-06T08:47:03.880 INFO:teuthology.orchestra.run.smithi028.stdout: "queue_len": 0, 2024-06-06T08:47:03.880 INFO:teuthology.orchestra.run.smithi028.stdout: "complete_latency": { 2024-06-06T08:47:03.880 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.880 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.880 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.880 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:03.881 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.881 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": { 2024-06-06T08:47:03.881 INFO:teuthology.orchestra.run.smithi028.stdout: "request": 0, 2024-06-06T08:47:03.881 INFO:teuthology.orchestra.run.smithi028.stdout: "reply": 0, 2024-06-06T08:47:03.881 INFO:teuthology.orchestra.run.smithi028.stdout: "reply_latency": { 2024-06-06T08:47:03.881 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.881 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.881 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.882 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.882 INFO:teuthology.orchestra.run.smithi028.stdout: "slow_reply": 0, 2024-06-06T08:47:03.882 INFO:teuthology.orchestra.run.smithi028.stdout: "forward": 0, 2024-06-06T08:47:03.882 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_fetch_complete": 0, 2024-06-06T08:47:03.882 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_fetch_keys": 0, 2024-06-06T08:47:03.882 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_commit": 0, 2024-06-06T08:47:03.882 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_split": 0, 2024-06-06T08:47:03.882 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_merge": 0, 2024-06-06T08:47:03.883 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes": 1176, 2024-06-06T08:47:03.883 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_top": 1, 2024-06-06T08:47:03.883 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_bottom": 1175, 2024-06-06T08:47:03.883 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_pin_tail": 0, 2024-06-06T08:47:03.883 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_pinned": 1175, 2024-06-06T08:47:03.883 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_expired": 0, 2024-06-06T08:47:03.883 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_with_caps": 0, 2024-06-06T08:47:03.883 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": 0, 2024-06-06T08:47:03.883 INFO:teuthology.orchestra.run.smithi028.stdout: "subtrees": 37, 2024-06-06T08:47:03.884 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse": 0, 2024-06-06T08:47:03.884 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_hit": 0, 2024-06-06T08:47:03.884 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_forward": 0, 2024-06-06T08:47:03.884 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_discover": 0, 2024-06-06T08:47:03.884 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_dir_fetch": 0, 2024-06-06T08:47:03.884 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_remote_ino": 0, 2024-06-06T08:47:03.884 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_lock": 0, 2024-06-06T08:47:03.884 INFO:teuthology.orchestra.run.smithi028.stdout: "load_cent": 0, 2024-06-06T08:47:03.884 INFO:teuthology.orchestra.run.smithi028.stdout: "q": 0, 2024-06-06T08:47:03.885 INFO:teuthology.orchestra.run.smithi028.stdout: "exported": 0, 2024-06-06T08:47:03.885 INFO:teuthology.orchestra.run.smithi028.stdout: "exported_inodes": 0, 2024-06-06T08:47:03.885 INFO:teuthology.orchestra.run.smithi028.stdout: "imported": 0, 2024-06-06T08:47:03.885 INFO:teuthology.orchestra.run.smithi028.stdout: "imported_inodes": 0, 2024-06-06T08:47:03.885 INFO:teuthology.orchestra.run.smithi028.stdout: "openino_dir_fetch": 0, 2024-06-06T08:47:03.885 INFO:teuthology.orchestra.run.smithi028.stdout: "openino_backtrace_fetch": 0, 2024-06-06T08:47:03.885 INFO:teuthology.orchestra.run.smithi028.stdout: "openino_peer_discover": 0, 2024-06-06T08:47:03.885 INFO:teuthology.orchestra.run.smithi028.stdout: "root_rfiles": 0, 2024-06-06T08:47:03.885 INFO:teuthology.orchestra.run.smithi028.stdout: "root_rbytes": 0, 2024-06-06T08:47:03.886 INFO:teuthology.orchestra.run.smithi028.stdout: "root_rsnaps": 0, 2024-06-06T08:47:03.886 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T08:47:03.886 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_set_tag": 0, 2024-06-06T08:47:03.886 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T08:47:03.886 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_inotable_repaired": 0, 2024-06-06T08:47:03.886 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_dir_inodes": 0, 2024-06-06T08:47:03.886 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T08:47:03.887 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T08:47:03.887 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_file_inodes": 0, 2024-06-06T08:47:03.887 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_inode_file_caps": 0, 2024-06-06T08:47:03.887 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T08:47:03.887 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_grant": 0, 2024-06-06T08:47:03.887 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T08:47:03.887 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T08:47:03.887 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T08:47:03.887 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_caps": 0, 2024-06-06T08:47:03.888 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_caps_dirty": 0, 2024-06-06T08:47:03.888 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_cap_release": 0, 2024-06-06T08:47:03.888 INFO:teuthology.orchestra.run.smithi028.stdout: "process_request_cap_release": 0 2024-06-06T08:47:03.888 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.888 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_cache": { 2024-06-06T08:47:03.888 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_update": 0, 2024-06-06T08:47:03.888 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_update_receipt": 0, 2024-06-06T08:47:03.888 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_try_discover": 0, 2024-06-06T08:47:03.889 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_send_discover": 0, 2024-06-06T08:47:03.889 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_handle_discover": 0, 2024-06-06T08:47:03.889 INFO:teuthology.orchestra.run.smithi028.stdout: "num_strays": 0, 2024-06-06T08:47:03.889 INFO:teuthology.orchestra.run.smithi028.stdout: "num_strays_delayed": 0, 2024-06-06T08:47:03.889 INFO:teuthology.orchestra.run.smithi028.stdout: "num_strays_enqueuing": 0, 2024-06-06T08:47:03.889 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_created": 0, 2024-06-06T08:47:03.889 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_enqueued": 0, 2024-06-06T08:47:03.889 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_reintegrated": 0, 2024-06-06T08:47:03.890 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_migrated": 0, 2024-06-06T08:47:03.890 INFO:teuthology.orchestra.run.smithi028.stdout: "num_recovering_processing": 0, 2024-06-06T08:47:03.890 INFO:teuthology.orchestra.run.smithi028.stdout: "num_recovering_enqueued": 0, 2024-06-06T08:47:03.890 INFO:teuthology.orchestra.run.smithi028.stdout: "num_recovering_prioritized": 0, 2024-06-06T08:47:03.890 INFO:teuthology.orchestra.run.smithi028.stdout: "recovery_started": 0, 2024-06-06T08:47:03.890 INFO:teuthology.orchestra.run.smithi028.stdout: "recovery_completed": 0, 2024-06-06T08:47:03.890 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_quiesce_path": 0, 2024-06-06T08:47:03.890 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_quiesce_inode": 0, 2024-06-06T08:47:03.891 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T08:47:03.891 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_exportdir": 0, 2024-06-06T08:47:03.891 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_flush": 0, 2024-06-06T08:47:03.891 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_fragmentdir": 0, 2024-06-06T08:47:03.891 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_fragstats": 0, 2024-06-06T08:47:03.891 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_inodestats": 0 2024-06-06T08:47:03.891 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.891 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_log": { 2024-06-06T08:47:03.892 INFO:teuthology.orchestra.run.smithi028.stdout: "evlrg": 0, 2024-06-06T08:47:03.892 INFO:teuthology.orchestra.run.smithi028.stdout: "evadd": 0, 2024-06-06T08:47:03.892 INFO:teuthology.orchestra.run.smithi028.stdout: "evex": 0, 2024-06-06T08:47:03.892 INFO:teuthology.orchestra.run.smithi028.stdout: "evtrm": 0, 2024-06-06T08:47:03.892 INFO:teuthology.orchestra.run.smithi028.stdout: "ev": 1652, 2024-06-06T08:47:03.892 INFO:teuthology.orchestra.run.smithi028.stdout: "evexg": 0, 2024-06-06T08:47:03.892 INFO:teuthology.orchestra.run.smithi028.stdout: "evexd": 0, 2024-06-06T08:47:03.892 INFO:teuthology.orchestra.run.smithi028.stdout: "segadd": 0, 2024-06-06T08:47:03.893 INFO:teuthology.orchestra.run.smithi028.stdout: "segex": 0, 2024-06-06T08:47:03.893 INFO:teuthology.orchestra.run.smithi028.stdout: "segtrm": 0, 2024-06-06T08:47:03.893 INFO:teuthology.orchestra.run.smithi028.stdout: "seg": 3, 2024-06-06T08:47:03.893 INFO:teuthology.orchestra.run.smithi028.stdout: "segmjr": 2, 2024-06-06T08:47:03.893 INFO:teuthology.orchestra.run.smithi028.stdout: "segexg": 0, 2024-06-06T08:47:03.893 INFO:teuthology.orchestra.run.smithi028.stdout: "segexd": 0, 2024-06-06T08:47:03.893 INFO:teuthology.orchestra.run.smithi028.stdout: "expos": 4194304, 2024-06-06T08:47:03.893 INFO:teuthology.orchestra.run.smithi028.stdout: "wrpos": 6888980, 2024-06-06T08:47:03.893 INFO:teuthology.orchestra.run.smithi028.stdout: "rdpos": 6888406, 2024-06-06T08:47:03.894 INFO:teuthology.orchestra.run.smithi028.stdout: "jlat": { 2024-06-06T08:47:03.894 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.894 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.894 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.894 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.894 INFO:teuthology.orchestra.run.smithi028.stdout: "replayed": 1652 2024-06-06T08:47:03.894 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.895 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_mem": { 2024-06-06T08:47:03.895 INFO:teuthology.orchestra.run.smithi028.stdout: "ino": 706, 2024-06-06T08:47:03.895 INFO:teuthology.orchestra.run.smithi028.stdout: "ino+": 961, 2024-06-06T08:47:03.895 INFO:teuthology.orchestra.run.smithi028.stdout: "ino-": 255, 2024-06-06T08:47:03.895 INFO:teuthology.orchestra.run.smithi028.stdout: "dir": 48, 2024-06-06T08:47:03.895 INFO:teuthology.orchestra.run.smithi028.stdout: "dir+": 48, 2024-06-06T08:47:03.895 INFO:teuthology.orchestra.run.smithi028.stdout: "dir-": 0, 2024-06-06T08:47:03.895 INFO:teuthology.orchestra.run.smithi028.stdout: "dn": 1176, 2024-06-06T08:47:03.896 INFO:teuthology.orchestra.run.smithi028.stdout: "dn+": 1176, 2024-06-06T08:47:03.896 INFO:teuthology.orchestra.run.smithi028.stdout: "dn-": 0, 2024-06-06T08:47:03.896 INFO:teuthology.orchestra.run.smithi028.stdout: "cap": 0, 2024-06-06T08:47:03.896 INFO:teuthology.orchestra.run.smithi028.stdout: "cap+": 0, 2024-06-06T08:47:03.896 INFO:teuthology.orchestra.run.smithi028.stdout: "cap-": 0, 2024-06-06T08:47:03.896 INFO:teuthology.orchestra.run.smithi028.stdout: "rss": 53088, 2024-06-06T08:47:03.896 INFO:teuthology.orchestra.run.smithi028.stdout: "heap": 215420 2024-06-06T08:47:03.896 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.896 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_server": { 2024-06-06T08:47:03.897 INFO:teuthology.orchestra.run.smithi028.stdout: "dispatch_client_request": 0, 2024-06-06T08:47:03.897 INFO:teuthology.orchestra.run.smithi028.stdout: "dispatch_server_request": 0, 2024-06-06T08:47:03.897 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_request": 0, 2024-06-06T08:47:03.897 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_session": 0, 2024-06-06T08:47:03.897 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_peer_request": 0, 2024-06-06T08:47:03.897 INFO:teuthology.orchestra.run.smithi028.stdout: "req_create_latency": { 2024-06-06T08:47:03.897 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.897 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.898 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.898 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.898 INFO:teuthology.orchestra.run.smithi028.stdout: "req_getattr_latency": { 2024-06-06T08:47:03.898 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.898 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.898 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.898 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.898 INFO:teuthology.orchestra.run.smithi028.stdout: "req_getfilelock_latency": { 2024-06-06T08:47:03.899 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.899 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.899 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.899 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.899 INFO:teuthology.orchestra.run.smithi028.stdout: "req_link_latency": { 2024-06-06T08:47:03.899 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.899 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.900 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.900 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookup_latency": { 2024-06-06T08:47:03.900 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.900 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.900 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.900 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookuphash_latency": { 2024-06-06T08:47:03.901 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.901 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.901 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.901 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.901 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupino_latency": { 2024-06-06T08:47:03.901 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.901 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.902 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.902 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.902 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupname_latency": { 2024-06-06T08:47:03.902 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.902 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.902 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.902 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.903 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupparent_latency": { 2024-06-06T08:47:03.903 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.903 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.903 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.903 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.903 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupsnap_latency": { 2024-06-06T08:47:03.903 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.904 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.904 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.904 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.904 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lssnap_latency": { 2024-06-06T08:47:03.904 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.904 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.904 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.904 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.905 INFO:teuthology.orchestra.run.smithi028.stdout: "req_mkdir_latency": { 2024-06-06T08:47:03.905 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.906 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.906 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.906 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.906 INFO:teuthology.orchestra.run.smithi028.stdout: "req_mknod_latency": { 2024-06-06T08:47:03.906 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.906 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.906 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.907 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.907 INFO:teuthology.orchestra.run.smithi028.stdout: "req_mksnap_latency": { 2024-06-06T08:47:03.907 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.907 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.907 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.907 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.907 INFO:teuthology.orchestra.run.smithi028.stdout: "req_open_latency": { 2024-06-06T08:47:03.907 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.908 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.908 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.908 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.908 INFO:teuthology.orchestra.run.smithi028.stdout: "req_readdir_latency": { 2024-06-06T08:47:03.908 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.908 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.908 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.908 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.909 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rename_latency": { 2024-06-06T08:47:03.909 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.909 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.909 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.909 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.909 INFO:teuthology.orchestra.run.smithi028.stdout: "req_renamesnap_latency": { 2024-06-06T08:47:03.909 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.909 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.910 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.910 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.910 INFO:teuthology.orchestra.run.smithi028.stdout: "req_snapdiff_latency": { 2024-06-06T08:47:03.910 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.910 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.910 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.910 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.910 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rmdir_latency": { 2024-06-06T08:47:03.911 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.911 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.911 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.911 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.911 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rmsnap_latency": { 2024-06-06T08:47:03.911 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.911 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.911 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.912 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.912 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rmxattr_latency": { 2024-06-06T08:47:03.912 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.912 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.912 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.912 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.912 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setattr_latency": { 2024-06-06T08:47:03.913 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.913 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.913 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.913 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.913 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setdirlayout_latency": { 2024-06-06T08:47:03.913 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.913 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.914 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.914 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.914 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setfilelock_latency": { 2024-06-06T08:47:03.914 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.914 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.914 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.915 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.915 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setlayout_latency": { 2024-06-06T08:47:03.915 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.915 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.915 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.915 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.915 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setxattr_latency": { 2024-06-06T08:47:03.915 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.916 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.916 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.916 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.916 INFO:teuthology.orchestra.run.smithi028.stdout: "req_symlink_latency": { 2024-06-06T08:47:03.916 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.916 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.916 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.917 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.917 INFO:teuthology.orchestra.run.smithi028.stdout: "req_unlink_latency": { 2024-06-06T08:47:03.917 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.917 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.917 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.917 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.917 INFO:teuthology.orchestra.run.smithi028.stdout: "cap_revoke_eviction": 0, 2024-06-06T08:47:03.917 INFO:teuthology.orchestra.run.smithi028.stdout: "cap_acquisition_throttle": 0, 2024-06-06T08:47:03.918 INFO:teuthology.orchestra.run.smithi028.stdout: "req_getvxattr_latency": { 2024-06-06T08:47:03.918 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.918 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.918 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.918 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:03.918 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.918 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_sessions": { 2024-06-06T08:47:03.919 INFO:teuthology.orchestra.run.smithi028.stdout: "session_count": 1, 2024-06-06T08:47:03.919 INFO:teuthology.orchestra.run.smithi028.stdout: "session_add": 1, 2024-06-06T08:47:03.919 INFO:teuthology.orchestra.run.smithi028.stdout: "session_remove": 0, 2024-06-06T08:47:03.919 INFO:teuthology.orchestra.run.smithi028.stdout: "sessions_open": 1, 2024-06-06T08:47:03.919 INFO:teuthology.orchestra.run.smithi028.stdout: "sessions_stale": 0, 2024-06-06T08:47:03.919 INFO:teuthology.orchestra.run.smithi028.stdout: "total_load": 0, 2024-06-06T08:47:03.919 INFO:teuthology.orchestra.run.smithi028.stdout: "average_load": 0, 2024-06-06T08:47:03.920 INFO:teuthology.orchestra.run.smithi028.stdout: "avg_session_uptime": 1570, 2024-06-06T08:47:03.920 INFO:teuthology.orchestra.run.smithi028.stdout: "mdthresh_evicted": 0 2024-06-06T08:47:03.920 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.920 INFO:teuthology.orchestra.run.smithi028.stdout: "mempool": { 2024-06-06T08:47:03.920 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:03.920 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:03.920 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:03.921 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:03.921 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:03.921 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:03.921 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:03.921 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:03.921 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:03.921 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:03.921 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:03.922 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:03.922 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:03.922 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:03.922 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:03.922 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:03.922 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:03.922 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:03.923 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:03.923 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:03.923 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:03.923 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:03.923 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:03.924 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:03.924 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:03.924 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:03.924 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:03.924 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:03.924 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:03.924 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:03.924 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:03.925 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_items": 0, 2024-06-06T08:47:03.925 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:03.925 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:03.925 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:03.925 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:03.925 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_bytes": 224156, 2024-06-06T08:47:03.925 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_items": 751, 2024-06-06T08:47:03.926 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_bytes": 0, 2024-06-06T08:47:03.926 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_items": 0, 2024-06-06T08:47:03.926 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_bytes": 0, 2024-06-06T08:47:03.926 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_items": 0, 2024-06-06T08:47:03.926 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:03.926 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:03.926 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:03.927 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:03.927 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_bytes": 8016, 2024-06-06T08:47:03.927 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_items": 169, 2024-06-06T08:47:03.927 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:03.927 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:03.927 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:03.927 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_items": 0, 2024-06-06T08:47:03.928 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_bytes": 2495224, 2024-06-06T08:47:03.928 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_items": 21052, 2024-06-06T08:47:03.928 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:03.928 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_items": 0, 2024-06-06T08:47:03.928 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:03.928 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_items": 0 2024-06-06T08:47:03.928 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.928 INFO:teuthology.orchestra.run.smithi028.stdout: "objecter": { 2024-06-06T08:47:03.929 INFO:teuthology.orchestra.run.smithi028.stdout: "op_active": 0, 2024-06-06T08:47:03.929 INFO:teuthology.orchestra.run.smithi028.stdout: "op_laggy": 0, 2024-06-06T08:47:03.929 INFO:teuthology.orchestra.run.smithi028.stdout: "op_send": 988, 2024-06-06T08:47:03.929 INFO:teuthology.orchestra.run.smithi028.stdout: "op_send_bytes": 21, 2024-06-06T08:47:03.929 INFO:teuthology.orchestra.run.smithi028.stdout: "op_resend": 3, 2024-06-06T08:47:03.930 INFO:teuthology.orchestra.run.smithi028.stdout: "op_reply": 988, 2024-06-06T08:47:03.930 INFO:teuthology.orchestra.run.smithi028.stdout: "op_latency": { 2024-06-06T08:47:03.930 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 988, 2024-06-06T08:47:03.930 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.757979199, 2024-06-06T08:47:03.930 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000767185 2024-06-06T08:47:03.930 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.930 INFO:teuthology.orchestra.run.smithi028.stdout: "op_inflight": 0, 2024-06-06T08:47:03.931 INFO:teuthology.orchestra.run.smithi028.stdout: "oplen_avg": { 2024-06-06T08:47:03.931 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 988, 2024-06-06T08:47:03.931 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 989 2024-06-06T08:47:03.931 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.931 INFO:teuthology.orchestra.run.smithi028.stdout: "op": 988, 2024-06-06T08:47:03.931 INFO:teuthology.orchestra.run.smithi028.stdout: "op_r": 988, 2024-06-06T08:47:03.931 INFO:teuthology.orchestra.run.smithi028.stdout: "op_w": 0, 2024-06-06T08:47:03.931 INFO:teuthology.orchestra.run.smithi028.stdout: "op_rmw": 0, 2024-06-06T08:47:03.932 INFO:teuthology.orchestra.run.smithi028.stdout: "op_pg": 0, 2024-06-06T08:47:03.932 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_stat": 570, 2024-06-06T08:47:03.932 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_create": 0, 2024-06-06T08:47:03.932 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_read": 416, 2024-06-06T08:47:03.932 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_write": 0, 2024-06-06T08:47:03.932 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_writefull": 0, 2024-06-06T08:47:03.932 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_writesame": 0, 2024-06-06T08:47:03.933 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_append": 0, 2024-06-06T08:47:03.933 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_zero": 0, 2024-06-06T08:47:03.933 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_truncate": 0, 2024-06-06T08:47:03.933 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_delete": 0, 2024-06-06T08:47:03.933 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_mapext": 0, 2024-06-06T08:47:03.933 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_sparse_read": 0, 2024-06-06T08:47:03.933 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_clonerange": 0, 2024-06-06T08:47:03.933 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_getxattr": 1, 2024-06-06T08:47:03.934 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_setxattr": 0, 2024-06-06T08:47:03.934 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_cmpxattr": 0, 2024-06-06T08:47:03.934 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_rmxattr": 0, 2024-06-06T08:47:03.934 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_resetxattrs": 0, 2024-06-06T08:47:03.934 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_call": 0, 2024-06-06T08:47:03.934 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_watch": 0, 2024-06-06T08:47:03.934 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_notify": 0, 2024-06-06T08:47:03.935 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T08:47:03.935 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_pgls": 0, 2024-06-06T08:47:03.935 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_pgls_filter": 0, 2024-06-06T08:47:03.935 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_other": 0, 2024-06-06T08:47:03.935 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_active": 0, 2024-06-06T08:47:03.935 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_send": 0, 2024-06-06T08:47:03.935 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_resend": 0, 2024-06-06T08:47:03.936 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_ping": 0, 2024-06-06T08:47:03.936 INFO:teuthology.orchestra.run.smithi028.stdout: "poolop_active": 0, 2024-06-06T08:47:03.936 INFO:teuthology.orchestra.run.smithi028.stdout: "poolop_send": 0, 2024-06-06T08:47:03.936 INFO:teuthology.orchestra.run.smithi028.stdout: "poolop_resend": 0, 2024-06-06T08:47:03.936 INFO:teuthology.orchestra.run.smithi028.stdout: "poolstat_active": 0, 2024-06-06T08:47:03.936 INFO:teuthology.orchestra.run.smithi028.stdout: "poolstat_send": 0, 2024-06-06T08:47:03.936 INFO:teuthology.orchestra.run.smithi028.stdout: "poolstat_resend": 0, 2024-06-06T08:47:03.937 INFO:teuthology.orchestra.run.smithi028.stdout: "statfs_active": 0, 2024-06-06T08:47:03.937 INFO:teuthology.orchestra.run.smithi028.stdout: "statfs_send": 0, 2024-06-06T08:47:03.937 INFO:teuthology.orchestra.run.smithi028.stdout: "statfs_resend": 0, 2024-06-06T08:47:03.937 INFO:teuthology.orchestra.run.smithi028.stdout: "command_active": 0, 2024-06-06T08:47:03.937 INFO:teuthology.orchestra.run.smithi028.stdout: "command_send": 0, 2024-06-06T08:47:03.937 INFO:teuthology.orchestra.run.smithi028.stdout: "command_resend": 0, 2024-06-06T08:47:03.937 INFO:teuthology.orchestra.run.smithi028.stdout: "map_epoch": 92, 2024-06-06T08:47:03.938 INFO:teuthology.orchestra.run.smithi028.stdout: "map_full": 0, 2024-06-06T08:47:03.938 INFO:teuthology.orchestra.run.smithi028.stdout: "map_inc": 4, 2024-06-06T08:47:03.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_sessions": 6, 2024-06-06T08:47:03.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_session_open": 6, 2024-06-06T08:47:03.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_session_close": 0, 2024-06-06T08:47:03.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_laggy": 0, 2024-06-06T08:47:03.939 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_wr": 0, 2024-06-06T08:47:03.939 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_rd": 2, 2024-06-06T08:47:03.939 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_del": 0 2024-06-06T08:47:03.939 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.939 INFO:teuthology.orchestra.run.smithi028.stdout: "oft": { 2024-06-06T08:47:03.939 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_objs": 0, 2024-06-06T08:47:03.939 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_kv_pairs": 0, 2024-06-06T08:47:03.939 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_updates": 0, 2024-06-06T08:47:03.939 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_removes": 0 2024-06-06T08:47:03.940 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.940 INFO:teuthology.orchestra.run.smithi028.stdout: "osd-slow-ops": { 2024-06-06T08:47:03.940 INFO:teuthology.orchestra.run.smithi028.stdout: "slow_ops_count": 0 2024-06-06T08:47:03.940 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.940 INFO:teuthology.orchestra.run.smithi028.stdout: "purge_queue": { 2024-06-06T08:47:03.940 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing_ops": 0, 2024-06-06T08:47:03.940 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T08:47:03.940 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing": 0, 2024-06-06T08:47:03.940 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing_high_water": 0, 2024-06-06T08:47:03.941 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executed_ops": 0, 2024-06-06T08:47:03.941 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executed": 0, 2024-06-06T08:47:03.941 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_item_in_journal": 0 2024-06-06T08:47:03.941 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.941 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:03.941 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:03.941 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 104857600, 2024-06-06T08:47:03.941 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:03.941 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 1130, 2024-06-06T08:47:03.942 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 3381463, 2024-06-06T08:47:03.942 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:03.942 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 1130, 2024-06-06T08:47:03.942 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-06-06T08:47:03.942 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-06-06T08:47:03.942 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 1130, 2024-06-06T08:47:03.942 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 3381463, 2024-06-06T08:47:03.943 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:03.943 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.943 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.943 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.943 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:03.943 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.943 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-objecter_bytes": { 2024-06-06T08:47:03.943 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:03.944 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 104857600, 2024-06-06T08:47:03.944 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:03.944 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 0, 2024-06-06T08:47:03.944 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 0, 2024-06-06T08:47:03.944 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:03.944 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:03.944 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 988, 2024-06-06T08:47:03.945 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 2694681, 2024-06-06T08:47:03.945 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 988, 2024-06-06T08:47:03.945 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 2694681, 2024-06-06T08:47:03.945 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:03.945 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.945 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.945 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.945 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:03.946 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.946 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-objecter_ops": { 2024-06-06T08:47:03.946 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:03.946 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 1024, 2024-06-06T08:47:03.946 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:03.946 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 0, 2024-06-06T08:47:03.946 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 0, 2024-06-06T08:47:03.947 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:03.947 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:03.947 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 988, 2024-06-06T08:47:03.947 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 988, 2024-06-06T08:47:03.947 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 988, 2024-06-06T08:47:03.947 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 988, 2024-06-06T08:47:03.947 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:03.947 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.947 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.948 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.948 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:03.948 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.948 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-write_buf_throttle": { 2024-06-06T08:47:03.948 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:03.948 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 3758096384, 2024-06-06T08:47:03.949 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:03.949 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 0, 2024-06-06T08:47:03.949 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 0, 2024-06-06T08:47:03.949 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:03.949 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:03.949 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-06-06T08:47:03.949 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-06-06T08:47:03.949 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 0, 2024-06-06T08:47:03.950 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 0, 2024-06-06T08:47:03.950 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:03.950 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.950 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.950 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.950 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:03.950 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:03.951 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-write_buf_throttle-0x56131f342780": { 2024-06-06T08:47:03.951 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:03.951 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 3758096384, 2024-06-06T08:47:03.951 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:03.951 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 0, 2024-06-06T08:47:03.951 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 0, 2024-06-06T08:47:03.951 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:03.951 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:03.952 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-06-06T08:47:03.952 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-06-06T08:47:03.952 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 0, 2024-06-06T08:47:03.952 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 0, 2024-06-06T08:47:03.952 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:03.952 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:03.952 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:03.953 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:03.953 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:03.953 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:03.953 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:47:04.257 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:03 smithi028 ceph-mon[31564]: pgmap v543: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 303 KiB/s wr, 68 op/s 2024-06-06T08:47:04.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:03 smithi037 ceph-mon[36609]: pgmap v543: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 303 KiB/s wr, 68 op/s 2024-06-06T08:47:04.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:03 smithi059 ceph-mon[36684]: pgmap v543: 97 pgs: 97 active+clean; 71 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 303 KiB/s wr, 68 op/s 2024-06-06T08:47:04.958 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-06-06T08:47:04.959 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-06-06T08:47:04.959 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-06-06T08:47:04.959 DEBUG:tasks.check_counter:Getting stats from d 2024-06-06T08:47:04.959 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.d perf dump 2024-06-06T08:47:05.425 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:47:06.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:05 smithi028 ceph-mon[31564]: pgmap v544: 97 pgs: 97 active+clean; 72 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 243 KiB/s wr, 41 op/s 2024-06-06T08:47:06.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:05 smithi037 ceph-mon[36609]: pgmap v544: 97 pgs: 97 active+clean; 72 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 243 KiB/s wr, 41 op/s 2024-06-06T08:47:06.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:05 smithi059 ceph-mon[36684]: pgmap v544: 97 pgs: 97 active+clean; 72 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 243 KiB/s wr, 41 op/s 2024-06-06T08:47:07.820 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:47:07.820 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:07.820 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 4, 2024-06-06T08:47:07.820 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 4, 2024-06-06T08:47:07.820 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 2992, 2024-06-06T08:47:07.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 448, 2024-06-06T08:47:07.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 4, 2024-06-06T08:47:07.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 0, 2024-06-06T08:47:07.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.004439710, 2024-06-06T08:47:07.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.000065388, 2024-06-06T08:47:07.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.001316128, 2024-06-06T08:47:07.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T08:47:07.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:07.822 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 3, 2024-06-06T08:47:07.822 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.001474174, 2024-06-06T08:47:07.822 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000491391 2024-06-06T08:47:07.822 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:07.822 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:07.822 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:07.822 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:07.822 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:07.823 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:07.823 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-06T08:47:07.823 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 448 2024-06-06T08:47:07.823 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:07.823 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:07.823 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 132, 2024-06-06T08:47:07.823 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 129, 2024-06-06T08:47:07.823 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 453104, 2024-06-06T08:47:07.823 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 78752, 2024-06-06T08:47:07.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 2, 2024-06-06T08:47:07.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 1, 2024-06-06T08:47:07.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.048357050, 2024-06-06T08:47:07.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.019750133, 2024-06-06T08:47:07.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.027418748, 2024-06-06T08:47:07.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.005285203, 2024-06-06T08:47:07.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:07.824 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 128, 2024-06-06T08:47:07.825 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.012177015, 2024-06-06T08:47:07.825 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000095132 2024-06-06T08:47:07.825 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:07.825 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:07.825 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:07.825 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:07.825 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:07.825 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:07.826 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 453104, 2024-06-06T08:47:07.826 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 78752 2024-06-06T08:47:07.826 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:07.826 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:07.826 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 1, 2024-06-06T08:47:07.826 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 98, 2024-06-06T08:47:07.826 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 160, 2024-06-06T08:47:07.826 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 95008, 2024-06-06T08:47:07.827 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 3, 2024-06-06T08:47:07.827 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 2, 2024-06-06T08:47:07.827 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.018558882, 2024-06-06T08:47:07.827 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.013938792, 2024-06-06T08:47:07.827 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.002239577, 2024-06-06T08:47:07.827 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T08:47:07.827 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:07.827 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 96, 2024-06-06T08:47:07.827 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.009793724, 2024-06-06T08:47:07.828 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000102017 2024-06-06T08:47:07.828 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:07.828 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:07.828 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:07.828 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:07.828 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:07.828 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:07.828 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T08:47:07.829 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 95008 2024-06-06T08:47:07.829 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:07.829 INFO:teuthology.orchestra.run.smithi028.stdout: "cct": { 2024-06-06T08:47:07.829 INFO:teuthology.orchestra.run.smithi028.stdout: "total_workers": 0, 2024-06-06T08:47:07.829 INFO:teuthology.orchestra.run.smithi028.stdout: "unhealthy_workers": 0 2024-06-06T08:47:07.829 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:07.829 INFO:teuthology.orchestra.run.smithi028.stdout: "mempool": { 2024-06-06T08:47:07.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:07.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:07.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:07.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:07.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:07.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:07.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:07.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:07.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:07.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:07.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:07.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:07.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:07.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:07.832 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:07.832 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:07.832 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:07.832 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:07.832 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:07.832 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:07.832 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:07.832 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:07.833 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:07.833 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:07.833 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:07.833 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:07.833 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:07.833 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:07.833 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:07.833 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:07.834 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:07.834 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_items": 0, 2024-06-06T08:47:07.834 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:07.834 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:07.834 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:07.834 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:07.834 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_bytes": 148823, 2024-06-06T08:47:07.834 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_items": 27, 2024-06-06T08:47:07.835 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_bytes": 0, 2024-06-06T08:47:07.835 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_items": 0, 2024-06-06T08:47:07.835 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_bytes": 0, 2024-06-06T08:47:07.835 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_items": 0, 2024-06-06T08:47:07.835 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:07.835 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:07.835 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:07.835 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:07.836 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_bytes": 0, 2024-06-06T08:47:07.836 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_items": 0, 2024-06-06T08:47:07.836 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:07.836 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:07.836 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:07.836 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_items": 0, 2024-06-06T08:47:07.836 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_bytes": 928, 2024-06-06T08:47:07.837 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_items": 2, 2024-06-06T08:47:07.837 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:07.837 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_items": 0, 2024-06-06T08:47:07.837 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:07.837 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_items": 0 2024-06-06T08:47:07.837 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:07.837 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:07.837 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:07.838 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 104857600, 2024-06-06T08:47:07.838 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:07.838 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 133, 2024-06-06T08:47:07.838 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 434473, 2024-06-06T08:47:07.838 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:07.838 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 133, 2024-06-06T08:47:07.838 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-06-06T08:47:07.838 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-06-06T08:47:07.839 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 133, 2024-06-06T08:47:07.839 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 434473, 2024-06-06T08:47:07.839 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:07.839 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:07.839 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:07.839 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:07.839 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:07.839 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:07.840 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:47:08.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:07 smithi028 ceph-mon[31564]: pgmap v545: 97 pgs: 97 active+clean; 72 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 95 KiB/s wr, 20 op/s 2024-06-06T08:47:08.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:07 smithi037 ceph-mon[36609]: pgmap v545: 97 pgs: 97 active+clean; 72 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 95 KiB/s wr, 20 op/s 2024-06-06T08:47:08.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:07 smithi059 ceph-mon[36684]: pgmap v545: 97 pgs: 97 active+clean; 72 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 95 KiB/s wr, 20 op/s 2024-06-06T08:47:09.056 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-06-06T08:47:09.056 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-06-06T08:47:09.057 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-06-06T08:47:09.057 DEBUG:tasks.check_counter:Getting stats from g 2024-06-06T08:47:09.057 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.g perf dump 2024-06-06T08:47:09.541 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:47:10.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:09 smithi028 ceph-mon[31564]: pgmap v546: 97 pgs: 97 active+clean; 72 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 87 KiB/s wr, 17 op/s 2024-06-06T08:47:10.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:09 smithi037 ceph-mon[36609]: pgmap v546: 97 pgs: 97 active+clean; 72 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 87 KiB/s wr, 17 op/s 2024-06-06T08:47:10.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:09 smithi059 ceph-mon[36684]: pgmap v546: 97 pgs: 97 active+clean; 72 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 87 KiB/s wr, 17 op/s 2024-06-06T08:47:11.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:10 smithi028 ceph-mon[31564]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:47:11.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:10 smithi037 ceph-mon[36609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:47:11.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:10 smithi059 ceph-mon[36684]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:47:11.876 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:47:11.876 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:11.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 550, 2024-06-06T08:47:11.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 539, 2024-06-06T08:47:11.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 653178, 2024-06-06T08:47:11.876 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 206518, 2024-06-06T08:47:11.877 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 5, 2024-06-06T08:47:11.877 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 1, 2024-06-06T08:47:11.877 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.144599705, 2024-06-06T08:47:11.877 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.060313314, 2024-06-06T08:47:11.877 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.051056855, 2024-06-06T08:47:11.877 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.026491758, 2024-06-06T08:47:11.877 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:11.877 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 538, 2024-06-06T08:47:11.878 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.049792211, 2024-06-06T08:47:11.878 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000092550 2024-06-06T08:47:11.878 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.878 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:11.878 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.878 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.878 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.878 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.879 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 516688, 2024-06-06T08:47:11.879 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 77728 2024-06-06T08:47:11.879 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.879 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:11.879 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 472, 2024-06-06T08:47:11.879 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 566, 2024-06-06T08:47:11.879 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 2227295, 2024-06-06T08:47:11.879 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 384491, 2024-06-06T08:47:11.879 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 5, 2024-06-06T08:47:11.880 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 4, 2024-06-06T08:47:11.880 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.106749315, 2024-06-06T08:47:11.880 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.041639523, 2024-06-06T08:47:11.880 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.031237317, 2024-06-06T08:47:11.880 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.022849128, 2024-06-06T08:47:11.880 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:11.880 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 564, 2024-06-06T08:47:11.881 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.047599079, 2024-06-06T08:47:11.881 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000084395 2024-06-06T08:47:11.881 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.881 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:11.881 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.881 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.881 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.881 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.881 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T08:47:11.882 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 234656 2024-06-06T08:47:11.882 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.882 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:11.882 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 8, 2024-06-06T08:47:11.882 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 8, 2024-06-06T08:47:11.882 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 4621, 2024-06-06T08:47:11.882 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 1732, 2024-06-06T08:47:11.882 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 5, 2024-06-06T08:47:11.883 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 4, 2024-06-06T08:47:11.883 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.003894163, 2024-06-06T08:47:11.883 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.000201800, 2024-06-06T08:47:11.883 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.003420706, 2024-06-06T08:47:11.883 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000146812, 2024-06-06T08:47:11.883 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:11.883 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 7, 2024-06-06T08:47:11.883 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.007031413, 2024-06-06T08:47:11.884 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.001004487 2024-06-06T08:47:11.884 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.884 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:11.884 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.884 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.884 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.885 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.885 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-06T08:47:11.885 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 448 2024-06-06T08:47:11.885 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.885 INFO:teuthology.orchestra.run.smithi028.stdout: "cct": { 2024-06-06T08:47:11.885 INFO:teuthology.orchestra.run.smithi028.stdout: "total_workers": 1, 2024-06-06T08:47:11.885 INFO:teuthology.orchestra.run.smithi028.stdout: "unhealthy_workers": 0 2024-06-06T08:47:11.885 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.886 INFO:teuthology.orchestra.run.smithi028.stdout: "finisher-MDSRank": { 2024-06-06T08:47:11.886 INFO:teuthology.orchestra.run.smithi028.stdout: "queue_len": 0, 2024-06-06T08:47:11.886 INFO:teuthology.orchestra.run.smithi028.stdout: "complete_latency": { 2024-06-06T08:47:11.886 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 1696, 2024-06-06T08:47:11.886 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.081569587, 2024-06-06T08:47:11.886 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000048095 2024-06-06T08:47:11.886 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:11.887 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.887 INFO:teuthology.orchestra.run.smithi028.stdout: "finisher-PurgeQueue": { 2024-06-06T08:47:11.887 INFO:teuthology.orchestra.run.smithi028.stdout: "queue_len": 0, 2024-06-06T08:47:11.887 INFO:teuthology.orchestra.run.smithi028.stdout: "complete_latency": { 2024-06-06T08:47:11.887 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.887 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.887 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.887 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:11.887 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.888 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": { 2024-06-06T08:47:11.888 INFO:teuthology.orchestra.run.smithi028.stdout: "request": 0, 2024-06-06T08:47:11.888 INFO:teuthology.orchestra.run.smithi028.stdout: "reply": 0, 2024-06-06T08:47:11.888 INFO:teuthology.orchestra.run.smithi028.stdout: "reply_latency": { 2024-06-06T08:47:11.888 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.888 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.888 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.889 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.889 INFO:teuthology.orchestra.run.smithi028.stdout: "slow_reply": 0, 2024-06-06T08:47:11.889 INFO:teuthology.orchestra.run.smithi028.stdout: "forward": 0, 2024-06-06T08:47:11.889 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_fetch_complete": 0, 2024-06-06T08:47:11.889 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_fetch_keys": 0, 2024-06-06T08:47:11.889 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_commit": 0, 2024-06-06T08:47:11.889 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_split": 0, 2024-06-06T08:47:11.889 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_merge": 0, 2024-06-06T08:47:11.890 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes": 925, 2024-06-06T08:47:11.890 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_top": 0, 2024-06-06T08:47:11.890 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_bottom": 925, 2024-06-06T08:47:11.890 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_pin_tail": 0, 2024-06-06T08:47:11.890 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_pinned": 925, 2024-06-06T08:47:11.890 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_expired": 0, 2024-06-06T08:47:11.890 INFO:teuthology.orchestra.run.smithi028.stdout: "inodes_with_caps": 0, 2024-06-06T08:47:11.890 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": 0, 2024-06-06T08:47:11.891 INFO:teuthology.orchestra.run.smithi028.stdout: "subtrees": 38, 2024-06-06T08:47:11.891 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse": 0, 2024-06-06T08:47:11.891 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_hit": 0, 2024-06-06T08:47:11.891 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_forward": 0, 2024-06-06T08:47:11.891 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_discover": 0, 2024-06-06T08:47:11.891 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_dir_fetch": 0, 2024-06-06T08:47:11.891 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_remote_ino": 0, 2024-06-06T08:47:11.892 INFO:teuthology.orchestra.run.smithi028.stdout: "traverse_lock": 0, 2024-06-06T08:47:11.892 INFO:teuthology.orchestra.run.smithi028.stdout: "load_cent": 0, 2024-06-06T08:47:11.892 INFO:teuthology.orchestra.run.smithi028.stdout: "q": 0, 2024-06-06T08:47:11.892 INFO:teuthology.orchestra.run.smithi028.stdout: "exported": 0, 2024-06-06T08:47:11.892 INFO:teuthology.orchestra.run.smithi028.stdout: "exported_inodes": 0, 2024-06-06T08:47:11.892 INFO:teuthology.orchestra.run.smithi028.stdout: "imported": 0, 2024-06-06T08:47:11.892 INFO:teuthology.orchestra.run.smithi028.stdout: "imported_inodes": 0, 2024-06-06T08:47:11.892 INFO:teuthology.orchestra.run.smithi028.stdout: "openino_dir_fetch": 0, 2024-06-06T08:47:11.893 INFO:teuthology.orchestra.run.smithi028.stdout: "openino_backtrace_fetch": 0, 2024-06-06T08:47:11.893 INFO:teuthology.orchestra.run.smithi028.stdout: "openino_peer_discover": 0, 2024-06-06T08:47:11.893 INFO:teuthology.orchestra.run.smithi028.stdout: "root_rfiles": 0, 2024-06-06T08:47:11.893 INFO:teuthology.orchestra.run.smithi028.stdout: "root_rbytes": 0, 2024-06-06T08:47:11.893 INFO:teuthology.orchestra.run.smithi028.stdout: "root_rsnaps": 0, 2024-06-06T08:47:11.893 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T08:47:11.893 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_set_tag": 0, 2024-06-06T08:47:11.893 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T08:47:11.894 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_inotable_repaired": 0, 2024-06-06T08:47:11.894 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_dir_inodes": 0, 2024-06-06T08:47:11.894 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T08:47:11.894 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T08:47:11.894 INFO:teuthology.orchestra.run.smithi028.stdout: "scrub_file_inodes": 0, 2024-06-06T08:47:11.894 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_inode_file_caps": 0, 2024-06-06T08:47:11.894 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T08:47:11.895 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_grant": 0, 2024-06-06T08:47:11.895 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T08:47:11.895 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T08:47:11.895 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T08:47:11.895 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_caps": 0, 2024-06-06T08:47:11.895 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_caps_dirty": 0, 2024-06-06T08:47:11.895 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_cap_release": 0, 2024-06-06T08:47:11.895 INFO:teuthology.orchestra.run.smithi028.stdout: "process_request_cap_release": 0 2024-06-06T08:47:11.896 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.896 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_cache": { 2024-06-06T08:47:11.896 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_update": 0, 2024-06-06T08:47:11.896 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_update_receipt": 0, 2024-06-06T08:47:11.896 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_try_discover": 0, 2024-06-06T08:47:11.896 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_send_discover": 0, 2024-06-06T08:47:11.896 INFO:teuthology.orchestra.run.smithi028.stdout: "dir_handle_discover": 0, 2024-06-06T08:47:11.897 INFO:teuthology.orchestra.run.smithi028.stdout: "num_strays": 0, 2024-06-06T08:47:11.897 INFO:teuthology.orchestra.run.smithi028.stdout: "num_strays_delayed": 0, 2024-06-06T08:47:11.897 INFO:teuthology.orchestra.run.smithi028.stdout: "num_strays_enqueuing": 0, 2024-06-06T08:47:11.897 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_created": 0, 2024-06-06T08:47:11.897 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_enqueued": 0, 2024-06-06T08:47:11.897 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_reintegrated": 0, 2024-06-06T08:47:11.897 INFO:teuthology.orchestra.run.smithi028.stdout: "strays_migrated": 0, 2024-06-06T08:47:11.898 INFO:teuthology.orchestra.run.smithi028.stdout: "num_recovering_processing": 0, 2024-06-06T08:47:11.898 INFO:teuthology.orchestra.run.smithi028.stdout: "num_recovering_enqueued": 0, 2024-06-06T08:47:11.898 INFO:teuthology.orchestra.run.smithi028.stdout: "num_recovering_prioritized": 0, 2024-06-06T08:47:11.898 INFO:teuthology.orchestra.run.smithi028.stdout: "recovery_started": 0, 2024-06-06T08:47:11.898 INFO:teuthology.orchestra.run.smithi028.stdout: "recovery_completed": 0, 2024-06-06T08:47:11.898 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_quiesce_path": 0, 2024-06-06T08:47:11.898 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_quiesce_inode": 0, 2024-06-06T08:47:11.898 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T08:47:11.899 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_exportdir": 0, 2024-06-06T08:47:11.899 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_flush": 0, 2024-06-06T08:47:11.899 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_fragmentdir": 0, 2024-06-06T08:47:11.899 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_fragstats": 0, 2024-06-06T08:47:11.899 INFO:teuthology.orchestra.run.smithi028.stdout: "ireq_inodestats": 0 2024-06-06T08:47:11.899 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.899 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_log": { 2024-06-06T08:47:11.899 INFO:teuthology.orchestra.run.smithi028.stdout: "evlrg": 0, 2024-06-06T08:47:11.900 INFO:teuthology.orchestra.run.smithi028.stdout: "evadd": 0, 2024-06-06T08:47:11.900 INFO:teuthology.orchestra.run.smithi028.stdout: "evex": 0, 2024-06-06T08:47:11.900 INFO:teuthology.orchestra.run.smithi028.stdout: "evtrm": 0, 2024-06-06T08:47:11.900 INFO:teuthology.orchestra.run.smithi028.stdout: "ev": 1206, 2024-06-06T08:47:11.900 INFO:teuthology.orchestra.run.smithi028.stdout: "evexg": 0, 2024-06-06T08:47:11.900 INFO:teuthology.orchestra.run.smithi028.stdout: "evexd": 0, 2024-06-06T08:47:11.900 INFO:teuthology.orchestra.run.smithi028.stdout: "segadd": 0, 2024-06-06T08:47:11.900 INFO:teuthology.orchestra.run.smithi028.stdout: "segex": 0, 2024-06-06T08:47:11.900 INFO:teuthology.orchestra.run.smithi028.stdout: "segtrm": 0, 2024-06-06T08:47:11.901 INFO:teuthology.orchestra.run.smithi028.stdout: "seg": 3, 2024-06-06T08:47:11.901 INFO:teuthology.orchestra.run.smithi028.stdout: "segmjr": 2, 2024-06-06T08:47:11.901 INFO:teuthology.orchestra.run.smithi028.stdout: "segexg": 0, 2024-06-06T08:47:11.901 INFO:teuthology.orchestra.run.smithi028.stdout: "segexd": 0, 2024-06-06T08:47:11.901 INFO:teuthology.orchestra.run.smithi028.stdout: "expos": 4194304, 2024-06-06T08:47:11.901 INFO:teuthology.orchestra.run.smithi028.stdout: "wrpos": 6299029, 2024-06-06T08:47:11.901 INFO:teuthology.orchestra.run.smithi028.stdout: "rdpos": 6298455, 2024-06-06T08:47:11.901 INFO:teuthology.orchestra.run.smithi028.stdout: "jlat": { 2024-06-06T08:47:11.902 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.902 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.902 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.902 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.902 INFO:teuthology.orchestra.run.smithi028.stdout: "replayed": 1206 2024-06-06T08:47:11.902 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.902 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_mem": { 2024-06-06T08:47:11.902 INFO:teuthology.orchestra.run.smithi028.stdout: "ino": 601, 2024-06-06T08:47:11.903 INFO:teuthology.orchestra.run.smithi028.stdout: "ino+": 733, 2024-06-06T08:47:11.903 INFO:teuthology.orchestra.run.smithi028.stdout: "ino-": 132, 2024-06-06T08:47:11.903 INFO:teuthology.orchestra.run.smithi028.stdout: "dir": 47, 2024-06-06T08:47:11.903 INFO:teuthology.orchestra.run.smithi028.stdout: "dir+": 47, 2024-06-06T08:47:11.903 INFO:teuthology.orchestra.run.smithi028.stdout: "dir-": 0, 2024-06-06T08:47:11.903 INFO:teuthology.orchestra.run.smithi028.stdout: "dn": 925, 2024-06-06T08:47:11.903 INFO:teuthology.orchestra.run.smithi028.stdout: "dn+": 925, 2024-06-06T08:47:11.903 INFO:teuthology.orchestra.run.smithi028.stdout: "dn-": 0, 2024-06-06T08:47:11.904 INFO:teuthology.orchestra.run.smithi028.stdout: "cap": 0, 2024-06-06T08:47:11.904 INFO:teuthology.orchestra.run.smithi028.stdout: "cap+": 0, 2024-06-06T08:47:11.904 INFO:teuthology.orchestra.run.smithi028.stdout: "cap-": 0, 2024-06-06T08:47:11.904 INFO:teuthology.orchestra.run.smithi028.stdout: "rss": 53308, 2024-06-06T08:47:11.904 INFO:teuthology.orchestra.run.smithi028.stdout: "heap": 215420 2024-06-06T08:47:11.904 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.904 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_server": { 2024-06-06T08:47:11.904 INFO:teuthology.orchestra.run.smithi028.stdout: "dispatch_client_request": 0, 2024-06-06T08:47:11.905 INFO:teuthology.orchestra.run.smithi028.stdout: "dispatch_server_request": 0, 2024-06-06T08:47:11.905 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_request": 0, 2024-06-06T08:47:11.905 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_client_session": 0, 2024-06-06T08:47:11.905 INFO:teuthology.orchestra.run.smithi028.stdout: "handle_peer_request": 0, 2024-06-06T08:47:11.905 INFO:teuthology.orchestra.run.smithi028.stdout: "req_create_latency": { 2024-06-06T08:47:11.905 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.905 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.905 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.905 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.906 INFO:teuthology.orchestra.run.smithi028.stdout: "req_getattr_latency": { 2024-06-06T08:47:11.906 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.906 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.906 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.906 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.906 INFO:teuthology.orchestra.run.smithi028.stdout: "req_getfilelock_latency": { 2024-06-06T08:47:11.906 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.907 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.907 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.907 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.907 INFO:teuthology.orchestra.run.smithi028.stdout: "req_link_latency": { 2024-06-06T08:47:11.907 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.907 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.907 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.907 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.908 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookup_latency": { 2024-06-06T08:47:11.908 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.908 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.908 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.908 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.908 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookuphash_latency": { 2024-06-06T08:47:11.908 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.908 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.908 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.909 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.909 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupino_latency": { 2024-06-06T08:47:11.909 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.909 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.909 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.909 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.909 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupname_latency": { 2024-06-06T08:47:11.909 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.910 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.910 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.910 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.910 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupparent_latency": { 2024-06-06T08:47:11.910 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.910 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.910 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.910 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.911 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lookupsnap_latency": { 2024-06-06T08:47:11.911 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.911 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.911 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.911 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.911 INFO:teuthology.orchestra.run.smithi028.stdout: "req_lssnap_latency": { 2024-06-06T08:47:11.911 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.911 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.911 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.912 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.912 INFO:teuthology.orchestra.run.smithi028.stdout: "req_mkdir_latency": { 2024-06-06T08:47:11.912 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.912 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.913 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.913 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.913 INFO:teuthology.orchestra.run.smithi028.stdout: "req_mknod_latency": { 2024-06-06T08:47:11.913 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.913 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.913 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.913 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.913 INFO:teuthology.orchestra.run.smithi028.stdout: "req_mksnap_latency": { 2024-06-06T08:47:11.914 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.914 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.914 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.914 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.914 INFO:teuthology.orchestra.run.smithi028.stdout: "req_open_latency": { 2024-06-06T08:47:11.914 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.914 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.914 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.915 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.915 INFO:teuthology.orchestra.run.smithi028.stdout: "req_readdir_latency": { 2024-06-06T08:47:11.915 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.915 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.915 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.915 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.915 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rename_latency": { 2024-06-06T08:47:11.915 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.916 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.916 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.916 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.916 INFO:teuthology.orchestra.run.smithi028.stdout: "req_renamesnap_latency": { 2024-06-06T08:47:11.916 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.916 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.916 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.917 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.917 INFO:teuthology.orchestra.run.smithi028.stdout: "req_snapdiff_latency": { 2024-06-06T08:47:11.917 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.917 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.917 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.917 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.917 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rmdir_latency": { 2024-06-06T08:47:11.917 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.917 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.918 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.918 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.918 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rmsnap_latency": { 2024-06-06T08:47:11.918 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.918 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.918 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.918 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.918 INFO:teuthology.orchestra.run.smithi028.stdout: "req_rmxattr_latency": { 2024-06-06T08:47:11.919 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.919 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.919 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.919 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.919 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setattr_latency": { 2024-06-06T08:47:11.919 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.919 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.919 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.920 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.920 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setdirlayout_latency": { 2024-06-06T08:47:11.920 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.920 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.920 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.920 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.920 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setfilelock_latency": { 2024-06-06T08:47:11.920 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.921 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.921 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.921 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.921 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setlayout_latency": { 2024-06-06T08:47:11.921 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.921 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.921 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.921 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.921 INFO:teuthology.orchestra.run.smithi028.stdout: "req_setxattr_latency": { 2024-06-06T08:47:11.922 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.922 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.922 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.922 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.922 INFO:teuthology.orchestra.run.smithi028.stdout: "req_symlink_latency": { 2024-06-06T08:47:11.922 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.922 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.922 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.923 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.923 INFO:teuthology.orchestra.run.smithi028.stdout: "req_unlink_latency": { 2024-06-06T08:47:11.923 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.923 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.923 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.923 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.923 INFO:teuthology.orchestra.run.smithi028.stdout: "cap_revoke_eviction": 0, 2024-06-06T08:47:11.923 INFO:teuthology.orchestra.run.smithi028.stdout: "cap_acquisition_throttle": 0, 2024-06-06T08:47:11.923 INFO:teuthology.orchestra.run.smithi028.stdout: "req_getvxattr_latency": { 2024-06-06T08:47:11.924 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.924 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.924 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.924 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:11.924 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.924 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_sessions": { 2024-06-06T08:47:11.924 INFO:teuthology.orchestra.run.smithi028.stdout: "session_count": 1, 2024-06-06T08:47:11.924 INFO:teuthology.orchestra.run.smithi028.stdout: "session_add": 1, 2024-06-06T08:47:11.924 INFO:teuthology.orchestra.run.smithi028.stdout: "session_remove": 0, 2024-06-06T08:47:11.925 INFO:teuthology.orchestra.run.smithi028.stdout: "sessions_open": 1, 2024-06-06T08:47:11.925 INFO:teuthology.orchestra.run.smithi028.stdout: "sessions_stale": 0, 2024-06-06T08:47:11.925 INFO:teuthology.orchestra.run.smithi028.stdout: "total_load": 0, 2024-06-06T08:47:11.925 INFO:teuthology.orchestra.run.smithi028.stdout: "average_load": 0, 2024-06-06T08:47:11.925 INFO:teuthology.orchestra.run.smithi028.stdout: "avg_session_uptime": 1576, 2024-06-06T08:47:11.925 INFO:teuthology.orchestra.run.smithi028.stdout: "mdthresh_evicted": 0 2024-06-06T08:47:11.925 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.926 INFO:teuthology.orchestra.run.smithi028.stdout: "mempool": { 2024-06-06T08:47:11.926 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:11.926 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:11.926 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:11.926 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:11.926 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:11.926 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:11.926 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:11.927 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:11.927 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:11.927 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:11.927 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:11.927 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:11.927 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:11.927 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:11.927 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:11.928 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:11.928 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:11.928 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:11.928 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:11.928 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:11.928 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:11.928 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:11.929 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:11.929 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:11.929 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:11.929 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:11.929 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:11.929 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:11.929 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:11.929 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:11.929 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:11.930 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_items": 0, 2024-06-06T08:47:11.930 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:11.930 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:11.930 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:11.930 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:11.930 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_bytes": 220291, 2024-06-06T08:47:11.930 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_items": 646, 2024-06-06T08:47:11.930 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_bytes": 0, 2024-06-06T08:47:11.931 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_items": 0, 2024-06-06T08:47:11.931 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_bytes": 0, 2024-06-06T08:47:11.931 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_items": 0, 2024-06-06T08:47:11.931 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:11.931 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:11.931 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:11.931 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:11.931 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_bytes": 8016, 2024-06-06T08:47:11.932 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_items": 169, 2024-06-06T08:47:11.932 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:11.932 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:11.932 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:11.932 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_items": 0, 2024-06-06T08:47:11.932 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_bytes": 2076822, 2024-06-06T08:47:11.932 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_items": 17459, 2024-06-06T08:47:11.932 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:11.933 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_items": 0, 2024-06-06T08:47:11.933 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:11.933 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_items": 0 2024-06-06T08:47:11.933 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.933 INFO:teuthology.orchestra.run.smithi028.stdout: "objecter": { 2024-06-06T08:47:11.933 INFO:teuthology.orchestra.run.smithi028.stdout: "op_active": 0, 2024-06-06T08:47:11.933 INFO:teuthology.orchestra.run.smithi028.stdout: "op_laggy": 0, 2024-06-06T08:47:11.933 INFO:teuthology.orchestra.run.smithi028.stdout: "op_send": 880, 2024-06-06T08:47:11.934 INFO:teuthology.orchestra.run.smithi028.stdout: "op_send_bytes": 21, 2024-06-06T08:47:11.934 INFO:teuthology.orchestra.run.smithi028.stdout: "op_resend": 3, 2024-06-06T08:47:11.934 INFO:teuthology.orchestra.run.smithi028.stdout: "op_reply": 880, 2024-06-06T08:47:11.934 INFO:teuthology.orchestra.run.smithi028.stdout: "op_latency": { 2024-06-06T08:47:11.934 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 880, 2024-06-06T08:47:11.934 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 1.811950138, 2024-06-06T08:47:11.934 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.002059034 2024-06-06T08:47:11.934 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.935 INFO:teuthology.orchestra.run.smithi028.stdout: "op_inflight": 0, 2024-06-06T08:47:11.935 INFO:teuthology.orchestra.run.smithi028.stdout: "oplen_avg": { 2024-06-06T08:47:11.935 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 880, 2024-06-06T08:47:11.935 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 881 2024-06-06T08:47:11.935 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.935 INFO:teuthology.orchestra.run.smithi028.stdout: "op": 880, 2024-06-06T08:47:11.935 INFO:teuthology.orchestra.run.smithi028.stdout: "op_r": 880, 2024-06-06T08:47:11.935 INFO:teuthology.orchestra.run.smithi028.stdout: "op_w": 0, 2024-06-06T08:47:11.936 INFO:teuthology.orchestra.run.smithi028.stdout: "op_rmw": 0, 2024-06-06T08:47:11.936 INFO:teuthology.orchestra.run.smithi028.stdout: "op_pg": 0, 2024-06-06T08:47:11.936 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_stat": 460, 2024-06-06T08:47:11.936 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_create": 0, 2024-06-06T08:47:11.936 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_read": 418, 2024-06-06T08:47:11.936 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_write": 0, 2024-06-06T08:47:11.936 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_writefull": 0, 2024-06-06T08:47:11.936 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_writesame": 0, 2024-06-06T08:47:11.937 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_append": 0, 2024-06-06T08:47:11.937 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_zero": 0, 2024-06-06T08:47:11.937 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_truncate": 0, 2024-06-06T08:47:11.937 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_delete": 0, 2024-06-06T08:47:11.937 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_mapext": 0, 2024-06-06T08:47:11.937 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_sparse_read": 0, 2024-06-06T08:47:11.937 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_clonerange": 0, 2024-06-06T08:47:11.937 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_getxattr": 1, 2024-06-06T08:47:11.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_setxattr": 0, 2024-06-06T08:47:11.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_cmpxattr": 0, 2024-06-06T08:47:11.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_rmxattr": 0, 2024-06-06T08:47:11.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_resetxattrs": 0, 2024-06-06T08:47:11.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_call": 0, 2024-06-06T08:47:11.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_watch": 0, 2024-06-06T08:47:11.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_notify": 0, 2024-06-06T08:47:11.938 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T08:47:11.939 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_pgls": 0, 2024-06-06T08:47:11.939 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_pgls_filter": 0, 2024-06-06T08:47:11.939 INFO:teuthology.orchestra.run.smithi028.stdout: "osdop_other": 0, 2024-06-06T08:47:11.939 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_active": 0, 2024-06-06T08:47:11.939 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_send": 0, 2024-06-06T08:47:11.939 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_resend": 0, 2024-06-06T08:47:11.939 INFO:teuthology.orchestra.run.smithi028.stdout: "linger_ping": 0, 2024-06-06T08:47:11.940 INFO:teuthology.orchestra.run.smithi028.stdout: "poolop_active": 0, 2024-06-06T08:47:11.940 INFO:teuthology.orchestra.run.smithi028.stdout: "poolop_send": 0, 2024-06-06T08:47:11.940 INFO:teuthology.orchestra.run.smithi028.stdout: "poolop_resend": 0, 2024-06-06T08:47:11.940 INFO:teuthology.orchestra.run.smithi028.stdout: "poolstat_active": 0, 2024-06-06T08:47:11.940 INFO:teuthology.orchestra.run.smithi028.stdout: "poolstat_send": 0, 2024-06-06T08:47:11.940 INFO:teuthology.orchestra.run.smithi028.stdout: "poolstat_resend": 0, 2024-06-06T08:47:11.940 INFO:teuthology.orchestra.run.smithi028.stdout: "statfs_active": 0, 2024-06-06T08:47:11.940 INFO:teuthology.orchestra.run.smithi028.stdout: "statfs_send": 0, 2024-06-06T08:47:11.940 INFO:teuthology.orchestra.run.smithi028.stdout: "statfs_resend": 0, 2024-06-06T08:47:11.941 INFO:teuthology.orchestra.run.smithi028.stdout: "command_active": 0, 2024-06-06T08:47:11.941 INFO:teuthology.orchestra.run.smithi028.stdout: "command_send": 0, 2024-06-06T08:47:11.941 INFO:teuthology.orchestra.run.smithi028.stdout: "command_resend": 0, 2024-06-06T08:47:11.941 INFO:teuthology.orchestra.run.smithi028.stdout: "map_epoch": 92, 2024-06-06T08:47:11.941 INFO:teuthology.orchestra.run.smithi028.stdout: "map_full": 0, 2024-06-06T08:47:11.941 INFO:teuthology.orchestra.run.smithi028.stdout: "map_inc": 4, 2024-06-06T08:47:11.941 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_sessions": 6, 2024-06-06T08:47:11.942 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_session_open": 6, 2024-06-06T08:47:11.942 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_session_close": 0, 2024-06-06T08:47:11.942 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_laggy": 0, 2024-06-06T08:47:11.942 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_wr": 0, 2024-06-06T08:47:11.942 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_rd": 2, 2024-06-06T08:47:11.942 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_del": 0 2024-06-06T08:47:11.942 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.942 INFO:teuthology.orchestra.run.smithi028.stdout: "oft": { 2024-06-06T08:47:11.943 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_objs": 0, 2024-06-06T08:47:11.943 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_kv_pairs": 0, 2024-06-06T08:47:11.943 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_updates": 0, 2024-06-06T08:47:11.943 INFO:teuthology.orchestra.run.smithi028.stdout: "omap_total_removes": 0 2024-06-06T08:47:11.943 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.943 INFO:teuthology.orchestra.run.smithi028.stdout: "osd-slow-ops": { 2024-06-06T08:47:11.943 INFO:teuthology.orchestra.run.smithi028.stdout: "slow_ops_count": 0 2024-06-06T08:47:11.943 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.944 INFO:teuthology.orchestra.run.smithi028.stdout: "purge_queue": { 2024-06-06T08:47:11.944 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing_ops": 0, 2024-06-06T08:47:11.944 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T08:47:11.944 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing": 0, 2024-06-06T08:47:11.944 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executing_high_water": 0, 2024-06-06T08:47:11.944 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executed_ops": 0, 2024-06-06T08:47:11.944 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_executed": 0, 2024-06-06T08:47:11.944 INFO:teuthology.orchestra.run.smithi028.stdout: "pq_item_in_journal": 0 2024-06-06T08:47:11.945 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.945 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:11.945 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:11.945 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 104857600, 2024-06-06T08:47:11.945 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:11.945 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 1026, 2024-06-06T08:47:11.945 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 2782413, 2024-06-06T08:47:11.945 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:11.946 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 1026, 2024-06-06T08:47:11.946 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-06-06T08:47:11.946 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-06-06T08:47:11.946 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 1026, 2024-06-06T08:47:11.946 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 2782413, 2024-06-06T08:47:11.946 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:11.946 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.946 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.947 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.947 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:11.947 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.947 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-objecter_bytes": { 2024-06-06T08:47:11.947 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:11.947 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 104857600, 2024-06-06T08:47:11.947 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:11.947 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 0, 2024-06-06T08:47:11.948 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 0, 2024-06-06T08:47:11.948 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:11.948 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:11.948 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 880, 2024-06-06T08:47:11.948 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 2104730, 2024-06-06T08:47:11.948 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 880, 2024-06-06T08:47:11.948 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 2104730, 2024-06-06T08:47:11.948 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:11.949 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.949 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.949 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.949 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:11.949 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.949 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-objecter_ops": { 2024-06-06T08:47:11.949 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:11.949 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 1024, 2024-06-06T08:47:11.950 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:11.950 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 0, 2024-06-06T08:47:11.950 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 0, 2024-06-06T08:47:11.950 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:11.950 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:11.950 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 880, 2024-06-06T08:47:11.950 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 880, 2024-06-06T08:47:11.951 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 880, 2024-06-06T08:47:11.951 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 880, 2024-06-06T08:47:11.951 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:11.951 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.951 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.951 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.951 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:11.951 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.952 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-write_buf_throttle": { 2024-06-06T08:47:11.952 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:11.952 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 3758096384, 2024-06-06T08:47:11.952 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:11.952 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 0, 2024-06-06T08:47:11.952 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 0, 2024-06-06T08:47:11.952 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:11.953 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:11.953 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-06-06T08:47:11.953 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-06-06T08:47:11.953 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 0, 2024-06-06T08:47:11.953 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 0, 2024-06-06T08:47:11.953 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:11.953 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.953 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.954 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.954 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:11.954 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:11.954 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-write_buf_throttle-0x564657114780": { 2024-06-06T08:47:11.954 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:11.954 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 3758096384, 2024-06-06T08:47:11.954 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:11.954 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 0, 2024-06-06T08:47:11.955 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 0, 2024-06-06T08:47:11.955 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:11.955 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:11.955 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-06-06T08:47:11.955 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-06-06T08:47:11.955 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 0, 2024-06-06T08:47:11.955 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 0, 2024-06-06T08:47:11.955 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:11.956 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:11.956 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:11.956 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:11.956 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:11.956 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:11.956 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:47:12.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:11 smithi028 ceph-mon[31564]: pgmap v547: 97 pgs: 97 active+clean; 72 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 83 KiB/s wr, 15 op/s 2024-06-06T08:47:12.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:11 smithi037 ceph-mon[36609]: pgmap v547: 97 pgs: 97 active+clean; 72 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 83 KiB/s wr, 15 op/s 2024-06-06T08:47:12.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:11 smithi059 ceph-mon[36684]: pgmap v547: 97 pgs: 97 active+clean; 72 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 83 KiB/s wr, 15 op/s 2024-06-06T08:47:12.968 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-06-06T08:47:12.968 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-06-06T08:47:12.968 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-06-06T08:47:12.968 DEBUG:tasks.check_counter:Getting stats from j 2024-06-06T08:47:12.969 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.j perf dump 2024-06-06T08:47:13.439 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:47:14.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:13 smithi028 ceph-mon[31564]: pgmap v548: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 144 KiB/s wr, 21 op/s 2024-06-06T08:47:14.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:13 smithi037 ceph-mon[36609]: pgmap v548: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 144 KiB/s wr, 21 op/s 2024-06-06T08:47:14.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:13 smithi059 ceph-mon[36684]: pgmap v548: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 144 KiB/s wr, 21 op/s 2024-06-06T08:47:15.817 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-06-06T08:47:15.818 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:15.818 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 135, 2024-06-06T08:47:15.818 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 132, 2024-06-06T08:47:15.818 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 453920, 2024-06-06T08:47:15.818 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 80672, 2024-06-06T08:47:15.819 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 4, 2024-06-06T08:47:15.819 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 0, 2024-06-06T08:47:15.819 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.051977703, 2024-06-06T08:47:15.819 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.019488552, 2024-06-06T08:47:15.819 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.027495429, 2024-06-06T08:47:15.819 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.005757137, 2024-06-06T08:47:15.819 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:15.819 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 131, 2024-06-06T08:47:15.820 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.012475409, 2024-06-06T08:47:15.820 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000095232 2024-06-06T08:47:15.820 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:15.820 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:15.820 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:15.820 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:15.820 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:15.820 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:15.820 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 453920, 2024-06-06T08:47:15.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 80672 2024-06-06T08:47:15.821 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:15.821 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:15.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 5, 2024-06-06T08:47:15.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 103, 2024-06-06T08:47:15.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 3152, 2024-06-06T08:47:15.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 95984, 2024-06-06T08:47:15.821 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 3, 2024-06-06T08:47:15.822 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 2, 2024-06-06T08:47:15.822 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.019576372, 2024-06-06T08:47:15.822 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.014320760, 2024-06-06T08:47:15.822 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.002997729, 2024-06-06T08:47:15.822 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T08:47:15.822 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:15.822 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 102, 2024-06-06T08:47:15.822 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.010726716, 2024-06-06T08:47:15.823 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000105163 2024-06-06T08:47:15.823 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:15.823 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:15.823 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:15.823 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:15.823 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:15.823 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:15.823 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-06-06T08:47:15.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 95984 2024-06-06T08:47:15.824 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:15.824 INFO:teuthology.orchestra.run.smithi028.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:15.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_messages": 0, 2024-06-06T08:47:15.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages": 2, 2024-06-06T08:47:15.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_bytes": 0, 2024-06-06T08:47:15.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_bytes": 0, 2024-06-06T08:47:15.824 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_created_connections": 2, 2024-06-06T08:47:15.825 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_active_connections": 1, 2024-06-06T08:47:15.825 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_total_time": 0.001299216, 2024-06-06T08:47:15.825 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_send_time": 0.000000000, 2024-06-06T08:47:15.825 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_recv_time": 0.001146325, 2024-06-06T08:47:15.825 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T08:47:15.825 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:15.825 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:15.825 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:15.826 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:15.826 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:15.826 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:15.826 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:15.826 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:15.826 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:15.826 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:15.826 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T08:47:15.826 INFO:teuthology.orchestra.run.smithi028.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T08:47:15.827 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:15.827 INFO:teuthology.orchestra.run.smithi028.stdout: "cct": { 2024-06-06T08:47:15.827 INFO:teuthology.orchestra.run.smithi028.stdout: "total_workers": 0, 2024-06-06T08:47:15.827 INFO:teuthology.orchestra.run.smithi028.stdout: "unhealthy_workers": 0 2024-06-06T08:47:15.827 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:15.827 INFO:teuthology.orchestra.run.smithi028.stdout: "mempool": { 2024-06-06T08:47:15.827 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:15.827 INFO:teuthology.orchestra.run.smithi028.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:15.828 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:15.828 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:15.828 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:15.828 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:15.828 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:15.828 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:15.828 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:15.828 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:15.829 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:15.829 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:15.829 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:15.829 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:15.829 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:15.829 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:15.829 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:15.829 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:15.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:15.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:15.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:15.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:15.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:15.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:15.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:15.830 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:15.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:15.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:15.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:15.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:15.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:15.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_items": 0, 2024-06-06T08:47:15.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:15.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:15.831 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:15.832 INFO:teuthology.orchestra.run.smithi028.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:15.832 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_bytes": 148823, 2024-06-06T08:47:15.832 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_anon_items": 27, 2024-06-06T08:47:15.832 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_bytes": 0, 2024-06-06T08:47:15.832 INFO:teuthology.orchestra.run.smithi028.stdout: "buffer_meta_items": 0, 2024-06-06T08:47:15.832 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_bytes": 0, 2024-06-06T08:47:15.832 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_items": 0, 2024-06-06T08:47:15.832 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:15.833 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:15.833 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:15.833 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:15.833 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_bytes": 0, 2024-06-06T08:47:15.833 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_items": 0, 2024-06-06T08:47:15.833 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:15.833 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:15.833 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:15.834 INFO:teuthology.orchestra.run.smithi028.stdout: "pgmap_items": 0, 2024-06-06T08:47:15.834 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_bytes": 928, 2024-06-06T08:47:15.834 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_co_items": 2, 2024-06-06T08:47:15.834 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:15.834 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_1_items": 0, 2024-06-06T08:47:15.834 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:15.834 INFO:teuthology.orchestra.run.smithi028.stdout: "unittest_2_items": 0 2024-06-06T08:47:15.834 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-06-06T08:47:15.835 INFO:teuthology.orchestra.run.smithi028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:15.835 INFO:teuthology.orchestra.run.smithi028.stdout: "val": 0, 2024-06-06T08:47:15.835 INFO:teuthology.orchestra.run.smithi028.stdout: "max": 104857600, 2024-06-06T08:47:15.835 INFO:teuthology.orchestra.run.smithi028.stdout: "get_started": 0, 2024-06-06T08:47:15.835 INFO:teuthology.orchestra.run.smithi028.stdout: "get": 136, 2024-06-06T08:47:15.835 INFO:teuthology.orchestra.run.smithi028.stdout: "get_sum": 434863, 2024-06-06T08:47:15.835 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:15.835 INFO:teuthology.orchestra.run.smithi028.stdout: "get_or_fail_success": 136, 2024-06-06T08:47:15.836 INFO:teuthology.orchestra.run.smithi028.stdout: "take": 0, 2024-06-06T08:47:15.836 INFO:teuthology.orchestra.run.smithi028.stdout: "take_sum": 0, 2024-06-06T08:47:15.836 INFO:teuthology.orchestra.run.smithi028.stdout: "put": 136, 2024-06-06T08:47:15.836 INFO:teuthology.orchestra.run.smithi028.stdout: "put_sum": 434863, 2024-06-06T08:47:15.836 INFO:teuthology.orchestra.run.smithi028.stdout: "wait": { 2024-06-06T08:47:15.836 INFO:teuthology.orchestra.run.smithi028.stdout: "avgcount": 0, 2024-06-06T08:47:15.836 INFO:teuthology.orchestra.run.smithi028.stdout: "sum": 0.000000000, 2024-06-06T08:47:15.837 INFO:teuthology.orchestra.run.smithi028.stdout: "avgtime": 0.000000000 2024-06-06T08:47:15.837 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:15.837 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-06-06T08:47:15.837 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-06-06T08:47:16.280 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:15 smithi028 ceph-mon[31564]: pgmap v549: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 117 KiB/s wr, 20 op/s 2024-06-06T08:47:16.280 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:15 smithi028 ceph-mon[31564]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:47:16.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:15 smithi037 ceph-mon[36609]: pgmap v549: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 117 KiB/s wr, 20 op/s 2024-06-06T08:47:16.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:15 smithi037 ceph-mon[36609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:47:16.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:15 smithi059 ceph-mon[36684]: pgmap v549: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 117 KiB/s wr, 20 op/s 2024-06-06T08:47:16.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:15 smithi059 ceph-mon[36684]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-06T08:47:16.769 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-06-06T08:47:16.769 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-06-06T08:47:16.770 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-06-06T08:47:16.770 DEBUG:tasks.check_counter:Getting stats from b 2024-06-06T08:47:16.770 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.b perf dump 2024-06-06T08:47:17.029 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:47:18.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:17 smithi028 ceph-mon[31564]: pgmap v550: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 72 KiB/s wr, 19 op/s 2024-06-06T08:47:18.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:17 smithi037 ceph-mon[36609]: pgmap v550: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 72 KiB/s wr, 19 op/s 2024-06-06T08:47:18.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:17 smithi059 ceph-mon[36684]: pgmap v550: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 72 KiB/s wr, 19 op/s 2024-06-06T08:47:19.016 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-06-06T08:47:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 19727, 2024-06-06T08:47:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 36396, 2024-06-06T08:47:19.017 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 6411517, 2024-06-06T08:47:19.017 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 31061496, 2024-06-06T08:47:19.017 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 15, 2024-06-06T08:47:19.017 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 4, 2024-06-06T08:47:19.017 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 1.225636487, 2024-06-06T08:47:19.017 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.608608426, 2024-06-06T08:47:19.017 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.825470254, 2024-06-06T08:47:19.017 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.056867484, 2024-06-06T08:47:19.017 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:19.018 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 36398, 2024-06-06T08:47:19.018 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 1.699903105, 2024-06-06T08:47:19.018 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000046703 2024-06-06T08:47:19.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.018 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:19.018 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 26794, 2024-06-06T08:47:19.019 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.007704423, 2024-06-06T08:47:19.019 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000287 2024-06-06T08:47:19.019 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.019 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 63936, 2024-06-06T08:47:19.019 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 30192 2024-06-06T08:47:19.019 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.019 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:19.019 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 3981, 2024-06-06T08:47:19.020 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2803, 2024-06-06T08:47:19.020 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1793187, 2024-06-06T08:47:19.020 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 15545163, 2024-06-06T08:47:19.020 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 10, 2024-06-06T08:47:19.020 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 9, 2024-06-06T08:47:19.020 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.297441816, 2024-06-06T08:47:19.020 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.115593883, 2024-06-06T08:47:19.021 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.521324297, 2024-06-06T08:47:19.021 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.056577200, 2024-06-06T08:47:19.021 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:19.021 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2796, 2024-06-06T08:47:19.021 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.360863864, 2024-06-06T08:47:19.021 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000129064 2024-06-06T08:47:19.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.021 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:19.022 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2855, 2024-06-06T08:47:19.022 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000526353, 2024-06-06T08:47:19.022 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000184 2024-06-06T08:47:19.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.022 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 557248, 2024-06-06T08:47:19.022 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 83872 2024-06-06T08:47:19.023 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.023 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:19.023 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 5898, 2024-06-06T08:47:19.023 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 3624, 2024-06-06T08:47:19.023 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1651367, 2024-06-06T08:47:19.023 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 5390100, 2024-06-06T08:47:19.023 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 9, 2024-06-06T08:47:19.023 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 5, 2024-06-06T08:47:19.024 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.366728399, 2024-06-06T08:47:19.024 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.158987670, 2024-06-06T08:47:19.024 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.222778015, 2024-06-06T08:47:19.024 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.036360025, 2024-06-06T08:47:19.024 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:19.024 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3625, 2024-06-06T08:47:19.024 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.307965696, 2024-06-06T08:47:19.024 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000084956 2024-06-06T08:47:19.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.025 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:19.025 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 7875, 2024-06-06T08:47:19.025 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.001219016, 2024-06-06T08:47:19.025 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000154 2024-06-06T08:47:19.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.025 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T08:47:19.026 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 245760 2024-06-06T08:47:19.026 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.026 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-06-06T08:47:19.026 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-06-06T08:47:19.026 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-06-06T08:47:19.026 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-06-06T08:47:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-06-06T08:47:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-06-06T08:47:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1250, 2024-06-06T08:47:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 7.454212187, 2024-06-06T08:47:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.005963369 2024-06-06T08:47:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:19.028 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.028 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-06-06T08:47:19.028 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-06-06T08:47:19.028 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-06-06T08:47:19.028 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3841, 2024-06-06T08:47:19.028 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.470895346, 2024-06-06T08:47:19.028 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000122597 2024-06-06T08:47:19.028 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:19.029 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-06-06T08:47:19.029 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 9664, 2024-06-06T08:47:19.029 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 9477, 2024-06-06T08:47:19.029 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-06-06T08:47:19.029 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 9477, 2024-06-06T08:47:19.029 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 31.666997436, 2024-06-06T08:47:19.029 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.003341457 2024-06-06T08:47:19.029 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.030 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-06-06T08:47:19.030 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 187, 2024-06-06T08:47:19.030 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-06-06T08:47:19.031 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-06-06T08:47:19.031 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 202, 2024-06-06T08:47:19.031 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 23, 2024-06-06T08:47:19.031 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-06-06T08:47:19.031 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 1073, 2024-06-06T08:47:19.031 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 424, 2024-06-06T08:47:19.031 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 239, 2024-06-06T08:47:19.032 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 410, 2024-06-06T08:47:19.032 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 466, 2024-06-06T08:47:19.032 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 4274, 2024-06-06T08:47:19.032 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 53, 2024-06-06T08:47:19.032 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 53, 2024-06-06T08:47:19.032 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 91, 2024-06-06T08:47:19.032 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 10867, 2024-06-06T08:47:19.032 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 10223, 2024-06-06T08:47:19.033 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 175, 2024-06-06T08:47:19.033 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 2, 2024-06-06T08:47:19.033 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-06-06T08:47:19.033 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-06-06T08:47:19.033 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 3, 2024-06-06T08:47:19.033 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 1319, 2024-06-06T08:47:19.033 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-06-06T08:47:19.033 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 140, 2024-06-06T08:47:19.034 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 4577, 2024-06-06T08:47:19.034 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 0, 2024-06-06T08:47:19.034 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 0, 2024-06-06T08:47:19.034 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-06-06T08:47:19.034 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-06-06T08:47:19.034 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-06-06T08:47:19.034 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 3454, 2024-06-06T08:47:19.034 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 26759812, 2024-06-06T08:47:19.035 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-06-06T08:47:19.035 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T08:47:19.035 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-06-06T08:47:19.035 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T08:47:19.035 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-06-06T08:47:19.035 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-06-06T08:47:19.035 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T08:47:19.036 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T08:47:19.036 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-06-06T08:47:19.036 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 5, 2024-06-06T08:47:19.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 201, 2024-06-06T08:47:19.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 8322, 2024-06-06T08:47:19.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 8, 2024-06-06T08:47:19.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T08:47:19.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T08:47:19.037 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 5270, 2024-06-06T08:47:19.037 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 3820, 2024-06-06T08:47:19.037 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 314, 2024-06-06T08:47:19.037 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 3252 2024-06-06T08:47:19.037 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.037 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-06-06T08:47:19.037 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-06-06T08:47:19.037 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-06-06T08:47:19.037 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-06-06T08:47:19.038 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 2, 2024-06-06T08:47:19.038 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 151, 2024-06-06T08:47:19.038 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 1, 2024-06-06T08:47:19.038 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-06-06T08:47:19.038 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-06-06T08:47:19.038 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 2099, 2024-06-06T08:47:19.038 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 2095, 2024-06-06T08:47:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 3, 2024-06-06T08:47:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-06-06T08:47:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-06-06T08:47:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-06-06T08:47:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-06-06T08:47:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-06-06T08:47:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-06-06T08:47:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-06-06T08:47:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-06-06T08:47:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T08:47:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 140, 2024-06-06T08:47:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-06-06T08:47:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 23, 2024-06-06T08:47:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-06-06T08:47:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0 2024-06-06T08:47:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-06-06T08:47:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-06-06T08:47:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 16195, 2024-06-06T08:47:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-06-06T08:47:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-06-06T08:47:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 16195, 2024-06-06T08:47:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-06-06T08:47:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-06-06T08:47:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 20, 2024-06-06T08:47:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-06-06T08:47:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-06-06T08:47:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 20, 2024-06-06T08:47:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 3, 2024-06-06T08:47:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-06-06T08:47:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-06-06T08:47:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-06-06T08:47:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 38301186, 2024-06-06T08:47:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 0, 2024-06-06T08:47:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-06-06T08:47:19.049 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 571, 2024-06-06T08:47:19.049 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 8.020422277, 2024-06-06T08:47:19.049 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.014046273 2024-06-06T08:47:19.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.050 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 0 2024-06-06T08:47:19.050 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.050 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-06-06T08:47:19.051 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 687, 2024-06-06T08:47:19.051 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 5891, 2024-06-06T08:47:19.051 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 5204, 2024-06-06T08:47:19.051 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 190, 2024-06-06T08:47:19.052 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 283, 2024-06-06T08:47:19.052 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 93, 2024-06-06T08:47:19.052 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 1073, 2024-06-06T08:47:19.053 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 7170, 2024-06-06T08:47:19.053 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 6097, 2024-06-06T08:47:19.053 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 53, 2024-06-06T08:47:19.053 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 5878, 2024-06-06T08:47:19.054 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 5825, 2024-06-06T08:47:19.054 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 88768, 2024-06-06T08:47:19.054 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 231804 2024-06-06T08:47:19.054 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.055 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-06-06T08:47:19.055 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 9984, 2024-06-06T08:47:19.055 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 2128, 2024-06-06T08:47:19.056 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 9664, 2024-06-06T08:47:19.056 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 153, 2024-06-06T08:47:19.056 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 4217, 2024-06-06T08:47:19.056 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-06-06T08:47:19.057 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 5783, 2024-06-06T08:47:19.057 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 23.746259230, 2024-06-06T08:47:19.057 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.004106218 2024-06-06T08:47:19.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.058 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-06-06T08:47:19.058 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 57, 2024-06-06T08:47:19.058 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.827625433, 2024-06-06T08:47:19.059 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.014519744 2024-06-06T08:47:19.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.059 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-06-06T08:47:19.060 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.060 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.060 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.061 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-06-06T08:47:19.061 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3, 2024-06-06T08:47:19.061 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.003312400, 2024-06-06T08:47:19.061 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.001104133 2024-06-06T08:47:19.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.062 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-06-06T08:47:19.062 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 948, 2024-06-06T08:47:19.062 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.839711906, 2024-06-06T08:47:19.063 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000885772 2024-06-06T08:47:19.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.063 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-06-06T08:47:19.064 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.064 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.064 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.064 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.065 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-06-06T08:47:19.065 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.065 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.065 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.066 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-06-06T08:47:19.066 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.067 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.067 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.067 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-06-06T08:47:19.068 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.068 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.068 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.069 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-06-06T08:47:19.069 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.069 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.070 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.070 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-06-06T08:47:19.070 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.071 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.071 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.072 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-06-06T08:47:19.072 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 83, 2024-06-06T08:47:19.072 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.079824867, 2024-06-06T08:47:19.073 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000961745 2024-06-06T08:47:19.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.073 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-06-06T08:47:19.073 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.074 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.074 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.075 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-06-06T08:47:19.075 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.075 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.075 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.076 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.076 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-06-06T08:47:19.076 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 350, 2024-06-06T08:47:19.077 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.101424662, 2024-06-06T08:47:19.077 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000289784 2024-06-06T08:47:19.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.077 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-06-06T08:47:19.078 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 80, 2024-06-06T08:47:19.078 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.980527373, 2024-06-06T08:47:19.078 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.012256592 2024-06-06T08:47:19.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.079 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-06-06T08:47:19.079 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 80, 2024-06-06T08:47:19.079 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.191793075, 2024-06-06T08:47:19.080 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.002397413 2024-06-06T08:47:19.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.080 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-06-06T08:47:19.080 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.081 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.081 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.081 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-06-06T08:47:19.082 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.082 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.082 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.083 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.083 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-06-06T08:47:19.083 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 22, 2024-06-06T08:47:19.083 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.592314971, 2024-06-06T08:47:19.084 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.026923407 2024-06-06T08:47:19.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.084 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-06-06T08:47:19.085 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.085 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.085 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.086 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-06-06T08:47:19.086 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.086 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.087 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.087 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-06-06T08:47:19.087 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 9, 2024-06-06T08:47:19.088 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.062835210, 2024-06-06T08:47:19.088 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.006981690 2024-06-06T08:47:19.088 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.088 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-06-06T08:47:19.089 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.089 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.089 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.090 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.090 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-06-06T08:47:19.090 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 8, 2024-06-06T08:47:19.090 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.007391951, 2024-06-06T08:47:19.091 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000923993 2024-06-06T08:47:19.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.091 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-06-06T08:47:19.092 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.092 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.092 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.093 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-06-06T08:47:19.093 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 7, 2024-06-06T08:47:19.093 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.020997070, 2024-06-06T08:47:19.094 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.002999581 2024-06-06T08:47:19.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.094 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-06-06T08:47:19.095 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 7, 2024-06-06T08:47:19.095 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.006360219, 2024-06-06T08:47:19.095 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000908602 2024-06-06T08:47:19.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.096 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-06-06T08:47:19.096 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2040, 2024-06-06T08:47:19.096 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 4.206619069, 2024-06-06T08:47:19.096 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.002062068 2024-06-06T08:47:19.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.097 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-06-06T08:47:19.097 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-06-06T08:47:19.097 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-06-06T08:47:19.097 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.097 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.097 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.097 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:19.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.098 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-06-06T08:47:19.098 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 1, 2024-06-06T08:47:19.098 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 2, 2024-06-06T08:47:19.098 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 1, 2024-06-06T08:47:19.098 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-06-06T08:47:19.098 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-06-06T08:47:19.098 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 5433, 2024-06-06T08:47:19.099 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 5433, 2024-06-06T08:47:19.099 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 184, 2024-06-06T08:47:19.099 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-06-06T08:47:19.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.099 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-06-06T08:47:19.099 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:19.099 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:19.099 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:19.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:19.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:19.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:19.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:19.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:19.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:19.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:19.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:19.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:19.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:19.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:19.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:19.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:19.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:19.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:19.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:19.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:19.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:19.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:19.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:19.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:19.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:19.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:19.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:19.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:19.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:19.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:19.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:19.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-06-06T08:47:19.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:19.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:19.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:19.104 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:19.104 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 313308, 2024-06-06T08:47:19.104 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 773, 2024-06-06T08:47:19.104 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 792, 2024-06-06T08:47:19.104 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 9, 2024-06-06T08:47:19.104 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-06-06T08:47:19.104 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-06-06T08:47:19.104 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:19.105 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:19.105 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:19.105 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:19.105 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 8016, 2024-06-06T08:47:19.105 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 169, 2024-06-06T08:47:19.105 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:19.105 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:19.105 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:19.106 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-06-06T08:47:19.106 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 2711990, 2024-06-06T08:47:19.106 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 34904, 2024-06-06T08:47:19.106 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:19.106 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-06-06T08:47:19.106 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:19.106 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-06-06T08:47:19.106 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.106 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-06-06T08:47:19.107 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-06-06T08:47:19.107 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-06-06T08:47:19.107 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 3637, 2024-06-06T08:47:19.107 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 37454360, 2024-06-06T08:47:19.107 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 33, 2024-06-06T08:47:19.107 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 3637, 2024-06-06T08:47:19.107 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-06-06T08:47:19.107 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3637, 2024-06-06T08:47:19.108 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 33.092575617, 2024-06-06T08:47:19.108 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.009098865 2024-06-06T08:47:19.108 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.108 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-06-06T08:47:19.108 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-06-06T08:47:19.108 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3637, 2024-06-06T08:47:19.108 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 3953 2024-06-06T08:47:19.108 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.109 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 3637, 2024-06-06T08:47:19.109 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 45, 2024-06-06T08:47:19.109 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 3592, 2024-06-06T08:47:19.109 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-06-06T08:47:19.109 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-06-06T08:47:19.109 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 0, 2024-06-06T08:47:19.109 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 11, 2024-06-06T08:47:19.110 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 45, 2024-06-06T08:47:19.110 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 616, 2024-06-06T08:47:19.110 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 40, 2024-06-06T08:47:19.110 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-06-06T08:47:19.110 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-06-06T08:47:19.110 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-06-06T08:47:19.110 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 7, 2024-06-06T08:47:19.110 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 2631, 2024-06-06T08:47:19.111 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-06-06T08:47:19.111 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-06-06T08:47:19.111 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-06-06T08:47:19.111 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 0, 2024-06-06T08:47:19.111 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 22, 2024-06-06T08:47:19.111 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-06-06T08:47:19.111 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-06-06T08:47:19.111 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-06-06T08:47:19.112 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-06-06T08:47:19.112 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-06-06T08:47:19.112 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-06-06T08:47:19.112 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T08:47:19.112 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-06-06T08:47:19.112 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-06-06T08:47:19.112 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 8, 2024-06-06T08:47:19.113 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-06-06T08:47:19.113 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-06-06T08:47:19.113 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-06-06T08:47:19.113 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-06-06T08:47:19.113 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-06-06T08:47:19.113 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-06-06T08:47:19.113 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-06-06T08:47:19.113 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-06-06T08:47:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-06-06T08:47:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-06-06T08:47:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-06-06T08:47:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-06-06T08:47:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-06-06T08:47:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-06-06T08:47:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-06-06T08:47:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-06-06T08:47:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 92, 2024-06-06T08:47:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-06-06T08:47:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 4, 2024-06-06T08:47:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 12, 2024-06-06T08:47:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 12, 2024-06-06T08:47:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 0, 2024-06-06T08:47:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-06-06T08:47:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 535, 2024-06-06T08:47:19.116 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 0, 2024-06-06T08:47:19.116 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 38 2024-06-06T08:47:19.116 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.116 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-06-06T08:47:19.116 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 1, 2024-06-06T08:47:19.116 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-06-06T08:47:19.116 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-06-06T08:47:19.116 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-06-06T08:47:19.116 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.117 INFO:teuthology.orchestra.run.smithi037.stdout: "osd-slow-ops": { 2024-06-06T08:47:19.117 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-06-06T08:47:19.117 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.117 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-06-06T08:47:19.117 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-06-06T08:47:19.117 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 6, 2024-06-06T08:47:19.117 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-06-06T08:47:19.118 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 6, 2024-06-06T08:47:19.118 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 2095, 2024-06-06T08:47:19.118 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 2095, 2024-06-06T08:47:19.118 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-06-06T08:47:19.118 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.118 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:19.119 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:19.119 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-06-06T08:47:19.119 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:19.119 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 29602, 2024-06-06T08:47:19.119 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 7421182, 2024-06-06T08:47:19.119 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:19.119 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 29602, 2024-06-06T08:47:19.119 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 29602, 2024-06-06T08:47:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 7421182, 2024-06-06T08:47:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.120 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:19.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.121 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-06-06T08:47:19.121 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:19.121 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-06-06T08:47:19.121 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:19.121 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-06-06T08:47:19.121 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-06-06T08:47:19.121 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:19.122 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:19.122 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3637, 2024-06-06T08:47:19.122 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 37665955, 2024-06-06T08:47:19.122 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3637, 2024-06-06T08:47:19.122 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 37665955, 2024-06-06T08:47:19.122 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:19.122 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.122 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-06-06T08:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-06-06T08:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-06-06T08:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-06-06T08:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3637, 2024-06-06T08:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 3637, 2024-06-06T08:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3637, 2024-06-06T08:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 3637, 2024-06-06T08:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-06-06T08:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-06-06T08:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 2095, 2024-06-06T08:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 211595, 2024-06-06T08:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 2095, 2024-06-06T08:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 45, 2024-06-06T08:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 211595, 2024-06-06T08:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x556ecd258460": { 2024-06-06T08:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-06-06T08:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 16195, 2024-06-06T08:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 34106882, 2024-06-06T08:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 16195, 2024-06-06T08:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 571, 2024-06-06T08:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 34106882, 2024-06-06T08:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-06-06T08:47:19.925 INFO:tasks.check_counter:Daemon mds.b mds.exported=140 2024-06-06T08:47:19.925 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-06-06T08:47:19.925 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=23 2024-06-06T08:47:19.925 DEBUG:tasks.check_counter:Getting stats from e 2024-06-06T08:47:19.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.e perf dump 2024-06-06T08:47:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:47:20.275 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:19 smithi037 ceph-mon[36609]: pgmap v551: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 71 KiB/s wr, 19 op/s 2024-06-06T08:47:20.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:19 smithi028 ceph-mon[31564]: pgmap v551: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 71 KiB/s wr, 19 op/s 2024-06-06T08:47:20.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:19 smithi059 ceph-mon[36684]: pgmap v551: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 71 KiB/s wr, 19 op/s 2024-06-06T08:47:22.057 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-06-06T08:47:22.057 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:22.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1429, 2024-06-06T08:47:22.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 3092, 2024-06-06T08:47:22.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 536456, 2024-06-06T08:47:22.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 1620539, 2024-06-06T08:47:22.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 16, 2024-06-06T08:47:22.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 3, 2024-06-06T08:47:22.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.105181323, 2024-06-06T08:47:22.059 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.050511845, 2024-06-06T08:47:22.059 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.062110019, 2024-06-06T08:47:22.059 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.003940471, 2024-06-06T08:47:22.059 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:22.059 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3091, 2024-06-06T08:47:22.059 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.095116271, 2024-06-06T08:47:22.059 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000030772 2024-06-06T08:47:22.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.059 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:22.060 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1752, 2024-06-06T08:47:22.060 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000794399, 2024-06-06T08:47:22.060 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000453 2024-06-06T08:47:22.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-06T08:47:22.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 448 2024-06-06T08:47:22.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.061 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:22.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 193, 2024-06-06T08:47:22.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 292, 2024-06-06T08:47:22.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 75071, 2024-06-06T08:47:22.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 3021819, 2024-06-06T08:47:22.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 10, 2024-06-06T08:47:22.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 7, 2024-06-06T08:47:22.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.028011414, 2024-06-06T08:47:22.062 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.013476380, 2024-06-06T08:47:22.062 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.007332705, 2024-06-06T08:47:22.062 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.005527761, 2024-06-06T08:47:22.062 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:22.062 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 290, 2024-06-06T08:47:22.062 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.033521599, 2024-06-06T08:47:22.062 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000115591 2024-06-06T08:47:22.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.063 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:22.063 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 30, 2024-06-06T08:47:22.063 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000007698, 2024-06-06T08:47:22.063 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000256 2024-06-06T08:47:22.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.063 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T08:47:22.063 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 238768 2024-06-06T08:47:22.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.064 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:22.064 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1477, 2024-06-06T08:47:22.064 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2570, 2024-06-06T08:47:22.064 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1787095, 2024-06-06T08:47:22.064 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 826379, 2024-06-06T08:47:22.064 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 8, 2024-06-06T08:47:22.064 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 5, 2024-06-06T08:47:22.064 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.159601605, 2024-06-06T08:47:22.065 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.073490035, 2024-06-06T08:47:22.065 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.088074448, 2024-06-06T08:47:22.065 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.008003790, 2024-06-06T08:47:22.065 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:22.065 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2569, 2024-06-06T08:47:22.065 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.110147285, 2024-06-06T08:47:22.065 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000042875 2024-06-06T08:47:22.065 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.066 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:22.066 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3357, 2024-06-06T08:47:22.066 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000748941, 2024-06-06T08:47:22.066 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000223 2024-06-06T08:47:22.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.066 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 543424, 2024-06-06T08:47:22.066 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 86224 2024-06-06T08:47:22.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.067 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-06-06T08:47:22.067 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-06-06T08:47:22.067 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-06-06T08:47:22.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.067 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-06-06T08:47:22.067 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-06-06T08:47:22.068 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-06-06T08:47:22.068 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 151, 2024-06-06T08:47:22.068 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.404203868, 2024-06-06T08:47:22.068 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.002676846 2024-06-06T08:47:22.068 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:22.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.068 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-06-06T08:47:22.068 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-06-06T08:47:22.069 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-06-06T08:47:22.069 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 485, 2024-06-06T08:47:22.069 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.025564445, 2024-06-06T08:47:22.069 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000052710 2024-06-06T08:47:22.069 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:22.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.069 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-06-06T08:47:22.069 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 775, 2024-06-06T08:47:22.070 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 774, 2024-06-06T08:47:22.070 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-06-06T08:47:22.070 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 774, 2024-06-06T08:47:22.070 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.781641054, 2024-06-06T08:47:22.070 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.001009872 2024-06-06T08:47:22.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.070 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-06-06T08:47:22.071 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 1, 2024-06-06T08:47:22.071 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-06-06T08:47:22.071 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-06-06T08:47:22.071 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 11, 2024-06-06T08:47:22.071 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 0, 2024-06-06T08:47:22.071 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-06-06T08:47:22.071 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 931, 2024-06-06T08:47:22.071 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 2, 2024-06-06T08:47:22.072 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 929, 2024-06-06T08:47:22.072 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 0, 2024-06-06T08:47:22.072 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 928, 2024-06-06T08:47:22.072 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 0, 2024-06-06T08:47:22.072 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 64, 2024-06-06T08:47:22.072 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 64, 2024-06-06T08:47:22.072 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 38, 2024-06-06T08:47:22.073 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 1557, 2024-06-06T08:47:22.073 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 1025, 2024-06-06T08:47:22.073 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 0, 2024-06-06T08:47:22.073 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 12, 2024-06-06T08:47:22.073 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-06-06T08:47:22.073 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-06-06T08:47:22.073 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 0, 2024-06-06T08:47:22.073 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 970, 2024-06-06T08:47:22.074 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-06-06T08:47:22.074 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 0, 2024-06-06T08:47:22.074 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 0, 2024-06-06T08:47:22.074 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 35, 2024-06-06T08:47:22.074 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 906, 2024-06-06T08:47:22.074 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-06-06T08:47:22.074 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-06-06T08:47:22.075 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-06-06T08:47:22.075 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 4, 2024-06-06T08:47:22.075 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 234, 2024-06-06T08:47:22.075 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-06-06T08:47:22.075 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T08:47:22.075 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-06-06T08:47:22.075 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T08:47:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-06-06T08:47:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-06-06T08:47:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T08:47:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T08:47:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-06-06T08:47:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 0, 2024-06-06T08:47:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 1, 2024-06-06T08:47:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 514, 2024-06-06T08:47:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T08:47:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T08:47:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T08:47:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 470, 2024-06-06T08:47:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 432, 2024-06-06T08:47:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 12, 2024-06-06T08:47:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 513 2024-06-06T08:47:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-06-06T08:47:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-06-06T08:47:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-06-06T08:47:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-06-06T08:47:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 12, 2024-06-06T08:47:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 34, 2024-06-06T08:47:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 0, 2024-06-06T08:47:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-06-06T08:47:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-06-06T08:47:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 255, 2024-06-06T08:47:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 255, 2024-06-06T08:47:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 0, 2024-06-06T08:47:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-06-06T08:47:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-06-06T08:47:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-06-06T08:47:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-06-06T08:47:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-06-06T08:47:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-06-06T08:47:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-06-06T08:47:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-06-06T08:47:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T08:47:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 0, 2024-06-06T08:47:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-06-06T08:47:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 0, 2024-06-06T08:47:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-06-06T08:47:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0 2024-06-06T08:47:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-06-06T08:47:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-06-06T08:47:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 1652, 2024-06-06T08:47:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-06-06T08:47:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-06-06T08:47:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 1652, 2024-06-06T08:47:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-06-06T08:47:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-06-06T08:47:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 3, 2024-06-06T08:47:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-06-06T08:47:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-06-06T08:47:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 3, 2024-06-06T08:47:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 2, 2024-06-06T08:47:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-06-06T08:47:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-06-06T08:47:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-06-06T08:47:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 6888980, 2024-06-06T08:47:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 0, 2024-06-06T08:47:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-06-06T08:47:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 50, 2024-06-06T08:47:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.259140251, 2024-06-06T08:47:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.005182805 2024-06-06T08:47:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 0 2024-06-06T08:47:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-06-06T08:47:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 714, 2024-06-06T08:47:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 969, 2024-06-06T08:47:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 255, 2024-06-06T08:47:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 56, 2024-06-06T08:47:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 57, 2024-06-06T08:47:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 1, 2024-06-06T08:47:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 931, 2024-06-06T08:47:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 1186, 2024-06-06T08:47:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 255, 2024-06-06T08:47:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 64, 2024-06-06T08:47:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 950, 2024-06-06T08:47:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 886, 2024-06-06T08:47:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 63084, 2024-06-06T08:47:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 223612 2024-06-06T08:47:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-06-06T08:47:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 1290, 2024-06-06T08:47:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 0, 2024-06-06T08:47:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 775, 2024-06-06T08:47:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 3, 2024-06-06T08:47:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 512, 2024-06-06T08:47:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-06-06T08:47:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 256, 2024-06-06T08:47:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.277821737, 2024-06-06T08:47:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.001085241 2024-06-06T08:47:22.089 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.089 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-06-06T08:47:22.089 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1, 2024-06-06T08:47:22.089 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000952455, 2024-06-06T08:47:22.089 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000952455 2024-06-06T08:47:22.089 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.089 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-06-06T08:47:22.090 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.090 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.090 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.090 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.090 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-06-06T08:47:22.090 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.090 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.090 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.091 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-06-06T08:47:22.091 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 260, 2024-06-06T08:47:22.091 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.089275038, 2024-06-06T08:47:22.091 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000343365 2024-06-06T08:47:22.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.092 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-06-06T08:47:22.092 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.092 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.092 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.092 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.092 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-06-06T08:47:22.092 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1, 2024-06-06T08:47:22.092 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000272610, 2024-06-06T08:47:22.093 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000272610 2024-06-06T08:47:22.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.093 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-06-06T08:47:22.093 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.093 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.093 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.093 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-06-06T08:47:22.094 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.094 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.094 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.094 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-06-06T08:47:22.094 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.094 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.094 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.095 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.095 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-06-06T08:47:22.095 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.095 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.096 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.096 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-06-06T08:47:22.096 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.096 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.096 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.097 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-06-06T08:47:22.097 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.097 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.097 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.097 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-06-06T08:47:22.097 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.098 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.098 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.098 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-06-06T08:47:22.098 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.098 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.098 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.099 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-06-06T08:47:22.099 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1, 2024-06-06T08:47:22.099 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.002154685, 2024-06-06T08:47:22.099 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.002154685 2024-06-06T08:47:22.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.099 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-06-06T08:47:22.099 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.099 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.100 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.100 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-06-06T08:47:22.100 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.100 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.100 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.100 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-06-06T08:47:22.100 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.101 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.101 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.101 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.101 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-06-06T08:47:22.101 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.101 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.101 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.102 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.102 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-06-06T08:47:22.102 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.102 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.102 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.102 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.102 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-06-06T08:47:22.103 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.103 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.103 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.103 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-06-06T08:47:22.103 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.103 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.103 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.104 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-06-06T08:47:22.104 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.104 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.104 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.104 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.104 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-06-06T08:47:22.104 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.104 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.105 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.105 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.105 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-06-06T08:47:22.105 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.105 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.105 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.105 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.106 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-06-06T08:47:22.106 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.106 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.106 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.106 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.106 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-06-06T08:47:22.106 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.106 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.107 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.107 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.107 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-06-06T08:47:22.107 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 255, 2024-06-06T08:47:22.107 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.411164529, 2024-06-06T08:47:22.107 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.001612409 2024-06-06T08:47:22.107 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.108 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-06-06T08:47:22.108 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-06-06T08:47:22.108 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-06-06T08:47:22.108 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.108 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.108 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.108 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:22.109 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.109 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-06-06T08:47:22.109 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 1, 2024-06-06T08:47:22.109 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 1, 2024-06-06T08:47:22.109 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 0, 2024-06-06T08:47:22.109 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-06-06T08:47:22.109 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-06-06T08:47:22.109 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 508, 2024-06-06T08:47:22.110 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 508, 2024-06-06T08:47:22.110 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 185, 2024-06-06T08:47:22.110 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-06-06T08:47:22.110 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.110 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-06-06T08:47:22.110 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:22.111 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:22.111 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:22.111 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:22.111 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:22.111 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:22.111 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:22.111 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:22.111 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:22.112 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:22.112 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:22.112 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:22.112 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:22.112 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:22.112 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:22.112 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:22.112 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:22.113 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:22.113 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:22.113 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:22.113 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:22.113 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:22.113 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:22.113 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:22.114 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:22.114 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:22.114 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:22.114 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:22.114 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:22.114 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:22.114 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:22.115 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-06-06T08:47:22.115 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:22.115 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:22.115 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:22.115 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:22.115 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 334687, 2024-06-06T08:47:22.115 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 830, 2024-06-06T08:47:22.116 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 880, 2024-06-06T08:47:22.116 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 10, 2024-06-06T08:47:22.116 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-06-06T08:47:22.116 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-06-06T08:47:22.116 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:22.116 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:22.116 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:22.116 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:22.117 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 8016, 2024-06-06T08:47:22.117 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 169, 2024-06-06T08:47:22.117 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:22.117 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:22.117 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:22.117 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-06-06T08:47:22.117 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 2434920, 2024-06-06T08:47:22.118 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 27105, 2024-06-06T08:47:22.118 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:22.118 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-06-06T08:47:22.118 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:22.118 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-06-06T08:47:22.118 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.118 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-06-06T08:47:22.119 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-06-06T08:47:22.119 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-06-06T08:47:22.119 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 393, 2024-06-06T08:47:22.119 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 2782472, 2024-06-06T08:47:22.119 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 28, 2024-06-06T08:47:22.119 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 393, 2024-06-06T08:47:22.119 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-06-06T08:47:22.119 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 393, 2024-06-06T08:47:22.120 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 1.630978889, 2024-06-06T08:47:22.120 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.004150073 2024-06-06T08:47:22.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.120 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-06-06T08:47:22.120 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-06-06T08:47:22.120 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 393, 2024-06-06T08:47:22.120 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 437 2024-06-06T08:47:22.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.121 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 393, 2024-06-06T08:47:22.121 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 9, 2024-06-06T08:47:22.121 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 384, 2024-06-06T08:47:22.121 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-06-06T08:47:22.121 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-06-06T08:47:22.121 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 0, 2024-06-06T08:47:22.121 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 10, 2024-06-06T08:47:22.122 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 9, 2024-06-06T08:47:22.122 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 59, 2024-06-06T08:47:22.122 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 14, 2024-06-06T08:47:22.122 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-06-06T08:47:22.122 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-06-06T08:47:22.122 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-06-06T08:47:22.122 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 0, 2024-06-06T08:47:22.123 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 267, 2024-06-06T08:47:22.123 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-06-06T08:47:22.123 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-06-06T08:47:22.123 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-06-06T08:47:22.123 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 0, 2024-06-06T08:47:22.123 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 20, 2024-06-06T08:47:22.123 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-06-06T08:47:22.124 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-06-06T08:47:22.124 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-06-06T08:47:22.124 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-06-06T08:47:22.124 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-06-06T08:47:22.124 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-06-06T08:47:22.124 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T08:47:22.124 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-06-06T08:47:22.125 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-06-06T08:47:22.125 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 0, 2024-06-06T08:47:22.125 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-06-06T08:47:22.125 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-06-06T08:47:22.125 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-06-06T08:47:22.125 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-06-06T08:47:22.125 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-06-06T08:47:22.125 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-06-06T08:47:22.126 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-06-06T08:47:22.126 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-06-06T08:47:22.126 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-06-06T08:47:22.126 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-06-06T08:47:22.126 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-06-06T08:47:22.126 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-06-06T08:47:22.127 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-06-06T08:47:22.127 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-06-06T08:47:22.127 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-06-06T08:47:22.127 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-06-06T08:47:22.127 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 92, 2024-06-06T08:47:22.127 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-06-06T08:47:22.127 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 4, 2024-06-06T08:47:22.127 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 12, 2024-06-06T08:47:22.127 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 12, 2024-06-06T08:47:22.127 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 0, 2024-06-06T08:47:22.128 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-06-06T08:47:22.128 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 51, 2024-06-06T08:47:22.128 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 0, 2024-06-06T08:47:22.128 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 7 2024-06-06T08:47:22.128 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.128 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-06-06T08:47:22.128 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 1, 2024-06-06T08:47:22.129 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-06-06T08:47:22.129 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-06-06T08:47:22.129 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-06-06T08:47:22.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.129 INFO:teuthology.orchestra.run.smithi037.stdout: "osd-slow-ops": { 2024-06-06T08:47:22.129 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-06-06T08:47:22.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.129 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-06-06T08:47:22.130 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-06-06T08:47:22.130 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 6, 2024-06-06T08:47:22.130 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-06-06T08:47:22.130 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 6, 2024-06-06T08:47:22.130 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 255, 2024-06-06T08:47:22.130 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 255, 2024-06-06T08:47:22.130 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-06-06T08:47:22.131 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.131 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:22.131 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:22.131 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-06-06T08:47:22.131 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:22.131 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 3095, 2024-06-06T08:47:22.131 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 2128146, 2024-06-06T08:47:22.131 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:22.132 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 3095, 2024-06-06T08:47:22.132 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:22.132 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:22.132 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3095, 2024-06-06T08:47:22.132 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 2128146, 2024-06-06T08:47:22.132 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:22.132 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.133 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.133 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.133 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:22.133 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.133 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-06-06T08:47:22.133 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:22.133 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-06-06T08:47:22.134 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:22.134 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-06-06T08:47:22.134 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-06-06T08:47:22.134 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:22.134 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:22.134 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 393, 2024-06-06T08:47:22.134 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 2808227, 2024-06-06T08:47:22.135 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 393, 2024-06-06T08:47:22.135 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 2808227, 2024-06-06T08:47:22.135 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:22.135 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.135 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.135 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.135 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:22.135 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.136 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-06-06T08:47:22.136 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:22.136 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-06-06T08:47:22.136 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:22.136 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-06-06T08:47:22.136 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-06-06T08:47:22.136 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:22.137 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:22.137 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 393, 2024-06-06T08:47:22.137 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 393, 2024-06-06T08:47:22.137 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 393, 2024-06-06T08:47:22.137 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 393, 2024-06-06T08:47:22.137 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:22.137 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.137 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.138 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.138 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:22.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.138 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-06-06T08:47:22.138 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:22.138 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-06-06T08:47:22.138 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:22.138 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 255, 2024-06-06T08:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 25755, 2024-06-06T08:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 255, 2024-06-06T08:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 9, 2024-06-06T08:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 25755, 2024-06-06T08:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.140 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.140 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.140 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:22.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:22.140 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x560b21106460": { 2024-06-06T08:47:22.140 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:22.141 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-06-06T08:47:22.141 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:22.141 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 1652, 2024-06-06T08:47:22.141 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 2694676, 2024-06-06T08:47:22.141 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:22.141 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 1652, 2024-06-06T08:47:22.141 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:22.142 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:22.142 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 50, 2024-06-06T08:47:22.142 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 2694676, 2024-06-06T08:47:22.142 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:22.142 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:22.142 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:22.142 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:22.142 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:22.143 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:22.143 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-06-06T08:47:22.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:21 smithi028 ceph-mon[31564]: pgmap v552: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 20 op/s 2024-06-06T08:47:22.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:21 smithi037 ceph-mon[36609]: pgmap v552: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 20 op/s 2024-06-06T08:47:22.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:21 smithi059 ceph-mon[36684]: pgmap v552: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 20 op/s 2024-06-06T08:47:22.871 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-06-06T08:47:22.871 INFO:tasks.check_counter:Daemon mds.e mds.imported=35 2024-06-06T08:47:22.871 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-06-06T08:47:22.871 DEBUG:tasks.check_counter:Getting stats from h 2024-06-06T08:47:22.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.h perf dump 2024-06-06T08:47:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:47:24.276 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:24 smithi037 ceph-mon[36609]: pgmap v553: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 72 KiB/s wr, 18 op/s 2024-06-06T08:47:24.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:24 smithi028 ceph-mon[31564]: pgmap v553: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 72 KiB/s wr, 18 op/s 2024-06-06T08:47:24.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:24 smithi059 ceph-mon[36684]: pgmap v553: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 72 KiB/s wr, 18 op/s 2024-06-06T08:47:24.902 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-06-06T08:47:24.903 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:24.903 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1692, 2024-06-06T08:47:24.903 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 3252, 2024-06-06T08:47:24.903 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 2038463, 2024-06-06T08:47:24.903 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 5354266, 2024-06-06T08:47:24.903 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 11, 2024-06-06T08:47:24.903 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 5, 2024-06-06T08:47:24.904 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.180261426, 2024-06-06T08:47:24.904 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.086533493, 2024-06-06T08:47:24.904 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.084180427, 2024-06-06T08:47:24.904 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.012283962, 2024-06-06T08:47:24.904 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:24.904 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3250, 2024-06-06T08:47:24.904 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.258631106, 2024-06-06T08:47:24.904 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000079578 2024-06-06T08:47:24.905 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.905 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:24.905 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 4151, 2024-06-06T08:47:24.905 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000887543, 2024-06-06T08:47:24.905 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000213 2024-06-06T08:47:24.905 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.905 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T08:47:24.905 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T08:47:24.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.906 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:24.906 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 490, 2024-06-06T08:47:24.906 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 497, 2024-06-06T08:47:24.906 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 836236, 2024-06-06T08:47:24.906 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 581390, 2024-06-06T08:47:24.906 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 16, 2024-06-06T08:47:24.906 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 5, 2024-06-06T08:47:24.907 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.043185425, 2024-06-06T08:47:24.907 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.015303778, 2024-06-06T08:47:24.907 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.034789327, 2024-06-06T08:47:24.907 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.003266691, 2024-06-06T08:47:24.907 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:24.907 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 497, 2024-06-06T08:47:24.907 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.051047499, 2024-06-06T08:47:24.907 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000102711 2024-06-06T08:47:24.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.908 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:24.908 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 557, 2024-06-06T08:47:24.908 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000104496, 2024-06-06T08:47:24.908 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000187 2024-06-06T08:47:24.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.908 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 2096, 2024-06-06T08:47:24.908 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 321696 2024-06-06T08:47:24.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.909 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:24.909 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 3228, 2024-06-06T08:47:24.909 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 6012, 2024-06-06T08:47:24.909 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1597167, 2024-06-06T08:47:24.909 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 3237145, 2024-06-06T08:47:24.909 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 9, 2024-06-06T08:47:24.909 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 7, 2024-06-06T08:47:24.910 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.195931628, 2024-06-06T08:47:24.910 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.093959973, 2024-06-06T08:47:24.910 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.124970910, 2024-06-06T08:47:24.910 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.008767291, 2024-06-06T08:47:24.910 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:24.910 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 6010, 2024-06-06T08:47:24.910 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.175307154, 2024-06-06T08:47:24.911 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000029169 2024-06-06T08:47:24.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.911 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:24.911 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3150, 2024-06-06T08:47:24.911 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.001128735, 2024-06-06T08:47:24.911 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000358 2024-06-06T08:47:24.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.911 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 555840, 2024-06-06T08:47:24.912 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 86192 2024-06-06T08:47:24.912 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.912 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-06-06T08:47:24.912 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-06-06T08:47:24.912 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-06-06T08:47:24.912 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.912 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-06-06T08:47:24.912 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-06-06T08:47:24.913 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-06-06T08:47:24.913 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 222, 2024-06-06T08:47:24.913 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.806296965, 2024-06-06T08:47:24.913 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.003631968 2024-06-06T08:47:24.913 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:24.913 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.913 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-06-06T08:47:24.913 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-06-06T08:47:24.914 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-06-06T08:47:24.914 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 825, 2024-06-06T08:47:24.914 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.052971967, 2024-06-06T08:47:24.914 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000064208 2024-06-06T08:47:24.914 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:24.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.914 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-06-06T08:47:24.915 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 1692, 2024-06-06T08:47:24.915 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 1689, 2024-06-06T08:47:24.915 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-06-06T08:47:24.915 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1689, 2024-06-06T08:47:24.915 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 1.513441908, 2024-06-06T08:47:24.915 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000896057 2024-06-06T08:47:24.915 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.915 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-06-06T08:47:24.916 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 3, 2024-06-06T08:47:24.916 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-06-06T08:47:24.916 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-06-06T08:47:24.916 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 11, 2024-06-06T08:47:24.916 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 0, 2024-06-06T08:47:24.916 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-06-06T08:47:24.916 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 2642, 2024-06-06T08:47:24.916 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 13, 2024-06-06T08:47:24.917 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 2629, 2024-06-06T08:47:24.917 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 0, 2024-06-06T08:47:24.917 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 2602, 2024-06-06T08:47:24.917 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 0, 2024-06-06T08:47:24.917 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 356, 2024-06-06T08:47:24.917 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 356, 2024-06-06T08:47:24.917 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 77, 2024-06-06T08:47:24.917 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 3392, 2024-06-06T08:47:24.918 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 2697, 2024-06-06T08:47:24.918 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 1, 2024-06-06T08:47:24.918 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 10, 2024-06-06T08:47:24.918 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-06-06T08:47:24.918 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-06-06T08:47:24.918 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 0, 2024-06-06T08:47:24.918 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 993, 2024-06-06T08:47:24.919 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-06-06T08:47:24.919 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 0, 2024-06-06T08:47:24.919 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 0, 2024-06-06T08:47:24.919 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 55, 2024-06-06T08:47:24.919 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 2619, 2024-06-06T08:47:24.919 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-06-06T08:47:24.919 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-06-06T08:47:24.919 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-06-06T08:47:24.919 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 4, 2024-06-06T08:47:24.920 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 234, 2024-06-06T08:47:24.920 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-06-06T08:47:24.920 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T08:47:24.920 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-06-06T08:47:24.920 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T08:47:24.920 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-06-06T08:47:24.920 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-06-06T08:47:24.921 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T08:47:24.921 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T08:47:24.921 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-06-06T08:47:24.921 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 0, 2024-06-06T08:47:24.921 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 6, 2024-06-06T08:47:24.921 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 670, 2024-06-06T08:47:24.921 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T08:47:24.921 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T08:47:24.922 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T08:47:24.922 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 1117, 2024-06-06T08:47:24.922 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 1111, 2024-06-06T08:47:24.922 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 16, 2024-06-06T08:47:24.922 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 880 2024-06-06T08:47:24.922 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.922 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-06-06T08:47:24.923 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-06-06T08:47:24.923 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-06-06T08:47:24.923 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-06-06T08:47:24.923 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 214, 2024-06-06T08:47:24.923 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 0, 2024-06-06T08:47:24.923 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 0, 2024-06-06T08:47:24.923 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-06-06T08:47:24.923 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-06-06T08:47:24.924 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 438, 2024-06-06T08:47:24.924 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 438, 2024-06-06T08:47:24.924 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 0, 2024-06-06T08:47:24.924 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-06-06T08:47:24.924 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-06-06T08:47:24.924 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-06-06T08:47:24.924 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-06-06T08:47:24.924 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-06-06T08:47:24.925 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-06-06T08:47:24.925 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-06-06T08:47:24.925 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-06-06T08:47:24.925 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T08:47:24.925 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 0, 2024-06-06T08:47:24.925 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-06-06T08:47:24.925 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 0, 2024-06-06T08:47:24.925 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-06-06T08:47:24.926 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0 2024-06-06T08:47:24.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.926 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-06-06T08:47:24.926 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-06-06T08:47:24.926 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 2844, 2024-06-06T08:47:24.926 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-06-06T08:47:24.926 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-06-06T08:47:24.926 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 2844, 2024-06-06T08:47:24.927 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-06-06T08:47:24.927 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-06-06T08:47:24.927 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 5, 2024-06-06T08:47:24.927 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-06-06T08:47:24.927 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-06-06T08:47:24.927 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 5, 2024-06-06T08:47:24.927 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 2, 2024-06-06T08:47:24.927 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-06-06T08:47:24.928 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-06-06T08:47:24.928 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-06-06T08:47:24.928 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 9285485, 2024-06-06T08:47:24.928 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 0, 2024-06-06T08:47:24.928 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-06-06T08:47:24.928 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 83, 2024-06-06T08:47:24.928 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.410200470, 2024-06-06T08:47:24.928 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.004942174 2024-06-06T08:47:24.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.929 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 0 2024-06-06T08:47:24.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.929 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-06-06T08:47:24.929 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1936, 2024-06-06T08:47:24.929 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 2374, 2024-06-06T08:47:24.929 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 438, 2024-06-06T08:47:24.929 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 198, 2024-06-06T08:47:24.930 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 199, 2024-06-06T08:47:24.930 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 1, 2024-06-06T08:47:24.930 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 2642, 2024-06-06T08:47:24.930 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 3082, 2024-06-06T08:47:24.930 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 440, 2024-06-06T08:47:24.930 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 356, 2024-06-06T08:47:24.930 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 1722, 2024-06-06T08:47:24.930 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 1366, 2024-06-06T08:47:24.930 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 70224, 2024-06-06T08:47:24.931 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 223612 2024-06-06T08:47:24.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.931 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-06-06T08:47:24.931 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 2367, 2024-06-06T08:47:24.931 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 4, 2024-06-06T08:47:24.931 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 1692, 2024-06-06T08:47:24.931 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 6, 2024-06-06T08:47:24.931 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 675, 2024-06-06T08:47:24.932 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-06-06T08:47:24.932 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 229, 2024-06-06T08:47:24.932 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.340705845, 2024-06-06T08:47:24.932 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.001487798 2024-06-06T08:47:24.932 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.932 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-06-06T08:47:24.932 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 4, 2024-06-06T08:47:24.932 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.006122603, 2024-06-06T08:47:24.933 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.001530650 2024-06-06T08:47:24.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.933 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-06-06T08:47:24.933 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.933 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.933 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.933 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-06-06T08:47:24.934 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.934 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.934 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.934 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.934 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-06-06T08:47:24.934 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1015, 2024-06-06T08:47:24.934 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.358975908, 2024-06-06T08:47:24.934 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000353670 2024-06-06T08:47:24.935 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.935 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-06-06T08:47:24.935 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.935 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.935 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.935 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.935 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-06-06T08:47:24.935 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.936 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.936 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.936 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-06-06T08:47:24.936 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.936 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.936 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.936 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-06-06T08:47:24.937 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.937 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.937 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.937 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.937 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-06-06T08:47:24.937 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.937 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.937 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.938 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.938 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-06-06T08:47:24.938 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.938 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.939 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.939 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.939 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-06-06T08:47:24.939 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.939 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.939 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.940 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.940 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-06-06T08:47:24.940 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.940 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.940 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.940 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.940 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-06-06T08:47:24.940 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.941 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.941 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.941 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.941 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-06-06T08:47:24.941 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1, 2024-06-06T08:47:24.941 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000463115, 2024-06-06T08:47:24.941 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000463115 2024-06-06T08:47:24.941 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.942 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-06-06T08:47:24.942 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2, 2024-06-06T08:47:24.942 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.001592162, 2024-06-06T08:47:24.942 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000796081 2024-06-06T08:47:24.942 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.942 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-06-06T08:47:24.942 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.943 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.943 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.943 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-06-06T08:47:24.943 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.943 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.943 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.944 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-06-06T08:47:24.944 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.944 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.944 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.944 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.944 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-06-06T08:47:24.944 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.945 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.945 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.945 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-06-06T08:47:24.945 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.945 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.945 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.946 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-06-06T08:47:24.946 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.946 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.946 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.946 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-06-06T08:47:24.946 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.947 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.947 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.947 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-06-06T08:47:24.947 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.947 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.947 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.948 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-06-06T08:47:24.948 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.948 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.948 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.948 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.948 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-06-06T08:47:24.948 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.949 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.949 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.949 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.949 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-06-06T08:47:24.949 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.949 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.949 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.950 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.950 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-06-06T08:47:24.950 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.950 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.950 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.950 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.950 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-06-06T08:47:24.951 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 438, 2024-06-06T08:47:24.951 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.805582275, 2024-06-06T08:47:24.951 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.001839228 2024-06-06T08:47:24.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.951 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-06-06T08:47:24.951 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-06-06T08:47:24.951 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-06-06T08:47:24.951 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.952 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.952 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.952 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:24.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.952 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-06-06T08:47:24.952 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 1, 2024-06-06T08:47:24.953 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 2, 2024-06-06T08:47:24.953 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 1, 2024-06-06T08:47:24.953 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-06-06T08:47:24.953 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-06-06T08:47:24.953 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 1066, 2024-06-06T08:47:24.953 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 1066, 2024-06-06T08:47:24.953 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 1818, 2024-06-06T08:47:24.953 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-06-06T08:47:24.954 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.954 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-06-06T08:47:24.954 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:24.954 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:24.954 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:24.954 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:24.954 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:24.955 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:24.955 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:24.955 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:24.955 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:24.955 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:24.955 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:24.955 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:24.955 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:24.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:24.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:24.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:24.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:24.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:24.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:24.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:24.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:24.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:24.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:24.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:24.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:24.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:24.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:24.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:24.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:24.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:24.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:24.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-06-06T08:47:24.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:24.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:24.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:24.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:24.959 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 372248, 2024-06-06T08:47:24.959 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 2040, 2024-06-06T08:47:24.959 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-06-06T08:47:24.959 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-06-06T08:47:24.959 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-06-06T08:47:24.959 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-06-06T08:47:24.959 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:24.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:24.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:24.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:24.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 8016, 2024-06-06T08:47:24.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 169, 2024-06-06T08:47:24.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:24.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:24.960 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:24.961 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-06-06T08:47:24.961 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 6797121, 2024-06-06T08:47:24.961 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 71681, 2024-06-06T08:47:24.961 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:24.961 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-06-06T08:47:24.961 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:24.961 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-06-06T08:47:24.961 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.962 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-06-06T08:47:24.962 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-06-06T08:47:24.962 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-06-06T08:47:24.962 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 621, 2024-06-06T08:47:24.962 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 5217681, 2024-06-06T08:47:24.962 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 33, 2024-06-06T08:47:24.962 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 621, 2024-06-06T08:47:24.962 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-06-06T08:47:24.963 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 621, 2024-06-06T08:47:24.963 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 2.202971406, 2024-06-06T08:47:24.963 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.003547457 2024-06-06T08:47:24.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.963 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-06-06T08:47:24.963 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-06-06T08:47:24.963 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 621, 2024-06-06T08:47:24.964 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 668 2024-06-06T08:47:24.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.964 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 621, 2024-06-06T08:47:24.964 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 12, 2024-06-06T08:47:24.964 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 609, 2024-06-06T08:47:24.964 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-06-06T08:47:24.964 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-06-06T08:47:24.964 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 0, 2024-06-06T08:47:24.965 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 10, 2024-06-06T08:47:24.965 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 12, 2024-06-06T08:47:24.965 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 95, 2024-06-06T08:47:24.965 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 16, 2024-06-06T08:47:24.965 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-06-06T08:47:24.965 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-06-06T08:47:24.965 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-06-06T08:47:24.965 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 0, 2024-06-06T08:47:24.966 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 451, 2024-06-06T08:47:24.966 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-06-06T08:47:24.966 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-06-06T08:47:24.966 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-06-06T08:47:24.966 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 0, 2024-06-06T08:47:24.966 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 20, 2024-06-06T08:47:24.966 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-06-06T08:47:24.966 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-06-06T08:47:24.967 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-06-06T08:47:24.967 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-06-06T08:47:24.967 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-06-06T08:47:24.967 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-06-06T08:47:24.967 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T08:47:24.967 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-06-06T08:47:24.967 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-06-06T08:47:24.967 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 0, 2024-06-06T08:47:24.967 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-06-06T08:47:24.968 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-06-06T08:47:24.968 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-06-06T08:47:24.968 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-06-06T08:47:24.968 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-06-06T08:47:24.968 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-06-06T08:47:24.968 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-06-06T08:47:24.968 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-06-06T08:47:24.968 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-06-06T08:47:24.969 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-06-06T08:47:24.969 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-06-06T08:47:24.969 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-06-06T08:47:24.969 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-06-06T08:47:24.969 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-06-06T08:47:24.969 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-06-06T08:47:24.969 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-06-06T08:47:24.969 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 92, 2024-06-06T08:47:24.970 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-06-06T08:47:24.970 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 4, 2024-06-06T08:47:24.970 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 12, 2024-06-06T08:47:24.970 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 12, 2024-06-06T08:47:24.973 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 0, 2024-06-06T08:47:24.973 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-06-06T08:47:24.973 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 56, 2024-06-06T08:47:24.974 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 0, 2024-06-06T08:47:24.974 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 8 2024-06-06T08:47:24.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.974 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-06-06T08:47:24.974 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 1, 2024-06-06T08:47:24.974 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-06-06T08:47:24.974 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-06-06T08:47:24.975 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-06-06T08:47:24.975 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.975 INFO:teuthology.orchestra.run.smithi037.stdout: "osd-slow-ops": { 2024-06-06T08:47:24.975 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-06-06T08:47:24.975 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.975 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-06-06T08:47:24.975 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-06-06T08:47:24.975 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 6, 2024-06-06T08:47:24.976 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-06-06T08:47:24.976 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 6, 2024-06-06T08:47:24.976 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 438, 2024-06-06T08:47:24.976 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 438, 2024-06-06T08:47:24.976 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-06-06T08:47:24.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.976 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:24.976 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:24.977 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-06-06T08:47:24.977 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:24.977 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 5406, 2024-06-06T08:47:24.977 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 4017807, 2024-06-06T08:47:24.977 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:24.977 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 5406, 2024-06-06T08:47:24.977 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:24.977 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:24.978 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 5406, 2024-06-06T08:47:24.978 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 4017807, 2024-06-06T08:47:24.978 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:24.978 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.978 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.978 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.978 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:24.979 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.979 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-06-06T08:47:24.979 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:24.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-06-06T08:47:24.979 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:24.979 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-06-06T08:47:24.979 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-06-06T08:47:24.979 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:24.980 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:24.980 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 621, 2024-06-06T08:47:24.980 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 5261919, 2024-06-06T08:47:24.980 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 621, 2024-06-06T08:47:24.980 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 5261919, 2024-06-06T08:47:24.980 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:24.980 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.980 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.981 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.981 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:24.981 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.981 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-06-06T08:47:24.981 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:24.981 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-06-06T08:47:24.981 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:24.981 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-06-06T08:47:24.982 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-06-06T08:47:24.982 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:24.982 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:24.982 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 621, 2024-06-06T08:47:24.982 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 621, 2024-06-06T08:47:24.982 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 621, 2024-06-06T08:47:24.982 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 621, 2024-06-06T08:47:24.983 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:24.983 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.983 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.983 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.983 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:24.983 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.983 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-06-06T08:47:24.983 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:24.983 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-06-06T08:47:24.984 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:24.984 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 438, 2024-06-06T08:47:24.984 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 44238, 2024-06-06T08:47:24.984 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:24.984 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 438, 2024-06-06T08:47:24.984 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:24.984 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:24.984 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 12, 2024-06-06T08:47:24.985 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 44238, 2024-06-06T08:47:24.985 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:24.985 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.985 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.985 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.985 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:24.985 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:24.985 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x55bf4fca0460": { 2024-06-06T08:47:24.986 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:24.986 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-06-06T08:47:24.986 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:24.986 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 2844, 2024-06-06T08:47:24.986 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 5091181, 2024-06-06T08:47:24.986 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:24.986 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 2844, 2024-06-06T08:47:24.986 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:24.987 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:24.987 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 83, 2024-06-06T08:47:24.987 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 5091181, 2024-06-06T08:47:24.987 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:24.987 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:24.987 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:24.987 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:24.987 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:24.988 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:24.988 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-06-06T08:47:25.724 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-06-06T08:47:25.725 INFO:tasks.check_counter:Daemon mds.h mds.imported=55 2024-06-06T08:47:25.725 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-06-06T08:47:25.725 DEBUG:tasks.check_counter:Getting stats from k 2024-06-06T08:47:25.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.k perf dump 2024-06-06T08:47:25.970 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T08:47:26.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:26 smithi028 ceph-mon[31564]: pgmap v554: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-06-06T08:47:26.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:26 smithi037 ceph-mon[36609]: pgmap v554: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-06-06T08:47:26.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:26 smithi059 ceph-mon[36684]: pgmap v554: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-06-06T08:47:27.587 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-06-06T08:47:27.588 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:27.588 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1182, 2024-06-06T08:47:27.588 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1181, 2024-06-06T08:47:27.588 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 5429486, 2024-06-06T08:47:27.588 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 374741, 2024-06-06T08:47:27.588 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 6, 2024-06-06T08:47:27.588 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-06-06T08:47:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.100051116, 2024-06-06T08:47:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.030333935, 2024-06-06T08:47:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.028682234, 2024-06-06T08:47:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.032546078, 2024-06-06T08:47:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1180, 2024-06-06T08:47:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.041108322, 2024-06-06T08:47:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000034837 2024-06-06T08:47:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-06T08:47:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 448 2024-06-06T08:47:27.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.591 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:27.591 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 3, 2024-06-06T08:47:27.591 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 106, 2024-06-06T08:47:27.591 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 716, 2024-06-06T08:47:27.591 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 241786, 2024-06-06T08:47:27.591 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-06-06T08:47:27.592 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 3, 2024-06-06T08:47:27.592 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.007065961, 2024-06-06T08:47:27.592 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.004704646, 2024-06-06T08:47:27.592 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001028285, 2024-06-06T08:47:27.592 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000057283, 2024-06-06T08:47:27.592 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:27.592 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 104, 2024-06-06T08:47:27.592 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.007460887, 2024-06-06T08:47:27.593 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000071739 2024-06-06T08:47:27.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.593 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:27.593 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.593 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.593 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.594 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T08:47:27.594 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 241088 2024-06-06T08:47:27.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.594 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:27.594 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 158, 2024-06-06T08:47:27.594 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 147, 2024-06-06T08:47:27.594 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 527084, 2024-06-06T08:47:27.594 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 85406, 2024-06-06T08:47:27.595 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 3, 2024-06-06T08:47:27.595 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-06-06T08:47:27.595 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.025067720, 2024-06-06T08:47:27.595 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.008700545, 2024-06-06T08:47:27.595 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.014147468, 2024-06-06T08:47:27.596 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.003547657, 2024-06-06T08:47:27.596 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:27.596 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 146, 2024-06-06T08:47:27.596 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.009450914, 2024-06-06T08:47:27.596 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000064732 2024-06-06T08:47:27.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.596 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:27.597 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.597 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.597 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.597 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 526816, 2024-06-06T08:47:27.597 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 85088 2024-06-06T08:47:27.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.597 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-06-06T08:47:27.598 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-06-06T08:47:27.598 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-06-06T08:47:27.598 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.598 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-06-06T08:47:27.598 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-06-06T08:47:27.598 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-06-06T08:47:27.598 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2020, 2024-06-06T08:47:27.598 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.052874421, 2024-06-06T08:47:27.599 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000026175 2024-06-06T08:47:27.599 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:27.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.599 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-06-06T08:47:27.599 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-06-06T08:47:27.599 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-06-06T08:47:27.599 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.599 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.599 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.600 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:27.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.600 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-06-06T08:47:27.600 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 0, 2024-06-06T08:47:27.600 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 0, 2024-06-06T08:47:27.600 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-06-06T08:47:27.600 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.600 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.601 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.601 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-06-06T08:47:27.601 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 0, 2024-06-06T08:47:27.601 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-06-06T08:47:27.601 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-06-06T08:47:27.602 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 0, 2024-06-06T08:47:27.602 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 0, 2024-06-06T08:47:27.602 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-06-06T08:47:27.602 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 3074, 2024-06-06T08:47:27.602 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 30, 2024-06-06T08:47:27.603 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 3044, 2024-06-06T08:47:27.603 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 0, 2024-06-06T08:47:27.603 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 3032, 2024-06-06T08:47:27.603 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 0, 2024-06-06T08:47:27.604 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 0, 2024-06-06T08:47:27.604 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 0, 2024-06-06T08:47:27.604 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 77, 2024-06-06T08:47:27.604 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 0, 2024-06-06T08:47:27.605 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 0, 2024-06-06T08:47:27.605 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 0, 2024-06-06T08:47:27.606 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 0, 2024-06-06T08:47:27.606 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-06-06T08:47:27.606 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-06-06T08:47:27.606 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 0, 2024-06-06T08:47:27.607 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 0, 2024-06-06T08:47:27.607 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-06-06T08:47:27.607 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 0, 2024-06-06T08:47:27.607 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 0, 2024-06-06T08:47:27.607 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 0, 2024-06-06T08:47:27.607 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 0, 2024-06-06T08:47:27.607 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-06-06T08:47:27.608 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-06-06T08:47:27.608 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-06-06T08:47:27.609 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 0, 2024-06-06T08:47:27.609 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 0, 2024-06-06T08:47:27.609 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-06-06T08:47:27.609 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T08:47:27.609 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-06-06T08:47:27.609 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T08:47:27.609 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-06-06T08:47:27.609 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-06-06T08:47:27.610 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T08:47:27.610 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T08:47:27.610 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-06-06T08:47:27.610 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 0, 2024-06-06T08:47:27.610 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T08:47:27.610 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 0, 2024-06-06T08:47:27.610 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T08:47:27.610 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T08:47:27.611 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T08:47:27.611 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 0, 2024-06-06T08:47:27.611 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 0, 2024-06-06T08:47:27.611 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 0, 2024-06-06T08:47:27.611 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 0 2024-06-06T08:47:27.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.611 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-06-06T08:47:27.611 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-06-06T08:47:27.612 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-06-06T08:47:27.612 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-06-06T08:47:27.612 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 0, 2024-06-06T08:47:27.612 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 0, 2024-06-06T08:47:27.612 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 0, 2024-06-06T08:47:27.612 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-06-06T08:47:27.612 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-06-06T08:47:27.612 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 0, 2024-06-06T08:47:27.613 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 0, 2024-06-06T08:47:27.613 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 0, 2024-06-06T08:47:27.613 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-06-06T08:47:27.613 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-06-06T08:47:27.613 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-06-06T08:47:27.613 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-06-06T08:47:27.613 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-06-06T08:47:27.613 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-06-06T08:47:27.613 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-06-06T08:47:27.614 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-06-06T08:47:27.614 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T08:47:27.614 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 0, 2024-06-06T08:47:27.614 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-06-06T08:47:27.614 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 0, 2024-06-06T08:47:27.614 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-06-06T08:47:27.614 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0 2024-06-06T08:47:27.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.615 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-06-06T08:47:27.618 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-06-06T08:47:27.619 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 0, 2024-06-06T08:47:27.619 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-06-06T08:47:27.619 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-06-06T08:47:27.619 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 2844, 2024-06-06T08:47:27.619 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-06-06T08:47:27.619 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-06-06T08:47:27.619 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 0, 2024-06-06T08:47:27.619 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-06-06T08:47:27.620 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-06-06T08:47:27.620 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 5, 2024-06-06T08:47:27.620 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 2, 2024-06-06T08:47:27.620 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-06-06T08:47:27.620 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-06-06T08:47:27.620 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-06-06T08:47:27.620 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 9285485, 2024-06-06T08:47:27.620 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 9285424, 2024-06-06T08:47:27.620 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-06-06T08:47:27.621 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.621 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.621 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.621 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 2844 2024-06-06T08:47:27.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.621 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-06-06T08:47:27.621 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1929, 2024-06-06T08:47:27.622 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 2367, 2024-06-06T08:47:27.622 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 438, 2024-06-06T08:47:27.622 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 191, 2024-06-06T08:47:27.622 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 191, 2024-06-06T08:47:27.622 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 0, 2024-06-06T08:47:27.622 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 3074, 2024-06-06T08:47:27.622 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 3074, 2024-06-06T08:47:27.622 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 0, 2024-06-06T08:47:27.623 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 0, 2024-06-06T08:47:27.623 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 0, 2024-06-06T08:47:27.623 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 0, 2024-06-06T08:47:27.623 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 60668, 2024-06-06T08:47:27.623 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 215420 2024-06-06T08:47:27.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.623 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-06-06T08:47:27.623 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 0, 2024-06-06T08:47:27.623 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 0, 2024-06-06T08:47:27.624 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 0, 2024-06-06T08:47:27.624 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 0, 2024-06-06T08:47:27.624 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 0, 2024-06-06T08:47:27.624 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-06-06T08:47:27.624 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.624 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.624 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.625 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-06-06T08:47:27.625 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.625 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.625 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.625 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-06-06T08:47:27.625 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.625 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.625 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.626 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.626 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-06-06T08:47:27.626 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.626 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.626 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.626 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.626 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-06-06T08:47:27.626 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.627 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.627 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.627 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.627 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-06-06T08:47:27.627 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.627 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.627 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.627 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.628 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-06-06T08:47:27.628 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.628 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.628 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.628 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-06-06T08:47:27.628 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.628 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.629 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.629 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-06-06T08:47:27.629 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.629 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.629 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.629 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-06-06T08:47:27.630 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.630 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.630 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.630 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.630 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-06-06T08:47:27.630 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.630 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.630 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.631 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-06-06T08:47:27.631 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.632 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.632 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.632 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.632 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-06-06T08:47:27.632 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.632 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.632 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.633 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-06-06T08:47:27.633 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.633 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.633 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.633 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-06-06T08:47:27.633 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.634 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.634 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.634 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-06-06T08:47:27.634 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.634 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.634 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.635 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-06-06T08:47:27.635 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.635 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.635 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.635 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-06-06T08:47:27.635 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.635 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.636 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.636 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.636 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-06-06T08:47:27.636 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.636 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.636 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.636 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.636 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-06-06T08:47:27.637 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.637 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.637 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.637 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.637 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-06-06T08:47:27.637 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.637 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.637 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.638 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.638 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-06-06T08:47:27.638 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.638 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.638 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.638 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.638 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-06-06T08:47:27.638 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.639 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.639 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.639 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-06-06T08:47:27.639 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.639 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.639 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.640 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-06-06T08:47:27.640 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.640 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.640 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.640 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.640 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-06-06T08:47:27.640 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.640 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.640 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.641 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-06-06T08:47:27.641 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.641 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.641 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.641 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-06-06T08:47:27.641 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.642 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.642 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.642 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-06-06T08:47:27.642 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.642 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.642 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.643 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-06-06T08:47:27.643 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-06-06T08:47:27.643 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-06-06T08:47:27.643 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.643 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.643 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.643 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:27.643 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.644 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-06-06T08:47:27.644 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 1, 2024-06-06T08:47:27.644 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 2, 2024-06-06T08:47:27.644 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 1, 2024-06-06T08:47:27.644 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-06-06T08:47:27.644 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-06-06T08:47:27.644 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 0, 2024-06-06T08:47:27.644 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 0, 2024-06-06T08:47:27.644 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 1821, 2024-06-06T08:47:27.645 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-06-06T08:47:27.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.645 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-06-06T08:47:27.645 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:27.645 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:27.645 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:27.645 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:27.645 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:27.646 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:27.646 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:27.646 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:27.646 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:27.646 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:27.646 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:27.646 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:27.646 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:27.646 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:27.647 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:27.647 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:27.647 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:27.647 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:27.647 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:27.647 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:27.647 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:27.647 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:27.648 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:27.648 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:27.648 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:27.648 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:27.648 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:27.648 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:27.648 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:27.648 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:27.648 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:27.649 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-06-06T08:47:27.649 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:27.649 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:27.649 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:27.649 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:27.649 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 252301, 2024-06-06T08:47:27.649 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 1966, 2024-06-06T08:47:27.649 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-06-06T08:47:27.650 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-06-06T08:47:27.650 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-06-06T08:47:27.650 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-06-06T08:47:27.650 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:27.650 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:27.650 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:27.650 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:27.650 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 8016, 2024-06-06T08:47:27.651 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 169, 2024-06-06T08:47:27.651 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:27.651 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:27.651 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:27.651 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-06-06T08:47:27.651 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 6799121, 2024-06-06T08:47:27.651 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 57742, 2024-06-06T08:47:27.651 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:27.652 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-06-06T08:47:27.652 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:27.652 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-06-06T08:47:27.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.652 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-06-06T08:47:27.652 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-06-06T08:47:27.652 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-06-06T08:47:27.653 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 1180, 2024-06-06T08:47:27.653 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 21, 2024-06-06T08:47:27.653 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 3, 2024-06-06T08:47:27.653 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 1180, 2024-06-06T08:47:27.653 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-06-06T08:47:27.653 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1180, 2024-06-06T08:47:27.653 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.801989513, 2024-06-06T08:47:27.653 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000679652 2024-06-06T08:47:27.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.654 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-06-06T08:47:27.654 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-06-06T08:47:27.654 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1180, 2024-06-06T08:47:27.654 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 1181 2024-06-06T08:47:27.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.654 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 1180, 2024-06-06T08:47:27.654 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 1180, 2024-06-06T08:47:27.654 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 0, 2024-06-06T08:47:27.655 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-06-06T08:47:27.655 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-06-06T08:47:27.655 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 737, 2024-06-06T08:47:27.655 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 0, 2024-06-06T08:47:27.655 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 441, 2024-06-06T08:47:27.655 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 0, 2024-06-06T08:47:27.655 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 0, 2024-06-06T08:47:27.655 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-06-06T08:47:27.656 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-06-06T08:47:27.656 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-06-06T08:47:27.656 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 0, 2024-06-06T08:47:27.656 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 0, 2024-06-06T08:47:27.656 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-06-06T08:47:27.656 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-06-06T08:47:27.656 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-06-06T08:47:27.656 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 1, 2024-06-06T08:47:27.656 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 0, 2024-06-06T08:47:27.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-06-06T08:47:27.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-06-06T08:47:27.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-06-06T08:47:27.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-06-06T08:47:27.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-06-06T08:47:27.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-06-06T08:47:27.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T08:47:27.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-06-06T08:47:27.658 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-06-06T08:47:27.658 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 0, 2024-06-06T08:47:27.658 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-06-06T08:47:27.658 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-06-06T08:47:27.658 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-06-06T08:47:27.658 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-06-06T08:47:27.658 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-06-06T08:47:27.658 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-06-06T08:47:27.659 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-06-06T08:47:27.659 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-06-06T08:47:27.659 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-06-06T08:47:27.659 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-06-06T08:47:27.659 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-06-06T08:47:27.659 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-06-06T08:47:27.659 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-06-06T08:47:27.659 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-06-06T08:47:27.659 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-06-06T08:47:27.660 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-06-06T08:47:27.660 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 92, 2024-06-06T08:47:27.660 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-06-06T08:47:27.660 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 4, 2024-06-06T08:47:27.660 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 4, 2024-06-06T08:47:27.660 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 4, 2024-06-06T08:47:27.660 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 0, 2024-06-06T08:47:27.660 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-06-06T08:47:27.661 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 0, 2024-06-06T08:47:27.661 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 2, 2024-06-06T08:47:27.661 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 0 2024-06-06T08:47:27.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.661 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-06-06T08:47:27.661 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 0, 2024-06-06T08:47:27.661 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-06-06T08:47:27.661 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-06-06T08:47:27.661 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-06-06T08:47:27.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.662 INFO:teuthology.orchestra.run.smithi037.stdout: "osd-slow-ops": { 2024-06-06T08:47:27.662 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-06-06T08:47:27.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.662 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-06-06T08:47:27.662 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-06-06T08:47:27.662 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T08:47:27.662 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-06-06T08:47:27.663 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 0, 2024-06-06T08:47:27.663 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 0, 2024-06-06T08:47:27.663 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 0, 2024-06-06T08:47:27.663 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-06-06T08:47:27.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.663 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:27.663 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:27.663 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-06-06T08:47:27.664 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:27.664 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 1339, 2024-06-06T08:47:27.664 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 5825765, 2024-06-06T08:47:27.664 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:27.664 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 1339, 2024-06-06T08:47:27.664 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:27.664 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:27.664 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 1339, 2024-06-06T08:47:27.665 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 5825765, 2024-06-06T08:47:27.665 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:27.665 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.665 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.665 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.665 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:27.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.665 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-06-06T08:47:27.666 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:27.666 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-06-06T08:47:27.666 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:27.666 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-06-06T08:47:27.666 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-06-06T08:47:27.666 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:27.666 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:27.666 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 1180, 2024-06-06T08:47:27.667 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 5091186, 2024-06-06T08:47:27.667 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 1180, 2024-06-06T08:47:27.667 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 5091186, 2024-06-06T08:47:27.667 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:27.667 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.667 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.667 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.667 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:27.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.668 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-06-06T08:47:27.668 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:27.668 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-06-06T08:47:27.668 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:27.668 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-06-06T08:47:27.668 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-06-06T08:47:27.668 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:27.668 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:27.669 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 1180, 2024-06-06T08:47:27.669 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 1180, 2024-06-06T08:47:27.669 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 1180, 2024-06-06T08:47:27.669 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1180, 2024-06-06T08:47:27.669 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:27.669 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.669 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.669 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.669 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:27.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.670 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-06-06T08:47:27.670 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:27.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-06-06T08:47:27.670 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:27.670 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-06-06T08:47:27.670 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-06-06T08:47:27.670 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:27.671 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:27.671 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:27.671 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:27.671 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-06-06T08:47:27.671 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-06-06T08:47:27.671 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:27.671 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.671 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.672 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.672 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:27.672 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-06-06T08:47:27.672 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x55c4403526e0": { 2024-06-06T08:47:27.672 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-06-06T08:47:27.672 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-06-06T08:47:27.672 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-06-06T08:47:27.672 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-06-06T08:47:27.672 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-06-06T08:47:27.673 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:27.673 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:27.673 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-06-06T08:47:27.673 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-06-06T08:47:27.673 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-06-06T08:47:27.673 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-06-06T08:47:27.673 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-06-06T08:47:27.673 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-06-06T08:47:27.674 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-06-06T08:47:27.674 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-06-06T08:47:27.674 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:27.674 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-06-06T08:47:27.674 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-06-06T08:47:28.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:28 smithi028 ceph-mon[31564]: pgmap v555: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-06-06T08:47:28.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:28 smithi037 ceph-mon[36609]: pgmap v555: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-06-06T08:47:28.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:28 smithi059 ceph-mon[36684]: pgmap v555: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-06-06T08:47:28.405 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-06-06T08:47:28.406 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-06-06T08:47:28.406 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-06-06T08:47:28.406 DEBUG:tasks.check_counter:Getting stats from c 2024-06-06T08:47:28.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.c perf dump 2024-06-06T08:47:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:47:30.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:30 smithi028 ceph-mon[31564]: pgmap v556: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-06-06T08:47:30.292 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:30 smithi059 ceph-mon[36684]: pgmap v556: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-06-06T08:47:30.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:30 smithi037 ceph-mon[36609]: pgmap v556: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-06-06T08:47:30.577 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-06-06T08:47:30.577 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:30.577 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1012, 2024-06-06T08:47:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2181, 2024-06-06T08:47:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 1003739, 2024-06-06T08:47:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 2548073, 2024-06-06T08:47:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 11, 2024-06-06T08:47:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 5, 2024-06-06T08:47:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.116773870, 2024-06-06T08:47:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.049942366, 2024-06-06T08:47:30.578 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.058641401, 2024-06-06T08:47:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.006889665, 2024-06-06T08:47:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2179, 2024-06-06T08:47:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.182460122, 2024-06-06T08:47:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000083735 2024-06-06T08:47:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:30.579 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2451, 2024-06-06T08:47:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000683520, 2024-06-06T08:47:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000278 2024-06-06T08:47:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T08:47:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T08:47:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1162, 2024-06-06T08:47:30.580 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2328, 2024-06-06T08:47:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 446165, 2024-06-06T08:47:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 1426618, 2024-06-06T08:47:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 15, 2024-06-06T08:47:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 8, 2024-06-06T08:47:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.082442778, 2024-06-06T08:47:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.039295432, 2024-06-06T08:47:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.055873919, 2024-06-06T08:47:30.581 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.001337352, 2024-06-06T08:47:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2327, 2024-06-06T08:47:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.078025425, 2024-06-06T08:47:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000033530 2024-06-06T08:47:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1348, 2024-06-06T08:47:30.582 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000465740, 2024-06-06T08:47:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000345 2024-06-06T08:47:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-06-06T08:47:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 320912 2024-06-06T08:47:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 292, 2024-06-06T08:47:30.583 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 281, 2024-06-06T08:47:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 655982, 2024-06-06T08:47:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 200525, 2024-06-06T08:47:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 8, 2024-06-06T08:47:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 6, 2024-06-06T08:47:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.036409729, 2024-06-06T08:47:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.012396851, 2024-06-06T08:47:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.021581530, 2024-06-06T08:47:30.584 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.005050941, 2024-06-06T08:47:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 280, 2024-06-06T08:47:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.034729053, 2024-06-06T08:47:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000124032 2024-06-06T08:47:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 70, 2024-06-06T08:47:30.585 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000014302, 2024-06-06T08:47:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000204 2024-06-06T08:47:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 538080, 2024-06-06T08:47:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 87664 2024-06-06T08:47:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-06-06T08:47:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-06-06T08:47:30.586 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-06-06T08:47:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-06-06T08:47:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-06-06T08:47:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-06-06T08:47:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 129, 2024-06-06T08:47:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.350630717, 2024-06-06T08:47:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.002718067 2024-06-06T08:47:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:30.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-06-06T08:47:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-06-06T08:47:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-06-06T08:47:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 244, 2024-06-06T08:47:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.024782373, 2024-06-06T08:47:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000101567 2024-06-06T08:47:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:30.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-06-06T08:47:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 402, 2024-06-06T08:47:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 402, 2024-06-06T08:47:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-06-06T08:47:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 402, 2024-06-06T08:47:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.427244944, 2024-06-06T08:47:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.001062798 2024-06-06T08:47:30.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-06-06T08:47:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-06-06T08:47:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-06-06T08:47:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-06-06T08:47:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 11, 2024-06-06T08:47:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-06-06T08:47:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-06-06T08:47:30.590 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 888, 2024-06-06T08:47:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 1, 2024-06-06T08:47:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 887, 2024-06-06T08:47:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-06-06T08:47:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 880, 2024-06-06T08:47:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 0, 2024-06-06T08:47:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 51, 2024-06-06T08:47:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 51, 2024-06-06T08:47:30.591 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 42, 2024-06-06T08:47:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 811, 2024-06-06T08:47:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 529, 2024-06-06T08:47:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-06-06T08:47:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 6, 2024-06-06T08:47:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-06-06T08:47:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-06-06T08:47:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-06-06T08:47:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 1109, 2024-06-06T08:47:30.592 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-06-06T08:47:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-06-06T08:47:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-06-06T08:47:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 39, 2024-06-06T08:47:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 862, 2024-06-06T08:47:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-06-06T08:47:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-06-06T08:47:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-06-06T08:47:30.593 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 4, 2024-06-06T08:47:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 234, 2024-06-06T08:47:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 0, 2024-06-06T08:47:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T08:47:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-06-06T08:47:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T08:47:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-06-06T08:47:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-06-06T08:47:30.594 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T08:47:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T08:47:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-06-06T08:47:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-06-06T08:47:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 1, 2024-06-06T08:47:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 286, 2024-06-06T08:47:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T08:47:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T08:47:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T08:47:30.595 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 586, 2024-06-06T08:47:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 501, 2024-06-06T08:47:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 39, 2024-06-06T08:47:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 266 2024-06-06T08:47:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-06-06T08:47:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-06-06T08:47:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 0, 2024-06-06T08:47:30.596 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 0, 2024-06-06T08:47:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 6, 2024-06-06T08:47:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 36, 2024-06-06T08:47:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-06-06T08:47:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-06-06T08:47:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-06-06T08:47:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 132, 2024-06-06T08:47:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 132, 2024-06-06T08:47:30.597 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-06-06T08:47:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-06-06T08:47:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-06-06T08:47:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-06-06T08:47:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-06-06T08:47:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-06-06T08:47:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-06-06T08:47:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-06-06T08:47:30.598 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-06-06T08:47:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T08:47:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-06-06T08:47:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-06-06T08:47:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-06-06T08:47:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-06-06T08:47:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0 2024-06-06T08:47:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.599 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-06-06T08:47:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-06-06T08:47:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 1213, 2024-06-06T08:47:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-06-06T08:47:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-06-06T08:47:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 1213, 2024-06-06T08:47:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-06-06T08:47:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-06-06T08:47:30.600 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 3, 2024-06-06T08:47:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-06-06T08:47:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-06-06T08:47:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 3, 2024-06-06T08:47:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-06-06T08:47:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-06-06T08:47:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-06-06T08:47:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-06-06T08:47:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 6362134, 2024-06-06T08:47:30.601 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 0, 2024-06-06T08:47:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-06-06T08:47:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 52, 2024-06-06T08:47:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.520022471, 2024-06-06T08:47:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.010000432 2024-06-06T08:47:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 0 2024-06-06T08:47:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.602 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-06-06T08:47:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 673, 2024-06-06T08:47:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 805, 2024-06-06T08:47:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 132, 2024-06-06T08:47:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 61, 2024-06-06T08:47:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 62, 2024-06-06T08:47:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 1, 2024-06-06T08:47:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 888, 2024-06-06T08:47:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 1020, 2024-06-06T08:47:30.603 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 132, 2024-06-06T08:47:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 49, 2024-06-06T08:47:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 779, 2024-06-06T08:47:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 730, 2024-06-06T08:47:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 64580, 2024-06-06T08:47:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 223612 2024-06-06T08:47:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-06-06T08:47:30.604 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 673, 2024-06-06T08:47:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-06-06T08:47:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 402, 2024-06-06T08:47:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 2, 2024-06-06T08:47:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 267, 2024-06-06T08:47:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-06-06T08:47:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 135, 2024-06-06T08:47:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.157835363, 2024-06-06T08:47:30.605 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.001169150 2024-06-06T08:47:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-06-06T08:47:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-06-06T08:47:30.606 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-06-06T08:47:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.607 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-06-06T08:47:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 135, 2024-06-06T08:47:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.043492760, 2024-06-06T08:47:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000322168 2024-06-06T08:47:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-06-06T08:47:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-06-06T08:47:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-06-06T08:47:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-06-06T08:47:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.610 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-06-06T08:47:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-06-06T08:47:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.611 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.612 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-06-06T08:47:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-06-06T08:47:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-06-06T08:47:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-06-06T08:47:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.614 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-06-06T08:47:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-06-06T08:47:30.615 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-06-06T08:47:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.616 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-06-06T08:47:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-06-06T08:47:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.617 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-06-06T08:47:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-06-06T08:47:30.618 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-06-06T08:47:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-06-06T08:47:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-06-06T08:47:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.620 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-06-06T08:47:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-06-06T08:47:30.621 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-06-06T08:47:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-06-06T08:47:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 132, 2024-06-06T08:47:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.225916821, 2024-06-06T08:47:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.001711491 2024-06-06T08:47:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-06-06T08:47:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-06-06T08:47:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-06-06T08:47:30.623 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-06-06T08:47:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 1, 2024-06-06T08:47:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 1, 2024-06-06T08:47:30.624 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 0, 2024-06-06T08:47:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 1, 2024-06-06T08:47:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-06-06T08:47:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 394, 2024-06-06T08:47:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 394, 2024-06-06T08:47:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 1806, 2024-06-06T08:47:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-06-06T08:47:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.625 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-06-06T08:47:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:30.626 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:30.627 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:30.628 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:30.629 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-06-06T08:47:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 341689, 2024-06-06T08:47:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 798, 2024-06-06T08:47:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 880, 2024-06-06T08:47:30.630 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 10, 2024-06-06T08:47:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-06-06T08:47:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-06-06T08:47:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 8016, 2024-06-06T08:47:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 169, 2024-06-06T08:47:30.631 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-06-06T08:47:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 2316883, 2024-06-06T08:47:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 25792, 2024-06-06T08:47:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-06-06T08:47:30.632 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-06-06T08:47:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-06-06T08:47:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-06-06T08:47:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-06-06T08:47:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 256, 2024-06-06T08:47:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 2241724, 2024-06-06T08:47:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 33, 2024-06-06T08:47:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 256, 2024-06-06T08:47:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-06-06T08:47:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 256, 2024-06-06T08:47:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 1.211984765, 2024-06-06T08:47:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.004734315 2024-06-06T08:47:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-06-06T08:47:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-06-06T08:47:30.634 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 256, 2024-06-06T08:47:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 291 2024-06-06T08:47:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 256, 2024-06-06T08:47:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 6, 2024-06-06T08:47:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 250, 2024-06-06T08:47:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-06-06T08:47:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-06-06T08:47:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 0, 2024-06-06T08:47:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 10, 2024-06-06T08:47:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 6, 2024-06-06T08:47:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 58, 2024-06-06T08:47:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 12, 2024-06-06T08:47:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-06-06T08:47:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-06-06T08:47:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-06-06T08:47:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-06-06T08:47:30.636 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 144, 2024-06-06T08:47:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-06-06T08:47:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-06-06T08:47:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-06-06T08:47:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 0, 2024-06-06T08:47:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 20, 2024-06-06T08:47:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-06-06T08:47:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-06-06T08:47:30.637 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-06-06T08:47:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-06-06T08:47:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-06-06T08:47:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-06-06T08:47:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T08:47:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-06-06T08:47:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-06-06T08:47:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-06-06T08:47:30.638 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-06-06T08:47:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-06-06T08:47:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-06-06T08:47:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-06-06T08:47:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-06-06T08:47:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-06-06T08:47:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-06-06T08:47:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-06-06T08:47:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-06-06T08:47:30.639 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-06-06T08:47:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-06-06T08:47:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-06-06T08:47:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-06-06T08:47:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-06-06T08:47:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-06-06T08:47:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-06-06T08:47:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 92, 2024-06-06T08:47:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-06-06T08:47:30.640 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 4, 2024-06-06T08:47:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 12, 2024-06-06T08:47:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 12, 2024-06-06T08:47:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 0, 2024-06-06T08:47:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-06-06T08:47:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 35, 2024-06-06T08:47:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 0, 2024-06-06T08:47:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 6 2024-06-06T08:47:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.641 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-06-06T08:47:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 1, 2024-06-06T08:47:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-06-06T08:47:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-06-06T08:47:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-06-06T08:47:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: "osd-slow-ops": { 2024-06-06T08:47:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-06-06T08:47:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.642 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-06-06T08:47:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-06-06T08:47:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 6, 2024-06-06T08:47:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-06-06T08:47:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 6, 2024-06-06T08:47:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 132, 2024-06-06T08:47:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 132, 2024-06-06T08:47:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-06-06T08:47:30.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-06-06T08:47:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 2462, 2024-06-06T08:47:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 1888488, 2024-06-06T08:47:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 2462, 2024-06-06T08:47:30.644 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2462, 2024-06-06T08:47:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1888488, 2024-06-06T08:47:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.645 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-06-06T08:47:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-06-06T08:47:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:30.646 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 256, 2024-06-06T08:47:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 2255056, 2024-06-06T08:47:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 256, 2024-06-06T08:47:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2255056, 2024-06-06T08:47:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.647 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-06-06T08:47:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-06-06T08:47:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:30.648 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 256, 2024-06-06T08:47:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 256, 2024-06-06T08:47:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 256, 2024-06-06T08:47:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 256, 2024-06-06T08:47:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-06-06T08:47:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-06-06T08:47:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 132, 2024-06-06T08:47:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 13332, 2024-06-06T08:47:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 132, 2024-06-06T08:47:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 6, 2024-06-06T08:47:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 13332, 2024-06-06T08:47:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.651 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x55bfd8530460": { 2024-06-06T08:47:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-06-06T08:47:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:30.652 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 1213, 2024-06-06T08:47:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 2167830, 2024-06-06T08:47:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 1213, 2024-06-06T08:47:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 52, 2024-06-06T08:47:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2167830, 2024-06-06T08:47:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:30.653 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:30.654 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:30.654 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-06-06T08:47:31.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:31 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:47:31.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:31 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:47:31.349 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:31 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T08:47:31.419 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-06-06T08:47:31.419 INFO:tasks.check_counter:Daemon mds.c mds.imported=39 2024-06-06T08:47:31.419 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-06-06T08:47:31.419 DEBUG:tasks.check_counter:Getting stats from f 2024-06-06T08:47:31.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.f perf dump 2024-06-06T08:47:31.672 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:47:32.074 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:32 smithi059 ceph-mon[36684]: pgmap v557: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2024-06-06T08:47:32.075 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:32 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:47:32.075 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:32 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:47:32.075 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:32 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:47:32.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:32 smithi028 ceph-mon[31564]: pgmap v557: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2024-06-06T08:47:32.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:32 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:47:32.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:32 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:47:32.291 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:32 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:47:32.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:32 smithi037 ceph-mon[36609]: pgmap v557: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2024-06-06T08:47:32.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:32 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T08:47:32.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:32 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T08:47:32.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:32 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' 2024-06-06T08:47:33.655 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-06-06T08:47:33.656 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:33.656 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 916, 2024-06-06T08:47:33.656 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 918, 2024-06-06T08:47:33.656 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 9217795, 2024-06-06T08:47:33.656 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 291298, 2024-06-06T08:47:33.656 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 7, 2024-06-06T08:47:33.656 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 3, 2024-06-06T08:47:33.656 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.099389260, 2024-06-06T08:47:33.657 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.030560978, 2024-06-06T08:47:33.657 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.030547134, 2024-06-06T08:47:33.657 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.027845183, 2024-06-06T08:47:33.657 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:33.657 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 916, 2024-06-06T08:47:33.657 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.039874452, 2024-06-06T08:47:33.657 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000043531 2024-06-06T08:47:33.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.658 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:33.658 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.658 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.658 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.658 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T08:47:33.658 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T08:47:33.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.659 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:33.659 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 277, 2024-06-06T08:47:33.659 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 264, 2024-06-06T08:47:33.659 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 17338828, 2024-06-06T08:47:33.659 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 121702, 2024-06-06T08:47:33.659 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2024-06-06T08:47:33.659 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 3, 2024-06-06T08:47:33.659 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.043409227, 2024-06-06T08:47:33.659 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.011655959, 2024-06-06T08:47:33.660 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.026283148, 2024-06-06T08:47:33.660 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.006038485, 2024-06-06T08:47:33.660 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:33.660 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 264, 2024-06-06T08:47:33.660 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.017117680, 2024-06-06T08:47:33.660 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000064839 2024-06-06T08:47:33.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.660 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:33.661 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.661 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.661 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.661 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 529056, 2024-06-06T08:47:33.661 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 84112 2024-06-06T08:47:33.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.661 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:33.661 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 354, 2024-06-06T08:47:33.662 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 455, 2024-06-06T08:47:33.662 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 8477014, 2024-06-06T08:47:33.662 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 434193, 2024-06-06T08:47:33.663 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 6, 2024-06-06T08:47:33.663 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 4, 2024-06-06T08:47:33.663 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.046842874, 2024-06-06T08:47:33.663 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.017122902, 2024-06-06T08:47:33.663 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.013510510, 2024-06-06T08:47:33.663 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.011696933, 2024-06-06T08:47:33.663 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:33.664 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 453, 2024-06-06T08:47:33.664 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.022817749, 2024-06-06T08:47:33.664 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000050370 2024-06-06T08:47:33.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.664 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:33.664 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.664 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.664 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.665 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T08:47:33.665 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 322256 2024-06-06T08:47:33.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.665 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-06-06T08:47:33.665 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-06-06T08:47:33.665 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-06-06T08:47:33.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.666 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-06-06T08:47:33.666 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-06-06T08:47:33.666 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-06-06T08:47:33.666 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2286, 2024-06-06T08:47:33.666 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.065950572, 2024-06-06T08:47:33.666 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000028849 2024-06-06T08:47:33.666 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:33.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.667 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-06-06T08:47:33.667 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-06-06T08:47:33.667 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-06-06T08:47:33.667 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.667 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.669 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.669 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:33.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.669 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-06-06T08:47:33.670 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 0, 2024-06-06T08:47:33.670 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 0, 2024-06-06T08:47:33.670 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-06-06T08:47:33.670 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.670 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.670 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.670 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-06-06T08:47:33.671 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-06-06T08:47:33.671 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-06-06T08:47:33.671 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-06-06T08:47:33.671 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 0, 2024-06-06T08:47:33.671 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-06-06T08:47:33.671 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-06-06T08:47:33.671 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 2211, 2024-06-06T08:47:33.671 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 0, 2024-06-06T08:47:33.671 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 2211, 2024-06-06T08:47:33.672 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-06-06T08:47:33.672 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 2211, 2024-06-06T08:47:33.672 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 0, 2024-06-06T08:47:33.672 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 0, 2024-06-06T08:47:33.672 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 0, 2024-06-06T08:47:33.672 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 22, 2024-06-06T08:47:33.672 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 0, 2024-06-06T08:47:33.673 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 0, 2024-06-06T08:47:33.673 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-06-06T08:47:33.673 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 0, 2024-06-06T08:47:33.673 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-06-06T08:47:33.673 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-06-06T08:47:33.673 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-06-06T08:47:33.673 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-06-06T08:47:33.673 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-06-06T08:47:33.673 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-06-06T08:47:33.674 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-06-06T08:47:33.674 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-06-06T08:47:33.674 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-06-06T08:47:33.674 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-06-06T08:47:33.674 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-06-06T08:47:33.674 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-06-06T08:47:33.674 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 3454, 2024-06-06T08:47:33.674 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 26759812, 2024-06-06T08:47:33.675 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 0, 2024-06-06T08:47:33.675 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T08:47:33.675 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-06-06T08:47:33.675 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T08:47:33.675 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-06-06T08:47:33.675 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-06-06T08:47:33.675 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T08:47:33.675 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T08:47:33.676 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-06-06T08:47:33.676 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-06-06T08:47:33.676 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T08:47:33.676 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 0, 2024-06-06T08:47:33.676 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T08:47:33.676 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T08:47:33.676 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T08:47:33.676 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 0, 2024-06-06T08:47:33.677 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 0, 2024-06-06T08:47:33.677 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 0, 2024-06-06T08:47:33.677 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 0 2024-06-06T08:47:33.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.677 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-06-06T08:47:33.677 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-06-06T08:47:33.677 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 0, 2024-06-06T08:47:33.677 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 0, 2024-06-06T08:47:33.677 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 0, 2024-06-06T08:47:33.678 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 0, 2024-06-06T08:47:33.678 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-06-06T08:47:33.678 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-06-06T08:47:33.678 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-06-06T08:47:33.678 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 0, 2024-06-06T08:47:33.678 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 0, 2024-06-06T08:47:33.678 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-06-06T08:47:33.678 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-06-06T08:47:33.679 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-06-06T08:47:33.679 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-06-06T08:47:33.679 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-06-06T08:47:33.679 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-06-06T08:47:33.679 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-06-06T08:47:33.679 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-06-06T08:47:33.679 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-06-06T08:47:33.679 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T08:47:33.680 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-06-06T08:47:33.680 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-06-06T08:47:33.680 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-06-06T08:47:33.680 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-06-06T08:47:33.680 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0 2024-06-06T08:47:33.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.680 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-06-06T08:47:33.680 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-06-06T08:47:33.681 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 0, 2024-06-06T08:47:33.681 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-06-06T08:47:33.681 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-06-06T08:47:33.681 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 16196, 2024-06-06T08:47:33.681 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-06-06T08:47:33.681 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-06-06T08:47:33.681 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 0, 2024-06-06T08:47:33.681 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-06-06T08:47:33.682 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-06-06T08:47:33.682 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 20, 2024-06-06T08:47:33.682 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 3, 2024-06-06T08:47:33.682 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-06-06T08:47:33.682 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-06-06T08:47:33.682 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-06-06T08:47:33.682 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 38307306, 2024-06-06T08:47:33.682 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 38301186, 2024-06-06T08:47:33.683 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-06-06T08:47:33.683 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.683 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.683 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.683 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 16196 2024-06-06T08:47:33.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.683 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-06-06T08:47:33.683 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 75, 2024-06-06T08:47:33.684 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 5885, 2024-06-06T08:47:33.684 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 5810, 2024-06-06T08:47:33.684 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 51, 2024-06-06T08:47:33.684 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 278, 2024-06-06T08:47:33.684 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 227, 2024-06-06T08:47:33.684 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 2211, 2024-06-06T08:47:33.684 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 6816, 2024-06-06T08:47:33.684 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 4605, 2024-06-06T08:47:33.684 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 0, 2024-06-06T08:47:33.685 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 0, 2024-06-06T08:47:33.685 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 0, 2024-06-06T08:47:33.685 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 65408, 2024-06-06T08:47:33.685 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 215420 2024-06-06T08:47:33.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.685 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-06-06T08:47:33.685 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 0, 2024-06-06T08:47:33.685 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-06-06T08:47:33.686 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 0, 2024-06-06T08:47:33.686 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 0, 2024-06-06T08:47:33.686 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 0, 2024-06-06T08:47:33.686 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-06-06T08:47:33.686 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.686 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.686 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.687 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-06-06T08:47:33.687 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.687 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.687 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.687 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-06-06T08:47:33.687 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.687 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.687 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.688 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-06-06T08:47:33.688 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.688 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.688 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.688 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-06-06T08:47:33.688 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.688 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.689 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.689 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-06-06T08:47:33.689 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.689 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.689 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.689 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-06-06T08:47:33.689 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.690 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.690 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.690 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-06-06T08:47:33.690 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.690 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.690 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.691 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-06-06T08:47:33.691 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.691 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.691 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.691 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-06-06T08:47:33.691 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.691 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.691 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.692 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-06-06T08:47:33.692 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.692 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.692 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-06-06T08:47:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-06-06T08:47:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-06-06T08:47:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-06-06T08:47:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-06-06T08:47:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-06-06T08:47:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-06-06T08:47:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-06-06T08:47:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-06-06T08:47:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-06-06T08:47:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-06-06T08:47:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-06-06T08:47:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-06-06T08:47:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-06-06T08:47:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-06-06T08:47:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-06-06T08:47:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-06-06T08:47:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-06-06T08:47:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-06-06T08:47:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-06-06T08:47:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-06-06T08:47:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-06-06T08:47:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 1, 2024-06-06T08:47:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 2, 2024-06-06T08:47:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 1, 2024-06-06T08:47:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 1, 2024-06-06T08:47:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-06-06T08:47:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 0, 2024-06-06T08:47:33.706 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 0, 2024-06-06T08:47:33.706 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 1808, 2024-06-06T08:47:33.706 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-06-06T08:47:33.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.706 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-06-06T08:47:33.706 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:33.706 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:33.707 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:33.707 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:33.707 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:33.707 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:33.707 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:33.707 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:33.707 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:33.707 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:33.707 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:33.708 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:33.708 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:33.708 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:33.708 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:33.708 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:33.708 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:33.708 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:33.709 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:33.709 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:33.709 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:33.709 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:33.709 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:33.709 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:33.709 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:33.709 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:33.709 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:33.710 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:33.710 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:33.710 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:33.710 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:33.710 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-06-06T08:47:33.710 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:33.710 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:33.711 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:33.711 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:33.711 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 207400, 2024-06-06T08:47:33.711 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 110, 2024-06-06T08:47:33.711 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-06-06T08:47:33.711 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-06-06T08:47:33.711 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-06-06T08:47:33.711 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-06-06T08:47:33.712 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:33.712 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:33.712 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:33.712 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:33.712 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 8016, 2024-06-06T08:47:33.712 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 169, 2024-06-06T08:47:33.712 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:33.712 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:33.712 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:33.713 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-06-06T08:47:33.713 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 1796263, 2024-06-06T08:47:33.713 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 10775, 2024-06-06T08:47:33.713 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:33.713 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-06-06T08:47:33.713 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:33.713 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-06-06T08:47:33.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.714 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-06-06T08:47:33.714 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-06-06T08:47:33.714 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-06-06T08:47:33.714 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 1386, 2024-06-06T08:47:33.714 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 26, 2024-06-06T08:47:33.714 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 4, 2024-06-06T08:47:33.714 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 1386, 2024-06-06T08:47:33.714 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-06-06T08:47:33.715 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1386, 2024-06-06T08:47:33.715 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.935988273, 2024-06-06T08:47:33.715 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000675316 2024-06-06T08:47:33.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.715 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-06-06T08:47:33.715 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-06-06T08:47:33.715 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1386, 2024-06-06T08:47:33.715 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 1387 2024-06-06T08:47:33.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.716 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 1386, 2024-06-06T08:47:33.716 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 1386, 2024-06-06T08:47:33.716 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 0, 2024-06-06T08:47:33.716 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-06-06T08:47:33.716 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-06-06T08:47:33.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 870, 2024-06-06T08:47:33.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 0, 2024-06-06T08:47:33.716 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 513, 2024-06-06T08:47:33.717 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 0, 2024-06-06T08:47:33.717 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 0, 2024-06-06T08:47:33.717 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-06-06T08:47:33.717 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-06-06T08:47:33.717 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-06-06T08:47:33.717 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-06-06T08:47:33.717 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 0, 2024-06-06T08:47:33.717 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-06-06T08:47:33.717 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-06-06T08:47:33.718 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-06-06T08:47:33.718 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 2, 2024-06-06T08:47:33.718 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 0, 2024-06-06T08:47:33.718 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-06-06T08:47:33.718 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-06-06T08:47:33.718 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-06-06T08:47:33.718 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-06-06T08:47:33.718 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-06-06T08:47:33.719 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-06-06T08:47:33.719 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T08:47:33.719 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-06-06T08:47:33.719 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-06-06T08:47:33.719 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-06-06T08:47:33.719 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-06-06T08:47:33.719 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-06-06T08:47:33.719 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-06-06T08:47:33.720 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-06-06T08:47:33.720 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-06-06T08:47:33.720 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-06-06T08:47:33.720 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-06-06T08:47:33.720 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-06-06T08:47:33.720 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-06-06T08:47:33.720 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-06-06T08:47:33.720 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-06-06T08:47:33.721 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-06-06T08:47:33.721 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-06-06T08:47:33.721 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-06-06T08:47:33.721 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-06-06T08:47:33.721 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-06-06T08:47:33.721 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 92, 2024-06-06T08:47:33.721 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-06-06T08:47:33.721 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 4, 2024-06-06T08:47:33.722 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 7, 2024-06-06T08:47:33.722 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 7, 2024-06-06T08:47:33.722 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 0, 2024-06-06T08:47:33.722 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-06-06T08:47:33.722 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 0, 2024-06-06T08:47:33.722 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 2, 2024-06-06T08:47:33.722 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 0 2024-06-06T08:47:33.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.722 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-06-06T08:47:33.723 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 0, 2024-06-06T08:47:33.723 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-06-06T08:47:33.723 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-06-06T08:47:33.723 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-06-06T08:47:33.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.723 INFO:teuthology.orchestra.run.smithi059.stdout: "osd-slow-ops": { 2024-06-06T08:47:33.723 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-06-06T08:47:33.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.724 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-06-06T08:47:33.724 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-06-06T08:47:33.724 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T08:47:33.724 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-06-06T08:47:33.724 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 0, 2024-06-06T08:47:33.724 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 0, 2024-06-06T08:47:33.724 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 0, 2024-06-06T08:47:33.724 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-06-06T08:47:33.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.725 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:33.725 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:33.725 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-06-06T08:47:33.725 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:33.725 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 1543, 2024-06-06T08:47:33.725 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 34883859, 2024-06-06T08:47:33.725 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:33.726 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 1543, 2024-06-06T08:47:33.726 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:33.726 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:33.726 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 1543, 2024-06-06T08:47:33.726 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 34883859, 2024-06-06T08:47:33.726 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:33.726 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.726 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.727 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.727 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:33.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.727 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-06-06T08:47:33.727 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:33.727 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-06-06T08:47:33.727 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:33.727 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 1386, 2024-06-06T08:47:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 34115617, 2024-06-06T08:47:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 1386, 2024-06-06T08:47:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 34115617, 2024-06-06T08:47:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-06-06T08:47:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-06-06T08:47:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 1386, 2024-06-06T08:47:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 1386, 2024-06-06T08:47:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 1386, 2024-06-06T08:47:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1386, 2024-06-06T08:47:33.731 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:33.731 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.731 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.731 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.731 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:33.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.731 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-06-06T08:47:33.731 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:33.732 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-06-06T08:47:33.732 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:33.732 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:33.732 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:33.732 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:33.732 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:33.732 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:33.732 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:33.732 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-06-06T08:47:33.733 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-06-06T08:47:33.733 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:33.733 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.733 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.733 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.733 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:33.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:33.733 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x55d024d526e0": { 2024-06-06T08:47:33.734 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:33.734 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-06-06T08:47:33.734 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:33.734 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:33.734 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:33.734 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:33.734 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:33.734 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:33.735 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:33.735 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-06-06T08:47:33.735 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-06-06T08:47:33.735 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:33.735 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:33.735 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:33.735 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:33.735 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:33.736 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:33.736 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-06-06T08:47:34.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:34 smithi028 ceph-mon[31564]: pgmap v558: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-06T08:47:34.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:34 smithi037 ceph-mon[36609]: pgmap v558: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-06T08:47:34.324 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:34 smithi059 ceph-mon[36684]: pgmap v558: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-06T08:47:34.354 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-06-06T08:47:34.354 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-06-06T08:47:34.354 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-06-06T08:47:34.354 DEBUG:tasks.check_counter:Getting stats from i 2024-06-06T08:47:34.354 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.i perf dump 2024-06-06T08:47:34.602 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:47:36.162 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:36 smithi059 ceph-mon[36684]: pgmap v559: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-06T08:47:36.290 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:36 smithi028 ceph-mon[31564]: pgmap v559: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-06T08:47:36.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:36 smithi037 ceph-mon[36609]: pgmap v559: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-06T08:47:36.434 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-06-06T08:47:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 2568, 2024-06-06T08:47:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 4912, 2024-06-06T08:47:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 866743, 2024-06-06T08:47:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 6480828, 2024-06-06T08:47:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 16, 2024-06-06T08:47:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 4, 2024-06-06T08:47:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.187369308, 2024-06-06T08:47:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.090048884, 2024-06-06T08:47:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.114038907, 2024-06-06T08:47:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.008236078, 2024-06-06T08:47:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 4911, 2024-06-06T08:47:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.154694200, 2024-06-06T08:47:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000031499 2024-06-06T08:47:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2799, 2024-06-06T08:47:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001032951, 2024-06-06T08:47:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000369 2024-06-06T08:47:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-06T08:47:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 448 2024-06-06T08:47:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 448, 2024-06-06T08:47:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 437, 2024-06-06T08:47:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 617646, 2024-06-06T08:47:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 282404, 2024-06-06T08:47:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 10, 2024-06-06T08:47:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 9, 2024-06-06T08:47:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.046596382, 2024-06-06T08:47:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.015326457, 2024-06-06T08:47:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.022034944, 2024-06-06T08:47:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.009430303, 2024-06-06T08:47:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 432, 2024-06-06T08:47:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.037819924, 2024-06-06T08:47:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000087546 2024-06-06T08:47:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 548736, 2024-06-06T08:47:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 87040 2024-06-06T08:47:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1968, 2024-06-06T08:47:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 3405, 2024-06-06T08:47:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 1806236, 2024-06-06T08:47:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 1961669, 2024-06-06T08:47:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 8, 2024-06-06T08:47:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 4, 2024-06-06T08:47:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.169660446, 2024-06-06T08:47:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.072950561, 2024-06-06T08:47:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.100800959, 2024-06-06T08:47:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.004389725, 2024-06-06T08:47:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 3407, 2024-06-06T08:47:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.107252062, 2024-06-06T08:47:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000031479 2024-06-06T08:47:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 4886, 2024-06-06T08:47:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001000270, 2024-06-06T08:47:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000204 2024-06-06T08:47:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T08:47:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 245408 2024-06-06T08:47:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-06-06T08:47:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-06-06T08:47:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-06-06T08:47:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-06-06T08:47:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-06-06T08:47:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-06-06T08:47:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 357, 2024-06-06T08:47:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.569492246, 2024-06-06T08:47:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.001595216 2024-06-06T08:47:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-06-06T08:47:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-06-06T08:47:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-06-06T08:47:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 691, 2024-06-06T08:47:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.036829497, 2024-06-06T08:47:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000053298 2024-06-06T08:47:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-06-06T08:47:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 1442, 2024-06-06T08:47:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 1442, 2024-06-06T08:47:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-06-06T08:47:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1442, 2024-06-06T08:47:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 7.757824333, 2024-06-06T08:47:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.005379905 2024-06-06T08:47:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-06-06T08:47:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-06-06T08:47:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-06-06T08:47:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-06-06T08:47:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 11, 2024-06-06T08:47:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-06-06T08:47:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-06-06T08:47:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 328, 2024-06-06T08:47:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 28, 2024-06-06T08:47:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 13, 2024-06-06T08:47:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 287, 2024-06-06T08:47:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 287, 2024-06-06T08:47:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 1078, 2024-06-06T08:47:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 173, 2024-06-06T08:47:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 173, 2024-06-06T08:47:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 19, 2024-06-06T08:47:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 2842, 2024-06-06T08:47:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 1609, 2024-06-06T08:47:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-06-06T08:47:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 20, 2024-06-06T08:47:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-06-06T08:47:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-06-06T08:47:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-06-06T08:47:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 1485, 2024-06-06T08:47:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 1, 2024-06-06T08:47:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 37, 2024-06-06T08:47:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 1029, 2024-06-06T08:47:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 48, 2024-06-06T08:47:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 1219, 2024-06-06T08:47:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-06-06T08:47:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-06-06T08:47:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-06-06T08:47:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 4, 2024-06-06T08:47:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 234, 2024-06-06T08:47:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 0, 2024-06-06T08:47:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T08:47:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-06-06T08:47:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T08:47:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-06-06T08:47:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-06-06T08:47:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T08:47:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T08:47:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-06-06T08:47:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-06-06T08:47:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 9, 2024-06-06T08:47:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 689, 2024-06-06T08:47:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T08:47:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T08:47:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T08:47:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 813, 2024-06-06T08:47:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 755, 2024-06-06T08:47:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 30, 2024-06-06T08:47:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 770 2024-06-06T08:47:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-06-06T08:47:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-06-06T08:47:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 0, 2024-06-06T08:47:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 0, 2024-06-06T08:47:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 20, 2024-06-06T08:47:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 34, 2024-06-06T08:47:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-06-06T08:47:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-06-06T08:47:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-06-06T08:47:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 349, 2024-06-06T08:47:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 349, 2024-06-06T08:47:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-06-06T08:47:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-06-06T08:47:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-06-06T08:47:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-06-06T08:47:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-06-06T08:47:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-06-06T08:47:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-06-06T08:47:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-06-06T08:47:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-06-06T08:47:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T08:47:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 37, 2024-06-06T08:47:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-06-06T08:47:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-06-06T08:47:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-06-06T08:47:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0 2024-06-06T08:47:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-06-06T08:47:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-06-06T08:47:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 2537, 2024-06-06T08:47:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-06-06T08:47:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-06-06T08:47:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 2537, 2024-06-06T08:47:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-06-06T08:47:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-06-06T08:47:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 5, 2024-06-06T08:47:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-06-06T08:47:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-06-06T08:47:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 5, 2024-06-06T08:47:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-06-06T08:47:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-06-06T08:47:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-06-06T08:47:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-06-06T08:47:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 8435824, 2024-06-06T08:47:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 0, 2024-06-06T08:47:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-06-06T08:47:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 131, 2024-06-06T08:47:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.468226116, 2024-06-06T08:47:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.003574245 2024-06-06T08:47:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 0 2024-06-06T08:47:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-06-06T08:47:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 281, 2024-06-06T08:47:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 1334, 2024-06-06T08:47:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 1053, 2024-06-06T08:47:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 90, 2024-06-06T08:47:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 95, 2024-06-06T08:47:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 5, 2024-06-06T08:47:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 328, 2024-06-06T08:47:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 1801, 2024-06-06T08:47:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 1473, 2024-06-06T08:47:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 173, 2024-06-06T08:47:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 1385, 2024-06-06T08:47:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 1212, 2024-06-06T08:47:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 65072, 2024-06-06T08:47:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 223612 2024-06-06T08:47:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-06-06T08:47:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 2163, 2024-06-06T08:47:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 1, 2024-06-06T08:47:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 1442, 2024-06-06T08:47:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 8, 2024-06-06T08:47:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 676, 2024-06-06T08:47:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-06-06T08:47:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 304, 2024-06-06T08:47:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.505514400, 2024-06-06T08:47:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.001662876 2024-06-06T08:47:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-06-06T08:47:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-06-06T08:47:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.466 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-06-06T08:47:36.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.466 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.466 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-06-06T08:47:36.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 647, 2024-06-06T08:47:36.467 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.223715269, 2024-06-06T08:47:36.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000345773 2024-06-06T08:47:36.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.467 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-06-06T08:47:36.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.467 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.468 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-06-06T08:47:36.468 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1, 2024-06-06T08:47:36.468 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000149096, 2024-06-06T08:47:36.468 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000149096 2024-06-06T08:47:36.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.468 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-06-06T08:47:36.468 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.468 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.469 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.469 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-06-06T08:47:36.469 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.469 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.469 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.469 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-06-06T08:47:36.470 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.470 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.470 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.470 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-06-06T08:47:36.470 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.470 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.471 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.471 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-06-06T08:47:36.471 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-06-06T08:47:36.472 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.126220038, 2024-06-06T08:47:36.472 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.063110019 2024-06-06T08:47:36.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.472 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-06-06T08:47:36.472 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.472 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.472 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.473 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-06-06T08:47:36.473 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.473 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.473 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.473 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-06-06T08:47:36.473 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 94, 2024-06-06T08:47:36.473 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.030138933, 2024-06-06T08:47:36.474 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000320626 2024-06-06T08:47:36.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.474 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-06-06T08:47:36.474 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 43, 2024-06-06T08:47:36.474 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.029754864, 2024-06-06T08:47:36.474 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000691973 2024-06-06T08:47:36.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.474 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-06-06T08:47:36.474 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-06-06T08:47:36.475 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 6.163456639, 2024-06-06T08:47:36.475 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 3.081728319 2024-06-06T08:47:36.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.475 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-06-06T08:47:36.475 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.475 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.475 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.476 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-06-06T08:47:36.476 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.476 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.476 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.476 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-06-06T08:47:36.476 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.476 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.477 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.477 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-06-06T08:47:36.477 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.477 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.477 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.477 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-06-06T08:47:36.477 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.478 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.478 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.478 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-06-06T08:47:36.478 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.478 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.478 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.479 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-06-06T08:47:36.479 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.479 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.479 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.479 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-06-06T08:47:36.479 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.479 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.480 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.480 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-06-06T08:47:36.480 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.480 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.480 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.480 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-06-06T08:47:36.480 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.481 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.481 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.481 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-06-06T08:47:36.481 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.481 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.481 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.482 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-06-06T08:47:36.482 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 349, 2024-06-06T08:47:36.482 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.678875094, 2024-06-06T08:47:36.482 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.001945200 2024-06-06T08:47:36.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.483 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-06-06T08:47:36.483 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-06-06T08:47:36.483 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-06-06T08:47:36.483 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.483 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.483 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.484 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:36.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.484 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-06-06T08:47:36.484 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 1, 2024-06-06T08:47:36.484 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 1, 2024-06-06T08:47:36.484 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 0, 2024-06-06T08:47:36.484 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 1, 2024-06-06T08:47:36.484 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-06-06T08:47:36.485 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 1052, 2024-06-06T08:47:36.485 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 1052, 2024-06-06T08:47:36.485 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 200, 2024-06-06T08:47:36.485 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-06-06T08:47:36.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.485 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-06-06T08:47:36.485 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:36.485 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:36.486 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:36.486 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:36.486 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:36.486 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:36.486 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:36.486 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:36.486 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:36.486 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:36.487 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:36.487 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:36.487 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:36.487 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:36.487 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:36.487 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:36.487 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:36.487 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:36.488 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:36.488 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:36.488 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:36.488 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:36.488 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:36.488 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:36.488 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:36.488 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:36.489 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:36.489 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:36.489 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:36.489 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:36.489 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:36.489 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-06-06T08:47:36.489 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:36.489 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:36.490 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:36.490 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:36.490 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 301090, 2024-06-06T08:47:36.490 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 383, 2024-06-06T08:47:36.490 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 704, 2024-06-06T08:47:36.490 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 8, 2024-06-06T08:47:36.490 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-06-06T08:47:36.490 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-06-06T08:47:36.491 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:36.491 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:36.491 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:36.491 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:36.491 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 8016, 2024-06-06T08:47:36.491 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 169, 2024-06-06T08:47:36.491 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:36.491 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:36.492 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:36.492 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-06-06T08:47:36.492 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 1078044, 2024-06-06T08:47:36.492 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 12931, 2024-06-06T08:47:36.492 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:36.492 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-06-06T08:47:36.492 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:36.493 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-06-06T08:47:36.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.493 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-06-06T08:47:36.493 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-06-06T08:47:36.493 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-06-06T08:47:36.493 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 596, 2024-06-06T08:47:36.493 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 4340529, 2024-06-06T08:47:36.493 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 27, 2024-06-06T08:47:36.494 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 596, 2024-06-06T08:47:36.494 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-06-06T08:47:36.494 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 596, 2024-06-06T08:47:36.494 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 2.078973809, 2024-06-06T08:47:36.494 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.003488211 2024-06-06T08:47:36.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.494 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-06-06T08:47:36.494 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-06-06T08:47:36.495 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 596, 2024-06-06T08:47:36.495 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 657 2024-06-06T08:47:36.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.495 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 596, 2024-06-06T08:47:36.495 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 13, 2024-06-06T08:47:36.495 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 583, 2024-06-06T08:47:36.495 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-06-06T08:47:36.495 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-06-06T08:47:36.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 0, 2024-06-06T08:47:36.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 10, 2024-06-06T08:47:36.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 13, 2024-06-06T08:47:36.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 144, 2024-06-06T08:47:36.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 20, 2024-06-06T08:47:36.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-06-06T08:47:36.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-06-06T08:47:36.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-06-06T08:47:36.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-06-06T08:47:36.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 362, 2024-06-06T08:47:36.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-06-06T08:47:36.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-06-06T08:47:36.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-06-06T08:47:36.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 0, 2024-06-06T08:47:36.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 20, 2024-06-06T08:47:36.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-06-06T08:47:36.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-06-06T08:47:36.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-06-06T08:47:36.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-06-06T08:47:36.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-06-06T08:47:36.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-06-06T08:47:36.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T08:47:36.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-06-06T08:47:36.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-06-06T08:47:36.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-06-06T08:47:36.499 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-06-06T08:47:36.499 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-06-06T08:47:36.499 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-06-06T08:47:36.499 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-06-06T08:47:36.499 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-06-06T08:47:36.499 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-06-06T08:47:36.499 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-06-06T08:47:36.499 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-06-06T08:47:36.500 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-06-06T08:47:36.500 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-06-06T08:47:36.500 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-06-06T08:47:36.500 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-06-06T08:47:36.500 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-06-06T08:47:36.500 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-06-06T08:47:36.500 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-06-06T08:47:36.500 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-06-06T08:47:36.501 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 92, 2024-06-06T08:47:36.501 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-06-06T08:47:36.501 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 4, 2024-06-06T08:47:36.501 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 12, 2024-06-06T08:47:36.501 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 12, 2024-06-06T08:47:36.501 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 0, 2024-06-06T08:47:36.501 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-06-06T08:47:36.501 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 74, 2024-06-06T08:47:36.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 0, 2024-06-06T08:47:36.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 14 2024-06-06T08:47:36.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.502 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-06-06T08:47:36.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 1, 2024-06-06T08:47:36.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-06-06T08:47:36.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-06-06T08:47:36.503 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-06-06T08:47:36.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.503 INFO:teuthology.orchestra.run.smithi059.stdout: "osd-slow-ops": { 2024-06-06T08:47:36.503 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-06-06T08:47:36.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.503 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-06-06T08:47:36.503 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-06-06T08:47:36.503 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 6, 2024-06-06T08:47:36.504 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-06-06T08:47:36.504 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 6, 2024-06-06T08:47:36.504 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 349, 2024-06-06T08:47:36.504 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 349, 2024-06-06T08:47:36.504 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-06-06T08:47:36.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.504 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:36.504 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:36.504 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-06-06T08:47:36.505 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:36.505 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 4980, 2024-06-06T08:47:36.505 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 2866925, 2024-06-06T08:47:36.505 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:36.505 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 4980, 2024-06-06T08:47:36.505 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:36.505 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:36.505 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 4980, 2024-06-06T08:47:36.506 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2866925, 2024-06-06T08:47:36.506 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:36.506 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.506 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.506 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.506 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:36.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.506 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-06-06T08:47:36.507 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:36.507 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-06-06T08:47:36.507 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:36.507 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:36.507 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:36.507 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:36.507 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:36.507 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 596, 2024-06-06T08:47:36.508 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 4375778, 2024-06-06T08:47:36.508 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 596, 2024-06-06T08:47:36.508 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 4375778, 2024-06-06T08:47:36.508 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:36.508 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.508 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.508 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:36.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.509 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-06-06T08:47:36.509 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:36.509 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-06-06T08:47:36.509 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:36.509 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:36.509 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:36.509 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:36.509 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:36.510 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 596, 2024-06-06T08:47:36.510 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 596, 2024-06-06T08:47:36.510 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 596, 2024-06-06T08:47:36.510 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 596, 2024-06-06T08:47:36.510 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:36.510 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.510 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.510 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.510 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:36.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.511 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-06-06T08:47:36.511 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:36.511 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-06-06T08:47:36.511 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:36.511 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 349, 2024-06-06T08:47:36.511 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 35249, 2024-06-06T08:47:36.511 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:36.512 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 349, 2024-06-06T08:47:36.512 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:36.512 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:36.512 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 13, 2024-06-06T08:47:36.512 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 35249, 2024-06-06T08:47:36.512 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:36.512 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.512 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.512 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.513 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:36.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:36.513 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x55a055fbe460": { 2024-06-06T08:47:36.513 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 574, 2024-06-06T08:47:36.513 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-06-06T08:47:36.513 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:36.513 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 2537, 2024-06-06T08:47:36.513 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 4241520, 2024-06-06T08:47:36.514 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:36.514 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 2537, 2024-06-06T08:47:36.514 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:36.514 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:36.514 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 131, 2024-06-06T08:47:36.514 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 4240946, 2024-06-06T08:47:36.514 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:36.514 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:36.514 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:36.515 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:36.515 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:36.515 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:36.515 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-06-06T08:47:37.217 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:37 smithi059 ceph-mon[36684]: pgmap v560: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-06-06T08:47:37.247 INFO:tasks.check_counter:Daemon mds.i mds.exported=37 2024-06-06T08:47:37.247 INFO:tasks.check_counter:Daemon mds.i mds.imported=48 2024-06-06T08:47:37.247 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-06-06T08:47:37.247 DEBUG:tasks.check_counter:Getting stats from l 2024-06-06T08:47:37.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph daemon mds.l perf dump 2024-06-06T08:47:37.496 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T08:47:37.540 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:37 smithi028 ceph-mon[31564]: pgmap v560: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-06-06T08:47:37.563 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:37 smithi037 ceph-mon[36609]: pgmap v560: 97 pgs: 97 active+clean; 72 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-06-06T08:47:39.464 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-06-06T08:47:39.464 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T08:47:39.464 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 453, 2024-06-06T08:47:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 455, 2024-06-06T08:47:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 4313197, 2024-06-06T08:47:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 144118, 2024-06-06T08:47:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 6, 2024-06-06T08:47:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2024-06-06T08:47:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.050865618, 2024-06-06T08:47:39.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.013756594, 2024-06-06T08:47:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.017002373, 2024-06-06T08:47:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.014437943, 2024-06-06T08:47:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 453, 2024-06-06T08:47:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.022502384, 2024-06-06T08:47:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000049674 2024-06-06T08:47:39.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T08:47:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T08:47:39.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T08:47:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 371, 2024-06-06T08:47:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 360, 2024-06-06T08:47:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 626692, 2024-06-06T08:47:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 154433, 2024-06-06T08:47:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2024-06-06T08:47:39.468 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 3, 2024-06-06T08:47:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.050235786, 2024-06-06T08:47:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.015481976, 2024-06-06T08:47:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.021375188, 2024-06-06T08:47:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.012681772, 2024-06-06T08:47:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 359, 2024-06-06T08:47:39.469 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.018765610, 2024-06-06T08:47:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000052271 2024-06-06T08:47:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.470 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 527904, 2024-06-06T08:47:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 87648 2024-06-06T08:47:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T08:47:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 448, 2024-06-06T08:47:39.471 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 552, 2024-06-06T08:47:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 151100, 2024-06-06T08:47:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 387786, 2024-06-06T08:47:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-06-06T08:47:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 4, 2024-06-06T08:47:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.063363161, 2024-06-06T08:47:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.021307902, 2024-06-06T08:47:39.472 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.016424444, 2024-06-06T08:47:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.018919692, 2024-06-06T08:47:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T08:47:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 551, 2024-06-06T08:47:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.034326352, 2024-06-06T08:47:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000062298 2024-06-06T08:47:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.473 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-06-06T08:47:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-06-06T08:47:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 246912 2024-06-06T08:47:39.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-06-06T08:47:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-06-06T08:47:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-06-06T08:47:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.475 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-06-06T08:47:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-06-06T08:47:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-06-06T08:47:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1981, 2024-06-06T08:47:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.064831486, 2024-06-06T08:47:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000032726 2024-06-06T08:47:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.476 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-06-06T08:47:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-06-06T08:47:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-06-06T08:47:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:39.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-06-06T08:47:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 0, 2024-06-06T08:47:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 0, 2024-06-06T08:47:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-06-06T08:47:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-06-06T08:47:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-06-06T08:47:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-06-06T08:47:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-06-06T08:47:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 0, 2024-06-06T08:47:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-06-06T08:47:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-06-06T08:47:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 622, 2024-06-06T08:47:39.479 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 0, 2024-06-06T08:47:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 622, 2024-06-06T08:47:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-06-06T08:47:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 622, 2024-06-06T08:47:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 0, 2024-06-06T08:47:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 0, 2024-06-06T08:47:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 0, 2024-06-06T08:47:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 13, 2024-06-06T08:47:39.480 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 0, 2024-06-06T08:47:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 0, 2024-06-06T08:47:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-06-06T08:47:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 0, 2024-06-06T08:47:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-06-06T08:47:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-06-06T08:47:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-06-06T08:47:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-06-06T08:47:39.481 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-06-06T08:47:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-06-06T08:47:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-06-06T08:47:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-06-06T08:47:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-06-06T08:47:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-06-06T08:47:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-06-06T08:47:39.482 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-06-06T08:47:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 0, 2024-06-06T08:47:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 0, 2024-06-06T08:47:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 0, 2024-06-06T08:47:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T08:47:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-06-06T08:47:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T08:47:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-06-06T08:47:39.483 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-06-06T08:47:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T08:47:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T08:47:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-06-06T08:47:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-06-06T08:47:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T08:47:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 0, 2024-06-06T08:47:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T08:47:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T08:47:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T08:47:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 0, 2024-06-06T08:47:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 0, 2024-06-06T08:47:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 0, 2024-06-06T08:47:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 0 2024-06-06T08:47:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.485 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-06-06T08:47:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-06-06T08:47:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 0, 2024-06-06T08:47:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 0, 2024-06-06T08:47:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 0, 2024-06-06T08:47:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 0, 2024-06-06T08:47:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-06-06T08:47:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-06-06T08:47:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-06-06T08:47:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 0, 2024-06-06T08:47:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 0, 2024-06-06T08:47:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-06-06T08:47:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-06-06T08:47:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-06-06T08:47:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-06-06T08:47:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-06-06T08:47:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-06-06T08:47:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-06-06T08:47:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-06-06T08:47:39.488 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-06-06T08:47:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T08:47:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-06-06T08:47:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-06-06T08:47:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-06-06T08:47:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-06-06T08:47:39.489 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0 2024-06-06T08:47:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-06-06T08:47:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-06-06T08:47:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 0, 2024-06-06T08:47:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-06-06T08:47:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-06-06T08:47:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 2536, 2024-06-06T08:47:39.490 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-06-06T08:47:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-06-06T08:47:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 0, 2024-06-06T08:47:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-06-06T08:47:39.491 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-06-06T08:47:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 5, 2024-06-06T08:47:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-06-06T08:47:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-06-06T08:47:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-06-06T08:47:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-06-06T08:47:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 8435250, 2024-06-06T08:47:39.492 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 8433536, 2024-06-06T08:47:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-06-06T08:47:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 2536 2024-06-06T08:47:39.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-06-06T08:47:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 239, 2024-06-06T08:47:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 1323, 2024-06-06T08:47:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 1084, 2024-06-06T08:47:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 42, 2024-06-06T08:47:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 83, 2024-06-06T08:47:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 41, 2024-06-06T08:47:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 622, 2024-06-06T08:47:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 1627, 2024-06-06T08:47:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 1005, 2024-06-06T08:47:39.495 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 0, 2024-06-06T08:47:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 0, 2024-06-06T08:47:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 0, 2024-06-06T08:47:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 52744, 2024-06-06T08:47:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 215420 2024-06-06T08:47:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-06-06T08:47:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 0, 2024-06-06T08:47:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-06-06T08:47:39.496 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 0, 2024-06-06T08:47:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 0, 2024-06-06T08:47:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 0, 2024-06-06T08:47:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-06-06T08:47:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.497 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-06-06T08:47:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-06-06T08:47:39.498 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.499 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-06-06T08:47:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-06-06T08:47:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.500 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-06-06T08:47:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.501 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.502 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-06-06T08:47:39.502 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.502 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.505 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-06-06T08:47:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-06-06T08:47:39.506 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-06-06T08:47:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.507 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-06-06T08:47:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.508 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-06-06T08:47:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-06-06T08:47:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-06-06T08:47:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.510 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-06-06T08:47:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.511 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-06-06T08:47:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-06-06T08:47:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.512 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-06-06T08:47:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-06-06T08:47:39.513 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-06-06T08:47:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-06-06T08:47:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-06-06T08:47:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.515 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-06-06T08:47:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-06-06T08:47:39.516 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-06-06T08:47:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-06-06T08:47:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-06-06T08:47:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.518 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-06-06T08:47:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.519 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-06-06T08:47:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-06-06T08:47:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-06-06T08:47:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-06-06T08:47:39.520 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-06-06T08:47:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 1, 2024-06-06T08:47:39.521 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 1, 2024-06-06T08:47:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 0, 2024-06-06T08:47:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 1, 2024-06-06T08:47:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-06-06T08:47:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 0, 2024-06-06T08:47:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 0, 2024-06-06T08:47:39.522 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 1814, 2024-06-06T08:47:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-06-06T08:47:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-06-06T08:47:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-06-06T08:47:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-06-06T08:47:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T08:47:39.523 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-06-06T08:47:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T08:47:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-06-06T08:47:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T08:47:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T08:47:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T08:47:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T08:47:39.524 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T08:47:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-06-06T08:47:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T08:47:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T08:47:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-06-06T08:47:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-06-06T08:47:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-06-06T08:47:39.525 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-06-06T08:47:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T08:47:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T08:47:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T08:47:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T08:47:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T08:47:39.526 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-06-06T08:47:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-06-06T08:47:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-06-06T08:47:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T08:47:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T08:47:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-06-06T08:47:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-06-06T08:47:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-06-06T08:47:39.527 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-06-06T08:47:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T08:47:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-06-06T08:47:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T08:47:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-06-06T08:47:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 206797, 2024-06-06T08:47:39.528 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 287, 2024-06-06T08:47:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-06-06T08:47:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-06-06T08:47:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-06-06T08:47:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-06-06T08:47:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-06-06T08:47:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-06-06T08:47:39.529 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-06-06T08:47:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-06-06T08:47:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 8016, 2024-06-06T08:47:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 169, 2024-06-06T08:47:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T08:47:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-06-06T08:47:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-06-06T08:47:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-06-06T08:47:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 1040091, 2024-06-06T08:47:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 10284, 2024-06-06T08:47:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-06-06T08:47:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-06-06T08:47:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-06-06T08:47:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-06-06T08:47:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-06-06T08:47:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-06-06T08:47:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-06-06T08:47:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 1106, 2024-06-06T08:47:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 21, 2024-06-06T08:47:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 3, 2024-06-06T08:47:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 1106, 2024-06-06T08:47:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-06-06T08:47:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1106, 2024-06-06T08:47:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.915988501, 2024-06-06T08:47:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000828199 2024-06-06T08:47:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.532 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-06-06T08:47:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-06-06T08:47:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1106, 2024-06-06T08:47:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 1107 2024-06-06T08:47:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 1106, 2024-06-06T08:47:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 1106, 2024-06-06T08:47:39.533 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 0, 2024-06-06T08:47:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-06-06T08:47:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-06-06T08:47:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 638, 2024-06-06T08:47:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 0, 2024-06-06T08:47:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 466, 2024-06-06T08:47:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 0, 2024-06-06T08:47:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 0, 2024-06-06T08:47:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-06-06T08:47:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-06-06T08:47:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-06-06T08:47:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-06-06T08:47:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 0, 2024-06-06T08:47:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-06-06T08:47:39.535 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-06-06T08:47:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-06-06T08:47:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 1, 2024-06-06T08:47:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 0, 2024-06-06T08:47:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-06-06T08:47:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-06-06T08:47:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-06-06T08:47:39.536 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-06-06T08:47:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-06-06T08:47:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-06-06T08:47:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T08:47:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-06-06T08:47:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-06-06T08:47:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-06-06T08:47:39.537 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-06-06T08:47:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-06-06T08:47:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-06-06T08:47:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-06-06T08:47:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-06-06T08:47:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-06-06T08:47:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-06-06T08:47:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-06-06T08:47:39.538 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-06-06T08:47:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-06-06T08:47:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-06-06T08:47:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-06-06T08:47:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-06-06T08:47:39.539 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-06-06T08:47:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-06-06T08:47:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-06-06T08:47:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 92, 2024-06-06T08:47:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-06-06T08:47:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 4, 2024-06-06T08:47:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 6, 2024-06-06T08:47:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 6, 2024-06-06T08:47:39.540 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 0, 2024-06-06T08:47:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-06-06T08:47:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 0, 2024-06-06T08:47:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 2, 2024-06-06T08:47:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 0 2024-06-06T08:47:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.541 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-06-06T08:47:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 0, 2024-06-06T08:47:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-06-06T08:47:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-06-06T08:47:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-06-06T08:47:39.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: "osd-slow-ops": { 2024-06-06T08:47:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-06-06T08:47:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-06-06T08:47:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-06-06T08:47:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T08:47:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-06-06T08:47:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 0, 2024-06-06T08:47:39.543 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 0, 2024-06-06T08:47:39.544 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 0, 2024-06-06T08:47:39.544 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-06-06T08:47:39.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.544 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T08:47:39.544 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:39.544 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-06-06T08:47:39.545 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:39.545 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 1268, 2024-06-06T08:47:39.545 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 4965650, 2024-06-06T08:47:39.545 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:39.545 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 1268, 2024-06-06T08:47:39.545 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:39.545 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:39.545 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 1268, 2024-06-06T08:47:39.546 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 4965650, 2024-06-06T08:47:39.546 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:39.546 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.546 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.546 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.546 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:39.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.546 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-06-06T08:47:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-06-06T08:47:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 1106, 2024-06-06T08:47:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 4240951, 2024-06-06T08:47:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 1106, 2024-06-06T08:47:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 4240951, 2024-06-06T08:47:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:39.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-06-06T08:47:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-06-06T08:47:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:39.549 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 1106, 2024-06-06T08:47:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 1106, 2024-06-06T08:47:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 1106, 2024-06-06T08:47:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1106, 2024-06-06T08:47:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.550 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-06-06T08:47:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-06-06T08:47:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:39.551 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-06-06T08:47:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-06-06T08:47:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:39.552 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-06-06T08:47:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x55652605c6e0": { 2024-06-06T08:47:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-06-06T08:47:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-06-06T08:47:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-06-06T08:47:39.553 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-06-06T08:47:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-06-06T08:47:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-06-06T08:47:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-06-06T08:47:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-06-06T08:47:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-06-06T08:47:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-06-06T08:47:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-06-06T08:47:39.554 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-06-06T08:47:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-06-06T08:47:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-06-06T08:47:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-06-06T08:47:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:39.555 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-06-06T08:47:39.555 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-06-06T08:47:39.599 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:39 smithi059 ceph-mon[36684]: pgmap v561: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-06-06T08:47:39.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:39 smithi028 ceph-mon[31564]: pgmap v561: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-06-06T08:47:39.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:39 smithi037 ceph-mon[36609]: pgmap v561: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-06-06T08:47:40.297 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-06-06T08:47:40.298 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-06-06T08:47:40.298 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-06-06T08:47:40.298 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-06-06T08:47:40.309 INFO:tasks.kclient:Unmounting kernel clients... 2024-06-06T08:47:40.309 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:47:40.309 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-06T08:47:40.372 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-06-06T08:47:40.372 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-06T08:47:40.427 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-06T08:47:40.895 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:47:41.661 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:41 smithi028 ceph-mon[31564]: pgmap v562: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-06-06T08:47:41.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:41 smithi037 ceph-mon[36609]: pgmap v562: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-06-06T08:47:41.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:41 smithi059 ceph-mon[36684]: pgmap v562: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-06-06T08:47:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.414+0000 7fd4d0c00700 1 -- 172.21.15.28:0/468336622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4cc102740 msgr2=0x7fd4cc102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.414+0000 7fd4d0c00700 1 --2- 172.21.15.28:0/468336622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4cc102740 0x7fd4cc102b20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0099c0 tx=0x7fd4bc009cd0 comp rx=0 tx=0).stop 2024-06-06T08:47:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.414+0000 7fd4d0c00700 1 -- 172.21.15.28:0/468336622 shutdown_connections 2024-06-06T08:47:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.414+0000 7fd4d0c00700 1 --2- 172.21.15.28:0/468336622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc107840 0x7fd4cc10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.414+0000 7fd4d0c00700 1 --2- 172.21.15.28:0/468336622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4cc102740 0x7fd4cc102b20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.414+0000 7fd4d0c00700 1 --2- 172.21.15.28:0/468336622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4cc1030f0 0x7fd4cc107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.414+0000 7fd4d0c00700 1 -- 172.21.15.28:0/468336622 >> 172.21.15.28:0/468336622 conn(0x7fd4cc0795f0 msgr2=0x7fd4cc079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:47:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.414+0000 7fd4d0c00700 1 -- 172.21.15.28:0/468336622 shutdown_connections 2024-06-06T08:47:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.415+0000 7fd4d0c00700 1 -- 172.21.15.28:0/468336622 wait complete. 2024-06-06T08:47:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.416+0000 7fd4d0c00700 1 Processor -- start 2024-06-06T08:47:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.416+0000 7fd4d0c00700 1 -- start start 2024-06-06T08:47:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.416+0000 7fd4d0c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4cc102740 0x7fd4cc19aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.416+0000 7fd4d0c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4cc1030f0 0x7fd4cc19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.416+0000 7fd4d0c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc107840 0x7fd4cc19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.416+0000 7fd4d0c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc1127d0 con 0x7fd4cc102740 2024-06-06T08:47:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.416+0000 7fd4d0c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc112650 con 0x7fd4cc107840 2024-06-06T08:47:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.416+0000 7fd4d0c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc112950 con 0x7fd4cc1030f0 2024-06-06T08:47:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.417+0000 7fd4c9e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4cc102740 0x7fd4cc19aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.417+0000 7fd4c9e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4cc102740 0x7fd4cc19aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50436/0 (socket says 172.21.15.28:50436) 2024-06-06T08:47:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.417+0000 7fd4c9e00700 1 -- 172.21.15.28:0/776520624 learned_addr learned my addr 172.21.15.28:0/776520624 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:47:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.417+0000 7fd4c9400700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4cc1030f0 0x7fd4cc19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.417+0000 7fd4ca800700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc107840 0x7fd4cc19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.417+0000 7fd4c9e00700 1 -- 172.21.15.28:0/776520624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4cc1030f0 msgr2=0x7fd4cc19b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.417+0000 7fd4c9e00700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4cc1030f0 0x7fd4cc19b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.417+0000 7fd4c9e00700 1 -- 172.21.15.28:0/776520624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc107840 msgr2=0x7fd4cc19f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.417+0000 7fd4c9e00700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc107840 0x7fd4cc19f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.417+0000 7fd4c9e00700 1 -- 172.21.15.28:0/776520624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4cc19fe10 con 0x7fd4cc102740 2024-06-06T08:47:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.418+0000 7fd4c9e00700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4cc102740 0x7fd4cc19aea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc006010 tx=0x7fd4bc003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:47:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.418+0000 7fd4c2a00700 1 -- 172.21.15.28:0/776520624 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc003e50 con 0x7fd4cc102740 2024-06-06T08:47:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.418+0000 7fd4c2a00700 1 -- 172.21.15.28:0/776520624 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4bc0055a0 con 0x7fd4cc102740 2024-06-06T08:47:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.418+0000 7fd4d0c00700 1 -- 172.21.15.28:0/776520624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4cc1a00a0 con 0x7fd4cc102740 2024-06-06T08:47:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.418+0000 7fd4c2a00700 1 -- 172.21.15.28:0/776520624 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc00fe30 con 0x7fd4cc102740 2024-06-06T08:47:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.418+0000 7fd4d0c00700 1 -- 172.21.15.28:0/776520624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4cc1a7980 con 0x7fd4cc102740 2024-06-06T08:47:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.419+0000 7fd4d0c00700 1 -- 172.21.15.28:0/776520624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4cc103bd0 con 0x7fd4cc102740 2024-06-06T08:47:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.422+0000 7fd4c2a00700 1 -- 172.21.15.28:0/776520624 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd4bc00f4f0 con 0x7fd4cc102740 2024-06-06T08:47:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.423+0000 7fd4c2a00700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd4b00a2dc0 0x7fd4b00a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.423+0000 7fd4c2a00700 1 -- 172.21.15.28:0/776520624 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fd4bc0cff50 con 0x7fd4cc102740 2024-06-06T08:47:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.424+0000 7fd4c9400700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd4b00a2dc0 0x7fd4b00a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.424+0000 7fd4c9400700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd4b00a2dc0 0x7fd4b00a5280 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc10f800 tx=0x7fd4b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:47:43.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.431+0000 7fd4c2a00700 1 -- 172.21.15.28:0/776520624 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd4bc013070 con 0x7fd4cc102740 2024-06-06T08:47:43.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.678+0000 7fd4d0c00700 1 -- 172.21.15.28:0/776520624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd4cc19c200 con 0x7fd4cc102740 2024-06-06T08:47:43.677 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:43 smithi028 ceph-mon[31564]: pgmap v563: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-06-06T08:47:43.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.679+0000 7fd4c2a00700 1 -- 172.21.15.28:0/776520624 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v92) ==== 81+0+590 (secure 0 0 0) 0x7fd4bc09ce60 con 0x7fd4cc102740 2024-06-06T08:47:43.678 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/4230567915 2024-06-07T08:31:40.064884+0000 2024-06-06T08:47:43.678 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:6801/2022015677 2024-06-07T08:31:40.064884+0000 2024-06-06T08:47:43.678 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:6800/3383589520 2024-06-07T08:31:04.770627+0000 2024-06-06T08:47:43.679 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/2860387445 2024-06-07T08:31:04.770627+0000 2024-06-06T08:47:43.679 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/886961600 2024-06-07T08:31:40.064884+0000 2024-06-06T08:47:43.679 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:6800/2022015677 2024-06-07T08:31:40.064884+0000 2024-06-06T08:47:43.679 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:6801/3383589520 2024-06-07T08:31:04.770627+0000 2024-06-06T08:47:43.679 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/3217551014 2024-06-07T08:31:40.064884+0000 2024-06-06T08:47:43.679 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/1629731223 2024-06-07T08:31:04.770627+0000 2024-06-06T08:47:43.679 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28:0/219831273 2024-06-07T08:31:04.770627+0000 2024-06-06T08:47:43.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 -- 172.21.15.28:0/776520624 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd4b00a2dc0 msgr2=0x7fd4b00a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:43.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd4b00a2dc0 0x7fd4b00a5280 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc10f800 tx=0x7fd4b8009260 comp rx=0 tx=0).stop 2024-06-06T08:47:43.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 -- 172.21.15.28:0/776520624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4cc102740 msgr2=0x7fd4cc19aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:43.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4cc102740 0x7fd4cc19aea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc006010 tx=0x7fd4bc003a90 comp rx=0 tx=0).stop 2024-06-06T08:47:43.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 -- 172.21.15.28:0/776520624 shutdown_connections 2024-06-06T08:47:43.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd4b00a2dc0 0x7fd4b00a5280 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:43.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4cc107840 0x7fd4cc19f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:43.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4cc102740 0x7fd4cc19aea0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:43.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 --2- 172.21.15.28:0/776520624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4cc1030f0 0x7fd4cc19b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:43.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 -- 172.21.15.28:0/776520624 >> 172.21.15.28:0/776520624 conn(0x7fd4cc0795f0 msgr2=0x7fd4cc101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:47:43.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 -- 172.21.15.28:0/776520624 shutdown_connections 2024-06-06T08:47:43.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:43.684+0000 7fd4d0c00700 1 -- 172.21.15.28:0/776520624 wait complete. 2024-06-06T08:47:43.684 INFO:teuthology.orchestra.run.smithi028.stderr:listed 10 entries 2024-06-06T08:47:43.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:43 smithi037 ceph-mon[36609]: pgmap v563: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-06-06T08:47:43.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:43 smithi059 ceph-mon[36684]: pgmap v563: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-06-06T08:47:44.492 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:44 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/776520624' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T08:47:44.566 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-06T08:47:44.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:47:44.566 DEBUG:teuthology.orchestra.run.smithi028:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-06-06T08:47:44.811 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-06-06T08:47:44.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:47:44.812 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-06T08:47:44.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:44 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/776520624' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T08:47:44.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:44 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/776520624' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T08:47:44.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:47:44.890 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-06-06T08:47:44.967 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-06T08:47:44.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:47:44.968 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-06T08:47:45.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T08:47:45.032 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link delete ceph-brx 2024-06-06T08:47:45.140 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-06-06T08:47:45.150 INFO:tasks.cephadm:Teardown begin 2024-06-06T08:47:45.151 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-06T08:47:45.151 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:47:45.584 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:47:45.770 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:45 smithi028 ceph-mon[31564]: pgmap v564: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-06-06T08:47:45.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:45 smithi037 ceph-mon[36609]: pgmap v564: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-06-06T08:47:45.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:45 smithi059 ceph-mon[36684]: pgmap v564: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-06-06T08:47:47.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:47 smithi028 ceph-mon[31564]: pgmap v565: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-06-06T08:47:47.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.778+0000 7ff875c00700 1 -- 172.21.15.28:0/2971904110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8701045c0 msgr2=0x7ff870104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:47.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.778+0000 7ff875c00700 1 --2- 172.21.15.28:0/2971904110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8701045c0 0x7ff870104a40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff858009990 tx=0x7ff858009ca0 comp rx=0 tx=0).stop 2024-06-06T08:47:47.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.778+0000 7ff875c00700 1 -- 172.21.15.28:0/2971904110 shutdown_connections 2024-06-06T08:47:47.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.778+0000 7ff875c00700 1 --2- 172.21.15.28:0/2971904110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff870104f80 0x7ff870111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:47.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.778+0000 7ff875c00700 1 --2- 172.21.15.28:0/2971904110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87010a650 0x7ff87010aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:47.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.778+0000 7ff875c00700 1 --2- 172.21.15.28:0/2971904110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8701045c0 0x7ff870104a40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:47.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.778+0000 7ff875c00700 1 -- 172.21.15.28:0/2971904110 >> 172.21.15.28:0/2971904110 conn(0x7ff8701000b0 msgr2=0x7ff8701024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:47:47.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.779+0000 7ff875c00700 1 -- 172.21.15.28:0/2971904110 shutdown_connections 2024-06-06T08:47:47.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.779+0000 7ff875c00700 1 -- 172.21.15.28:0/2971904110 wait complete. 2024-06-06T08:47:47.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.780+0000 7ff875c00700 1 Processor -- start 2024-06-06T08:47:47.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.780+0000 7ff875c00700 1 -- start start 2024-06-06T08:47:47.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.781+0000 7ff875c00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8701045c0 0x7ff8701a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:47.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.781+0000 7ff875c00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff870104f80 0x7ff8701a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:47.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.781+0000 7ff875c00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff87010a650 0x7ff87019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:47.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.781+0000 7ff875c00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff870114960 con 0x7ff870104f80 2024-06-06T08:47:47.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.781+0000 7ff875c00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff8701147e0 con 0x7ff87010a650 2024-06-06T08:47:47.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.781+0000 7ff875c00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff870114ae0 con 0x7ff8701045c0 2024-06-06T08:47:47.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.781+0000 7ff86fe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8701045c0 0x7ff8701a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:47.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.781+0000 7ff86fe00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8701045c0 0x7ff8701a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:57188/0 (socket says 172.21.15.28:57188) 2024-06-06T08:47:47.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.781+0000 7ff867400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff870104f80 0x7ff8701a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:47.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.781+0000 7ff86fe00700 1 -- 172.21.15.28:0/2224066215 learned_addr learned my addr 172.21.15.28:0/2224066215 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:47:47.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.781+0000 7ff875200700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff87010a650 0x7ff87019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:47.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.782+0000 7ff86fe00700 1 -- 172.21.15.28:0/2224066215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff87010a650 msgr2=0x7ff87019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:47.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.782+0000 7ff86fe00700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff87010a650 0x7ff87019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:47.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.782+0000 7ff86fe00700 1 -- 172.21.15.28:0/2224066215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff870104f80 msgr2=0x7ff8701a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:47.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.782+0000 7ff86fe00700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff870104f80 0x7ff8701a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:47.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.782+0000 7ff86fe00700 1 -- 172.21.15.28:0/2224066215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87019b240 con 0x7ff8701045c0 2024-06-06T08:47:47.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.782+0000 7ff86fe00700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8701045c0 0x7ff8701a0920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff86000e970 tx=0x7ff86000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:47:47.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.782+0000 7ff86d600700 1 -- 172.21.15.28:0/2224066215 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860004220 con 0x7ff8701045c0 2024-06-06T08:47:47.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.782+0000 7ff86d600700 1 -- 172.21.15.28:0/2224066215 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8600043c0 con 0x7ff8701045c0 2024-06-06T08:47:47.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.782+0000 7ff86d600700 1 -- 172.21.15.28:0/2224066215 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860003dc0 con 0x7ff8701045c0 2024-06-06T08:47:47.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.782+0000 7ff875c00700 1 -- 172.21.15.28:0/2224066215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87019b530 con 0x7ff8701045c0 2024-06-06T08:47:47.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.782+0000 7ff875c00700 1 -- 172.21.15.28:0/2224066215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8701a77f0 con 0x7ff8701045c0 2024-06-06T08:47:47.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.784+0000 7ff875c00700 1 -- 172.21.15.28:0/2224066215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff870069180 con 0x7ff8701045c0 2024-06-06T08:47:47.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.785+0000 7ff86d600700 1 -- 172.21.15.28:0/2224066215 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff86000c7e0 con 0x7ff8701045c0 2024-06-06T08:47:47.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.787+0000 7ff86d600700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff8540a2c20 0x7ff8540a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:47.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.787+0000 7ff86d600700 1 -- 172.21.15.28:0/2224066215 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7ff8600cf300 con 0x7ff8701045c0 2024-06-06T08:47:47.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.787+0000 7ff867400700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff8540a2c20 0x7ff8540a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:47.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.788+0000 7ff867400700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff8540a2c20 0x7ff8540a50e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff870109c00 tx=0x7ff85800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:47:47.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:47.791+0000 7ff86d600700 1 -- 172.21.15.28:0/2224066215 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff86009c180 con 0x7ff8701045c0 2024-06-06T08:47:47.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:47 smithi037 ceph-mon[36609]: pgmap v565: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-06-06T08:47:47.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:47 smithi059 ceph-mon[36684]: pgmap v565: 97 pgs: 97 active+clean; 72 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-06-06T08:47:48.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.070+0000 7ff875c00700 1 -- 172.21.15.28:0/2224066215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff87019bfd0 con 0x7ff8701045c0 2024-06-06T08:47:48.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.072+0000 7ff86d600700 1 -- 172.21.15.28:0/2224066215 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11921 (secure 0 0 0) 0x7ff86009ba80 con 0x7ff8701045c0 2024-06-06T08:47:48.072 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:47:48.072 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T08:40:05.416261+0000","modified":"2024-06-06T08:47:14.246527+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24542,"mds_1":24503,"mds_2":24499,"mds_3":24485,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14388":{"gid":14388,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6839/735176440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":735176440},{"type":"v1","addr":"172.21.15.28:6839","nonce":735176440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14400":{"gid":14400,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6841/3192274308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":3192274308},{"type":"v1","addr":"172.21.15.28:6841","nonce":3192274308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6839/771325139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":771325139},{"type":"v1","addr":"172.21.15.59:6839","nonce":771325139}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.37:6839/527311102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":527311102},{"type":"v1","addr":"172.21.15.37:6839","nonce":527311102}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24503,24542,24484,24485,24499]},"id":1}]} 2024-06-06T08:47:48.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 -- 172.21.15.28:0/2224066215 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff8540a2c20 msgr2=0x7ff8540a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:48.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff8540a2c20 0x7ff8540a50e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff870109c00 tx=0x7ff85800b260 comp rx=0 tx=0).stop 2024-06-06T08:47:48.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 -- 172.21.15.28:0/2224066215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8701045c0 msgr2=0x7ff8701a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:48.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8701045c0 0x7ff8701a0920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff86000e970 tx=0x7ff86000ec80 comp rx=0 tx=0).stop 2024-06-06T08:47:48.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 -- 172.21.15.28:0/2224066215 shutdown_connections 2024-06-06T08:47:48.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7ff8540a2c20 0x7ff8540a50e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:48.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff87010a650 0x7ff87019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:48.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8701045c0 0x7ff8701a0920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:48.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 --2- 172.21.15.28:0/2224066215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff870104f80 0x7ff8701a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:48.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 -- 172.21.15.28:0/2224066215 >> 172.21.15.28:0/2224066215 conn(0x7ff8701000b0 msgr2=0x7ff8701015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:47:48.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 -- 172.21.15.28:0/2224066215 shutdown_connections 2024-06-06T08:47:48.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:48.075+0000 7ff875c00700 1 -- 172.21.15.28:0/2224066215 wait complete. 2024-06-06T08:47:48.076 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 35 2024-06-06T08:47:48.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:48 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/2224066215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:47:48.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:48 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/2224066215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:47:48.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:48 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/2224066215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:47:48.991 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T08:47:49.478 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:47:49.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:49 smithi028 ceph-mon[31564]: pgmap v566: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-06-06T08:47:49.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:49 smithi037 ceph-mon[36609]: pgmap v566: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-06-06T08:47:49.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:49 smithi059 ceph-mon[36684]: pgmap v566: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-06-06T08:47:51.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:51 smithi028 ceph-mon[31564]: pgmap v567: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-06-06T08:47:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.797+0000 7fa89d000700 1 -- 172.21.15.28:0/2001611536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa898107700 msgr2=0x7fa89810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.797+0000 7fa89d000700 1 --2- 172.21.15.28:0/2001611536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa898107700 0x7fa89810f2d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa89000b0d0 tx=0x7fa89000b3e0 comp rx=0 tx=0).stop 2024-06-06T08:47:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.797+0000 7fa89d000700 1 -- 172.21.15.28:0/2001611536 shutdown_connections 2024-06-06T08:47:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.797+0000 7fa89d000700 1 --2- 172.21.15.28:0/2001611536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa898107700 0x7fa89810f2d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.797+0000 7fa89d000700 1 --2- 172.21.15.28:0/2001611536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa898102620 0x7fa898102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.797+0000 7fa89d000700 1 --2- 172.21.15.28:0/2001611536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898102fd0 0x7fa898107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.797+0000 7fa89d000700 1 -- 172.21.15.28:0/2001611536 >> 172.21.15.28:0/2001611536 conn(0x7fa8980fdf10 msgr2=0x7fa898100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:47:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.797+0000 7fa89d000700 1 -- 172.21.15.28:0/2001611536 shutdown_connections 2024-06-06T08:47:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.797+0000 7fa89d000700 1 -- 172.21.15.28:0/2001611536 wait complete. 2024-06-06T08:47:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.799+0000 7fa89d000700 1 Processor -- start 2024-06-06T08:47:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.799+0000 7fa89d000700 1 -- start start 2024-06-06T08:47:51.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa89d000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa898102620 0x7fa89819e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:51.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa89d000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898102fd0 0x7fa89819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:51.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa89d000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa898107700 0x7fa898198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa89d000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981126f0 con 0x7fa898102620 2024-06-06T08:47:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa89d000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa898112570 con 0x7fa898102fd0 2024-06-06T08:47:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa89d000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa898112870 con 0x7fa898107700 2024-06-06T08:47:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa897400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa898102620 0x7fa89819e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa88ea00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898102fd0 0x7fa89819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa88ea00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898102fd0 0x7fa89819ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:43680/0 (socket says 172.21.15.28:43680) 2024-06-06T08:47:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa88ea00700 1 -- 172.21.15.28:0/733396220 learned_addr learned my addr 172.21.15.28:0/733396220 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:47:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa897e00700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa898107700 0x7fa898198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:51.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa88ea00700 1 -- 172.21.15.28:0/733396220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa898107700 msgr2=0x7fa898198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:51.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa88ea00700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa898107700 0x7fa898198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:51.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa88ea00700 1 -- 172.21.15.28:0/733396220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa898102620 msgr2=0x7fa89819e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:51.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa88ea00700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa898102620 0x7fa89819e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:51.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.800+0000 7fa88ea00700 1 -- 172.21.15.28:0/733396220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8981990b0 con 0x7fa898102fd0 2024-06-06T08:47:51.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.801+0000 7fa88ea00700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898102fd0 0x7fa89819ecd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa88000e970 tx=0x7fa88000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:47:51.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.801+0000 7fa894c00700 1 -- 172.21.15.28:0/733396220 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa880004a30 con 0x7fa898102fd0 2024-06-06T08:47:51.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.801+0000 7fa894c00700 1 -- 172.21.15.28:0/733396220 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa88000ccc0 con 0x7fa898102fd0 2024-06-06T08:47:51.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.801+0000 7fa89d000700 1 -- 172.21.15.28:0/733396220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8981993a0 con 0x7fa898102fd0 2024-06-06T08:47:51.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.801+0000 7fa894c00700 1 -- 172.21.15.28:0/733396220 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa880005650 con 0x7fa898102fd0 2024-06-06T08:47:51.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.801+0000 7fa89d000700 1 -- 172.21.15.28:0/733396220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8981a5660 con 0x7fa898102fd0 2024-06-06T08:47:51.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.802+0000 7fa89d000700 1 -- 172.21.15.28:0/733396220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa898069180 con 0x7fa898102fd0 2024-06-06T08:47:51.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.805+0000 7fa894c00700 1 -- 172.21.15.28:0/733396220 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa880004bd0 con 0x7fa898102fd0 2024-06-06T08:47:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.806+0000 7fa894c00700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa87c0a2c20 0x7fa87c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.806+0000 7fa894c00700 1 -- 172.21.15.28:0/733396220 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fa8800cf4c0 con 0x7fa898102fd0 2024-06-06T08:47:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.806+0000 7fa897400700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa87c0a2c20 0x7fa87c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.807+0000 7fa897400700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa87c0a2c20 0x7fa87c0a50e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa898199a90 tx=0x7fa888009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:47:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:51.808+0000 7fa894c00700 1 -- 172.21.15.28:0/733396220 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa880053850 con 0x7fa898102fd0 2024-06-06T08:47:51.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:51 smithi037 ceph-mon[36609]: pgmap v567: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-06-06T08:47:51.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:51 smithi059 ceph-mon[36684]: pgmap v567: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-06-06T08:47:52.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.085+0000 7fa89d000700 1 -- 172.21.15.28:0/733396220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa898199e80 con 0x7fa898102fd0 2024-06-06T08:47:52.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.086+0000 7fa894c00700 1 -- 172.21.15.28:0/733396220 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11921 (secure 0 0 0) 0x7fa88009c340 con 0x7fa898102fd0 2024-06-06T08:47:52.086 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:47:52.086 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14358,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/906327649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":906327649},{"type":"v1","addr":"172.21.15.28:6835","nonce":906327649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14364,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/165707269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":165707269},{"type":"v1","addr":"172.21.15.28:6837","nonce":165707269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T08:40:05.416261+0000","modified":"2024-06-06T08:47:14.246527+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24542,"mds_1":24503,"mds_2":24499,"mds_3":24485,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14388":{"gid":14388,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6839/735176440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6838","nonce":735176440},{"type":"v1","addr":"172.21.15.28:6839","nonce":735176440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14400":{"gid":14400,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.28:6841/3192274308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6840","nonce":3192274308},{"type":"v1","addr":"172.21.15.28:6841","nonce":3192274308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/3120575580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3120575580},{"type":"v1","addr":"172.21.15.59:6833","nonce":3120575580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6833/1955606328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1955606328},{"type":"v1","addr":"172.21.15.37:6833","nonce":1955606328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2983089313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2983089313},{"type":"v1","addr":"172.21.15.59:6835","nonce":2983089313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":17,"addr":"172.21.15.59:6837/2388488967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2388488967},{"type":"v1","addr":"172.21.15.59:6837","nonce":2388488967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.37:6835/2566253946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2566253946},{"type":"v1","addr":"172.21.15.37:6835","nonce":2566253946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6839/771325139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":771325139},{"type":"v1","addr":"172.21.15.59:6839","nonce":771325139}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.37:6837/1443905946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1443905946},{"type":"v1","addr":"172.21.15.37:6837","nonce":1443905946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.37:6839/527311102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":527311102},{"type":"v1","addr":"172.21.15.37:6839","nonce":527311102}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24542,"qdb_cluster":[24503,24542,24484,24485,24499]},"id":1}]} 2024-06-06T08:47:52.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.090+0000 7fa89d000700 1 -- 172.21.15.28:0/733396220 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa87c0a2c20 msgr2=0x7fa87c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:52.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.090+0000 7fa89d000700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa87c0a2c20 0x7fa87c0a50e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa898199a90 tx=0x7fa888009260 comp rx=0 tx=0).stop 2024-06-06T08:47:52.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.090+0000 7fa89d000700 1 -- 172.21.15.28:0/733396220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898102fd0 msgr2=0x7fa89819ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:52.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.090+0000 7fa89d000700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898102fd0 0x7fa89819ecd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa88000e970 tx=0x7fa88000ec80 comp rx=0 tx=0).stop 2024-06-06T08:47:52.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.090+0000 7fa89d000700 1 -- 172.21.15.28:0/733396220 shutdown_connections 2024-06-06T08:47:52.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.090+0000 7fa89d000700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fa87c0a2c20 0x7fa87c0a50e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:52.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.090+0000 7fa89d000700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa898107700 0x7fa898198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:52.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.090+0000 7fa89d000700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa898102620 0x7fa89819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:52.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.090+0000 7fa89d000700 1 --2- 172.21.15.28:0/733396220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa898102fd0 0x7fa89819ecd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:52.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.090+0000 7fa89d000700 1 -- 172.21.15.28:0/733396220 >> 172.21.15.28:0/733396220 conn(0x7fa8980fdf10 msgr2=0x7fa8980fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:47:52.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.091+0000 7fa89d000700 1 -- 172.21.15.28:0/733396220 shutdown_connections 2024-06-06T08:47:52.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:52.091+0000 7fa89d000700 1 -- 172.21.15.28:0/733396220 wait complete. 2024-06-06T08:47:52.092 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 35 2024-06-06T08:47:52.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:52 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/733396220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:47:52.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:52 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/733396220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:47:52.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:52 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/733396220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T08:47:53.124 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T08:47:53.598 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:47:53.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:53 smithi028 ceph-mon[31564]: pgmap v568: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-06-06T08:47:53.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:53 smithi037 ceph-mon[36609]: pgmap v568: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-06-06T08:47:53.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:53 smithi059 ceph-mon[36684]: pgmap v568: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-06-06T08:47:55.782 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:55 smithi028 ceph-mon[31564]: pgmap v569: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-06-06T08:47:55.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:55 smithi037 ceph-mon[36609]: pgmap v569: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-06-06T08:47:55.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:55 smithi059 ceph-mon[36684]: pgmap v569: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-06-06T08:47:55.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.957+0000 7fe50ca00700 1 -- 172.21.15.28:0/3135159631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe508113240 msgr2=0x7fe508115630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:55.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.957+0000 7fe50ca00700 1 --2- 172.21.15.28:0/3135159631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe508113240 0x7fe508115630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe50000b0a0 tx=0x7fe50000b3b0 comp rx=0 tx=0).stop 2024-06-06T08:47:55.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.957+0000 7fe50ca00700 1 -- 172.21.15.28:0/3135159631 shutdown_connections 2024-06-06T08:47:55.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.957+0000 7fe50ca00700 1 --2- 172.21.15.28:0/3135159631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe508113240 0x7fe508115630 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:55.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.957+0000 7fe50ca00700 1 --2- 172.21.15.28:0/3135159631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5080769c0 0x7fe508076da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:55.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.957+0000 7fe50ca00700 1 --2- 172.21.15.28:0/3135159631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe5080772e0 0x7fe508112d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:55.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.958+0000 7fe50ca00700 1 -- 172.21.15.28:0/3135159631 >> 172.21.15.28:0/3135159631 conn(0x7fe5081000d0 msgr2=0x7fe5081024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:47:55.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.958+0000 7fe50ca00700 1 -- 172.21.15.28:0/3135159631 shutdown_connections 2024-06-06T08:47:55.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.958+0000 7fe50ca00700 1 -- 172.21.15.28:0/3135159631 wait complete. 2024-06-06T08:47:55.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.959+0000 7fe50ca00700 1 Processor -- start 2024-06-06T08:47:55.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.959+0000 7fe50ca00700 1 -- start start 2024-06-06T08:47:55.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.960+0000 7fe50ca00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5080769c0 0x7fe50819f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:55.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.960+0000 7fe50ca00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5080772e0 0x7fe50819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:55.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.960+0000 7fe50ca00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe508113240 0x7fe5081a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:55.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.960+0000 7fe50ca00700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe508118ce0 con 0x7fe508113240 2024-06-06T08:47:55.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.960+0000 7fe50ca00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe508118b60 con 0x7fe5080772e0 2024-06-06T08:47:55.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.960+0000 7fe50ca00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe508118e60 con 0x7fe5080769c0 2024-06-06T08:47:55.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.960+0000 7fe507e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe508113240 0x7fe5081a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:55.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.960+0000 7fe507400700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5080769c0 0x7fe50819f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:55.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.960+0000 7fe506a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5080772e0 0x7fe50819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:55.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.961+0000 7fe507e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe508113240 0x7fe5081a3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60226/0 (socket says 172.21.15.28:60226) 2024-06-06T08:47:55.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.961+0000 7fe507e00700 1 -- 172.21.15.28:0/1247654829 learned_addr learned my addr 172.21.15.28:0/1247654829 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:47:55.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.961+0000 7fe507e00700 1 -- 172.21.15.28:0/1247654829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5080769c0 msgr2=0x7fe50819f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:55.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.961+0000 7fe507e00700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5080769c0 0x7fe50819f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:55.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.961+0000 7fe507e00700 1 -- 172.21.15.28:0/1247654829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5080772e0 msgr2=0x7fe50819f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:55.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.961+0000 7fe507e00700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5080772e0 0x7fe50819f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:55.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.961+0000 7fe507e00700 1 -- 172.21.15.28:0/1247654829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5081a41a0 con 0x7fe508113240 2024-06-06T08:47:55.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.961+0000 7fe506a00700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5080772e0 0x7fe50819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:47:55.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.961+0000 7fe507400700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5080769c0 0x7fe50819f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:47:55.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.961+0000 7fe507e00700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe508113240 0x7fe5081a3a60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe500004d00 tx=0x7fe500004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:47:55.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.962+0000 7fe4ffe00700 1 -- 172.21.15.28:0/1247654829 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500021070 con 0x7fe508113240 2024-06-06T08:47:55.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.962+0000 7fe50ca00700 1 -- 172.21.15.28:0/1247654829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5081a4430 con 0x7fe508113240 2024-06-06T08:47:55.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.962+0000 7fe4ffe00700 1 -- 172.21.15.28:0/1247654829 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe500007b80 con 0x7fe508113240 2024-06-06T08:47:55.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.962+0000 7fe50ca00700 1 -- 172.21.15.28:0/1247654829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5081abd10 con 0x7fe508113240 2024-06-06T08:47:55.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.962+0000 7fe4ffe00700 1 -- 172.21.15.28:0/1247654829 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50002b060 con 0x7fe508113240 2024-06-06T08:47:55.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.963+0000 7fe50ca00700 1 -- 172.21.15.28:0/1247654829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe508069180 con 0x7fe508113240 2024-06-06T08:47:55.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.967+0000 7fe4ffe00700 1 -- 172.21.15.28:0/1247654829 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe500024070 con 0x7fe508113240 2024-06-06T08:47:55.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.968+0000 7fe4ffe00700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe4ec0a2c20 0x7fe4ec0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:47:55.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.968+0000 7fe4ffe00700 1 -- 172.21.15.28:0/1247654829 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7fe5000d0330 con 0x7fe508113240 2024-06-06T08:47:55.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.968+0000 7fe507400700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe4ec0a2c20 0x7fe4ec0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:47:55.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.969+0000 7fe507400700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe4ec0a2c20 0x7fe4ec0a50e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8011490 tx=0x7fe4f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:47:55.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:55.971+0000 7fe4ffe00700 1 -- 172.21.15.28:0/1247654829 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe50009d360 con 0x7fe508113240 2024-06-06T08:47:56.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.203+0000 7fe50ca00700 1 -- 172.21.15.28:0/1247654829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe50802dca0 con 0x7fe508113240 2024-06-06T08:47:56.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.206+0000 7fe4ffe00700 1 -- 172.21.15.28:0/1247654829 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+22770 (secure 0 0 0) 0x7fe50009cc60 con 0x7fe508113240 2024-06-06T08:47:56.205 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-06-06T08:47:56.205 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":92,"fsid":"e34a6934-23de-11ef-bc9b-c7b262605968","created":"2024-06-06T08:30:30.991501+0000","modified":"2024-06-06T08:41:41.833381+0000","last_up_change":"2024-06-06T08:38:45.850887+0000","last_in_change":"2024-06-06T08:38:26.532528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T08:34:26.800168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T08:39:56.375661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T08:40:01.096994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7edaffea-7613-4d20-b9b8-108a17af8f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6803","nonce":2001709636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6805","nonce":2001709636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6809","nonce":2001709636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":2001709636},{"type":"v1","addr":"172.21.15.28:6807","nonce":2001709636}]},"public_addr":"172.21.15.28:6803/2001709636","cluster_addr":"172.21.15.28:6805/2001709636","heartbeat_back_addr":"172.21.15.28:6809/2001709636","heartbeat_front_addr":"172.21.15.28:6807/2001709636","state":["exists","up"]},{"osd":1,"uuid":"17eb7536-c2a4-4f8b-bec4-b1abb5125836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6801","nonce":593429648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6803","nonce":593429648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6807","nonce":593429648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":593429648},{"type":"v1","addr":"172.21.15.37:6805","nonce":593429648}]},"public_addr":"172.21.15.37:6801/593429648","cluster_addr":"172.21.15.37:6803/593429648","heartbeat_back_addr":"172.21.15.37:6807/593429648","heartbeat_front_addr":"172.21.15.37:6805/593429648","state":["exists","up"]},{"osd":2,"uuid":"3ea64fd8-13f4-4d53-933b-07055ec72701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6801","nonce":88678886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6803","nonce":88678886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6807","nonce":88678886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":88678886},{"type":"v1","addr":"172.21.15.59:6805","nonce":88678886}]},"public_addr":"172.21.15.59:6801/88678886","cluster_addr":"172.21.15.59:6803/88678886","heartbeat_back_addr":"172.21.15.59:6807/88678886","heartbeat_front_addr":"172.21.15.59:6805/88678886","state":["exists","up"]},{"osd":3,"uuid":"8be9cdb5-12a9-438e-b8cd-ce65988b0ac6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6811","nonce":484290430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6813","nonce":484290430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6817","nonce":484290430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":484290430},{"type":"v1","addr":"172.21.15.28:6815","nonce":484290430}]},"public_addr":"172.21.15.28:6811/484290430","cluster_addr":"172.21.15.28:6813/484290430","heartbeat_back_addr":"172.21.15.28:6817/484290430","heartbeat_front_addr":"172.21.15.28:6815/484290430","state":["exists","up"]},{"osd":4,"uuid":"ddea397d-d7b1-46f3-9a13-dd318cade055","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6809","nonce":3596500266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6811","nonce":3596500266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6815","nonce":3596500266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3596500266},{"type":"v1","addr":"172.21.15.37:6813","nonce":3596500266}]},"public_addr":"172.21.15.37:6809/3596500266","cluster_addr":"172.21.15.37:6811/3596500266","heartbeat_back_addr":"172.21.15.37:6815/3596500266","heartbeat_front_addr":"172.21.15.37:6813/3596500266","state":["exists","up"]},{"osd":5,"uuid":"ee19857b-b047-4d15-8b17-257b6e4966a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6809","nonce":3037648282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6811","nonce":3037648282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6815","nonce":3037648282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":3037648282},{"type":"v1","addr":"172.21.15.59:6813","nonce":3037648282}]},"public_addr":"172.21.15.59:6809/3037648282","cluster_addr":"172.21.15.59:6811/3037648282","heartbeat_back_addr":"172.21.15.59:6815/3037648282","heartbeat_front_addr":"172.21.15.59:6813/3037648282","state":["exists","up"]},{"osd":6,"uuid":"1d57d0ba-8e37-4ac2-87e8-40b20b24fc53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6819","nonce":3794924886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6821","nonce":3794924886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6825","nonce":3794924886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3794924886},{"type":"v1","addr":"172.21.15.28:6823","nonce":3794924886}]},"public_addr":"172.21.15.28:6819/3794924886","cluster_addr":"172.21.15.28:6821/3794924886","heartbeat_back_addr":"172.21.15.28:6825/3794924886","heartbeat_front_addr":"172.21.15.28:6823/3794924886","state":["exists","up"]},{"osd":7,"uuid":"43f3c2c8-752d-4a70-99dd-2c14aeefa137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6817","nonce":724042860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6819","nonce":724042860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6823","nonce":724042860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":724042860},{"type":"v1","addr":"172.21.15.37:6821","nonce":724042860}]},"public_addr":"172.21.15.37:6817/724042860","cluster_addr":"172.21.15.37:6819/724042860","heartbeat_back_addr":"172.21.15.37:6823/724042860","heartbeat_front_addr":"172.21.15.37:6821/724042860","state":["exists","up"]},{"osd":8,"uuid":"3ffc07d7-ca79-419d-88a4-2b53d07ffae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6817","nonce":1240363223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6819","nonce":1240363223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6823","nonce":1240363223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1240363223},{"type":"v1","addr":"172.21.15.59:6821","nonce":1240363223}]},"public_addr":"172.21.15.59:6817/1240363223","cluster_addr":"172.21.15.59:6819/1240363223","heartbeat_back_addr":"172.21.15.59:6823/1240363223","heartbeat_front_addr":"172.21.15.59:6821/1240363223","state":["exists","up"]},{"osd":9,"uuid":"4e014fc7-1ca3-4d6c-acdd-95ca59541310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6827","nonce":2555848355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6829","nonce":2555848355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6833","nonce":2555848355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":2555848355},{"type":"v1","addr":"172.21.15.28:6831","nonce":2555848355}]},"public_addr":"172.21.15.28:6827/2555848355","cluster_addr":"172.21.15.28:6829/2555848355","heartbeat_back_addr":"172.21.15.28:6833/2555848355","heartbeat_front_addr":"172.21.15.28:6831/2555848355","state":["exists","up"]},{"osd":10,"uuid":"fc418661-5e89-4241-b14b-241a2be432f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6825","nonce":176857372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6827","nonce":176857372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6831","nonce":176857372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":176857372},{"type":"v1","addr":"172.21.15.37:6829","nonce":176857372}]},"public_addr":"172.21.15.37:6825/176857372","cluster_addr":"172.21.15.37:6827/176857372","heartbeat_back_addr":"172.21.15.37:6831/176857372","heartbeat_front_addr":"172.21.15.37:6829/176857372","state":["exists","up"]},{"osd":11,"uuid":"e54d81ee-1461-4229-a1c0-c6e750dd66ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6825","nonce":2675673798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6827","nonce":2675673798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6831","nonce":2675673798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2675673798},{"type":"v1","addr":"172.21.15.59:6829","nonce":2675673798}]},"public_addr":"172.21.15.59:6825/2675673798","cluster_addr":"172.21.15.59:6827/2675673798","heartbeat_back_addr":"172.21.15.59:6831/2675673798","heartbeat_front_addr":"172.21.15.59:6829/2675673798","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:33.904270+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:33:58.988528+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:22.997033+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:34:57.171455+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:23.594371+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:35:48.928423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:22.957203+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:36:50.599655+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:16.166981+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:37:50.755673+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:18.677280+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T08:38:44.432598+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":5,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1f","mappings":[{"from":1,"to":2}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:0/4230567915":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/2860387445":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/886961600":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6800/2022015677":"2024-06-07T08:31:40.064884+0000","172.21.15.28:6801/3383589520":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/3217551014":"2024-06-07T08:31:40.064884+0000","172.21.15.28:0/1629731223":"2024-06-07T08:31:04.770627+0000","172.21.15.28:0/219831273":"2024-06-07T08:31:04.770627+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T08:47:56.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 -- 172.21.15.28:0/1247654829 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe4ec0a2c20 msgr2=0x7fe4ec0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:56.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe4ec0a2c20 0x7fe4ec0a50e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8011490 tx=0x7fe4f8009260 comp rx=0 tx=0).stop 2024-06-06T08:47:56.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 -- 172.21.15.28:0/1247654829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe508113240 msgr2=0x7fe5081a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:47:56.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe508113240 0x7fe5081a3a60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe500004d00 tx=0x7fe500004d30 comp rx=0 tx=0).stop 2024-06-06T08:47:56.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 -- 172.21.15.28:0/1247654829 shutdown_connections 2024-06-06T08:47:56.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fe4ec0a2c20 0x7fe4ec0a50e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:56.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe508113240 0x7fe5081a3a60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:56.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5080769c0 0x7fe50819f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:56.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 --2- 172.21.15.28:0/1247654829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5080772e0 0x7fe50819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:47:56.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 -- 172.21.15.28:0/1247654829 >> 172.21.15.28:0/1247654829 conn(0x7fe5081000d0 msgr2=0x7fe508113eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:47:56.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 -- 172.21.15.28:0/1247654829 shutdown_connections 2024-06-06T08:47:56.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:47:56.209+0000 7fe50ca00700 1 -- 172.21.15.28:0/1247654829 wait complete. 2024-06-06T08:47:56.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:56 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1247654829' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:47:56.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:56 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1247654829' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:47:56.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:56 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1247654829' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T08:47:57.263 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs fail cephfs 2024-06-06T08:47:57.726 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:47:57.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:57 smithi037 ceph-mon[36609]: pgmap v570: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-06-06T08:47:57.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:57 smithi059 ceph-mon[36684]: pgmap v570: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-06-06T08:47:57.873 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:57 smithi028 ceph-mon[31564]: pgmap v570: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-06-06T08:47:59.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:47:59 smithi037 ceph-mon[36609]: pgmap v571: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-06-06T08:47:59.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:47:59 smithi059 ceph-mon[36684]: pgmap v571: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-06-06T08:47:59.946 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:47:59 smithi028 ceph-mon[31564]: pgmap v571: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-06-06T08:48:00.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.282+0000 7f0f11000700 1 -- 172.21.15.28:0/3361094614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f0c1046b0 msgr2=0x7f0f0c104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:00.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.282+0000 7f0f11000700 1 --2- 172.21.15.28:0/3361094614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f0c1046b0 0x7f0f0c104b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009990 tx=0x7f0ef8009ca0 comp rx=0 tx=0).stop 2024-06-06T08:48:00.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.282+0000 7f0f11000700 1 -- 172.21.15.28:0/3361094614 shutdown_connections 2024-06-06T08:48:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.282+0000 7f0f11000700 1 --2- 172.21.15.28:0/3361094614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f0c105070 0x7f0f0c111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.282+0000 7f0f11000700 1 --2- 172.21.15.28:0/3361094614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c10a6b0 0x7f0f0c10aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.282+0000 7f0f11000700 1 --2- 172.21.15.28:0/3361094614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f0c1046b0 0x7f0f0c104b30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.282+0000 7f0f11000700 1 -- 172.21.15.28:0/3361094614 >> 172.21.15.28:0/3361094614 conn(0x7f0f0c1001a0 msgr2=0x7f0f0c1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:48:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.282+0000 7f0f11000700 1 -- 172.21.15.28:0/3361094614 shutdown_connections 2024-06-06T08:48:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.282+0000 7f0f11000700 1 -- 172.21.15.28:0/3361094614 wait complete. 2024-06-06T08:48:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.284+0000 7f0f11000700 1 Processor -- start 2024-06-06T08:48:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.284+0000 7f0f11000700 1 -- start start 2024-06-06T08:48:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f11000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c1046b0 0x7f0f0c19adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:00.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f11000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f0c105070 0x7f0f0c19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:00.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f11000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f0c10a6b0 0x7f0f0c19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:00.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f11000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c114a40 con 0x7f0f0c105070 2024-06-06T08:48:00.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f11000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c1148c0 con 0x7f0f0c1046b0 2024-06-06T08:48:00.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f11000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c114bc0 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f09400700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f0c105070 0x7f0f0c19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:00.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f0a800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f0c10a6b0 0x7f0f0c19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:00.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f0a800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f0c10a6b0 0x7f0f0c19f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.28:34850/0 (socket says 172.21.15.28:34850) 2024-06-06T08:48:00.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f0a800700 1 -- 172.21.15.28:0/1539830716 learned_addr learned my addr 172.21.15.28:0/1539830716 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:48:00.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f09e00700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c1046b0 0x7f0f0c19adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:00.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f0a800700 1 -- 172.21.15.28:0/1539830716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c1046b0 msgr2=0x7f0f0c19adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:00.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f0a800700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c1046b0 0x7f0f0c19adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:00.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f0a800700 1 -- 172.21.15.28:0/1539830716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f0c105070 msgr2=0x7f0f0c19b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:00.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f0a800700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f0c105070 0x7f0f0c19b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:00.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.285+0000 7f0f0a800700 1 -- 172.21.15.28:0/1539830716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0c19fe00 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.286+0000 7f0f0a800700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f0c10a6b0 0x7f0f0c19f6c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400ef30 tx=0x7f0f0400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:48:00.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.286+0000 7f0f02a00700 1 -- 172.21.15.28:0/1539830716 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040092e0 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.286+0000 7f0f02a00700 1 -- 172.21.15.28:0/1539830716 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f04004bb0 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.286+0000 7f0f02a00700 1 -- 172.21.15.28:0/1539830716 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04004280 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.286+0000 7f0f11000700 1 -- 172.21.15.28:0/1539830716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0c1a0090 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.286+0000 7f0f11000700 1 -- 172.21.15.28:0/1539830716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0c1a7970 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.287+0000 7f0f11000700 1 -- 172.21.15.28:0/1539830716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0c069180 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.289+0000 7f0f02a00700 1 -- 172.21.15.28:0/1539830716 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0f0401b030 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.291+0000 7f0f02a00700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0ef00a2ca0 0x7f0ef00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:00.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.291+0000 7f0f02a00700 1 -- 172.21.15.28:0/1539830716 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8364+0+0 (secure 0 0 0) 0x7f0f040ceb80 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.291+0000 7f0f09e00700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0ef00a2ca0 0x7f0ef00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:00.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.292+0000 7f0f09e00700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0ef00a2ca0 0x7f0ef00a5160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0efc005950 tx=0x7f0efc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:48:00.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.295+0000 7f0f02a00700 1 -- 172.21.15.28:0/1539830716 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0f04022020 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.573+0000 7f0f11000700 1 -- 172.21.15.28:0/1539830716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0f0c02dca0 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.582+0000 7f0f02a00700 1 -- 172.21.15.28:0/1539830716 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) ==== 161+0+0 (secure 0 0 0) 0x7f0f04010040 con 0x7f0f0c10a6b0 2024-06-06T08:48:00.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.585+0000 7f0f11000700 1 -- 172.21.15.28:0/1539830716 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0ef00a2ca0 msgr2=0x7f0ef00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:00.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.585+0000 7f0f11000700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0ef00a2ca0 0x7f0ef00a5160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0efc005950 tx=0x7f0efc00b410 comp rx=0 tx=0).stop 2024-06-06T08:48:00.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.585+0000 7f0f11000700 1 -- 172.21.15.28:0/1539830716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f0c10a6b0 msgr2=0x7f0f0c19f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:00.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.585+0000 7f0f11000700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f0c10a6b0 0x7f0f0c19f6c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400ef30 tx=0x7f0f0400c3a0 comp rx=0 tx=0).stop 2024-06-06T08:48:00.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.586+0000 7f0f11000700 1 -- 172.21.15.28:0/1539830716 shutdown_connections 2024-06-06T08:48:00.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.586+0000 7f0f11000700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f0ef00a2ca0 0x7f0ef00a5160 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:00.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.586+0000 7f0f11000700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f0c10a6b0 0x7f0f0c19f6c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:00.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.586+0000 7f0f11000700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c1046b0 0x7f0f0c19adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:00.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.586+0000 7f0f11000700 1 --2- 172.21.15.28:0/1539830716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f0c105070 0x7f0f0c19b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:00.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.586+0000 7f0f11000700 1 -- 172.21.15.28:0/1539830716 >> 172.21.15.28:0/1539830716 conn(0x7f0f0c1001a0 msgr2=0x7f0f0c1006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:48:00.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.586+0000 7f0f11000700 1 -- 172.21.15.28:0/1539830716 shutdown_connections 2024-06-06T08:48:00.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:00.586+0000 7f0f11000700 1 -- 172.21.15.28:0/1539830716 wait complete. 2024-06-06T08:48:00.586 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-06T08:48:00.931 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c[67114]: ignoring --setuser ceph since I am not root 2024-06-06T08:48:00.931 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c[67114]: ignoring --setgroup ceph since I am not root 2024-06-06T08:48:00.931 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-mds[67118]: -- 172.21.15.59:0/1655720624 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560ccb2124e0 con 0x560ccb1e8c00 2024-06-06T08:48:00.931 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-mds[67118]: -- 172.21.15.59:0/1655720624 <== mon.1 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ccb215a40 con 0x560ccb1e8c00 2024-06-06T08:48:00.932 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c[67114]: starting mds.c at 2024-06-06T08:48:00.932 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f[66810]: ignoring --setuser ceph since I am not root 2024-06-06T08:48:00.932 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f[66810]: ignoring --setgroup ceph since I am not root 2024-06-06T08:48:00.932 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f[66810]: starting mds.f at 2024-06-06T08:48:00.933 INFO:journalctl@ceph.mds.l.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-l[66509]: ignoring --setuser ceph since I am not root 2024-06-06T08:48:00.933 INFO:journalctl@ceph.mds.l.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-l[66509]: ignoring --setgroup ceph since I am not root 2024-06-06T08:48:00.933 INFO:journalctl@ceph.mds.l.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-mds[66513]: -- 172.21.15.59:0/1344862993 <== mon.1 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5619643bfa40 con 0x561964392800 2024-06-06T08:48:00.933 INFO:journalctl@ceph.mds.l.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-l[66509]: starting mds.l at 2024-06-06T08:48:00.933 INFO:journalctl@ceph.mds.i.smithi059.stdout:Jun 06 08:48:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-i[67429]: starting mds.i at 2024-06-06T08:48:01.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:00 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a[31560]: 2024-06-06T08:48:00.575+0000 7fe344800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-06T08:48:01.041 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:48:00 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a[73729]: ignoring --setuser ceph since I am not root 2024-06-06T08:48:01.041 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:48:00 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a[73729]: ignoring --setgroup ceph since I am not root 2024-06-06T08:48:01.041 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:48:00 smithi028 ceph-mds[73735]: -- 172.21.15.28:0/2011739770 <== mon.1 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556f8b3e1a40 con 0x556f8b3b4800 2024-06-06T08:48:01.041 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:48:00 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a[73729]: starting mds.a at 2024-06-06T08:48:01.042 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:48:00 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g[73335]: ignoring --setuser ceph since I am not root 2024-06-06T08:48:01.042 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:48:00 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g[73335]: ignoring --setgroup ceph since I am not root 2024-06-06T08:48:01.042 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:48:00 smithi028 ceph-mds[73343]: -- 172.21.15.28:0/3292127016 <== mon.2 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aae575da40 con 0x55aae5730800 2024-06-06T08:48:01.042 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:48:00 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g[73335]: starting mds.g at 2024-06-06T08:48:01.063 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h[66949]: ignoring --setuser ceph since I am not root 2024-06-06T08:48:01.063 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h[66949]: ignoring --setgroup ceph since I am not root 2024-06-06T08:48:01.063 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-mds[66953]: -- 172.21.15.37:0/909048076 <== mon.1 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce4462fa40 con 0x55ce44602c00 2024-06-06T08:48:01.063 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h[66949]: starting mds.h at 2024-06-06T08:48:01.064 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k[66324]: ignoring --setuser ceph since I am not root 2024-06-06T08:48:01.064 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k[66324]: ignoring --setgroup ceph since I am not root 2024-06-06T08:48:01.064 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-mds[66328]: -- 172.21.15.37:0/626699525 <== mon.2 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a46f2ba40 con 0x559a46efec00 2024-06-06T08:48:01.064 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k[66324]: starting mds.k at 2024-06-06T08:48:01.065 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b[67261]: ignoring --setuser ceph since I am not root 2024-06-06T08:48:01.065 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b[67261]: ignoring --setgroup ceph since I am not root 2024-06-06T08:48:01.065 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-mds[67265]: -- 172.21.15.37:0/962773610 <== mon.2 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bc896bda40 con 0x55bc89690800 2024-06-06T08:48:01.065 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b[67261]: starting mds.b at 2024-06-06T08:48:01.065 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b[67261]: 2024-06-06T08:48:00.629+0000 7f4711c18700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-06-06T08:48:01.065 INFO:journalctl@ceph.mds.e.smithi037.stdout:Jun 06 08:48:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-e[66647]: starting mds.e at 2024-06-06T08:48:01.778 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-06-06T08:48:01.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:01 smithi037 ceph-mon[36609]: pgmap v572: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-06-06T08:48:01.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:01 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1539830716' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T08:48:01.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:01 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T08:48:01.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:01 smithi037 ceph-mon[36609]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-06T08:48:01.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:01 smithi037 ceph-mon[36609]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-06T08:48:01.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:01 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-06T08:48:01.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:01 smithi037 ceph-mon[36609]: osdmap e93: 12 total, 12 up, 12 in 2024-06-06T08:48:01.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:01 smithi037 ceph-mon[36609]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-06T08:48:01.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:01 smithi059 ceph-mon[36684]: pgmap v572: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-06-06T08:48:01.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:01 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1539830716' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T08:48:01.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:01 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T08:48:01.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:01 smithi059 ceph-mon[36684]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-06T08:48:01.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:01 smithi059 ceph-mon[36684]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-06T08:48:01.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:01 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-06T08:48:01.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:01 smithi059 ceph-mon[36684]: osdmap e93: 12 total, 12 up, 12 in 2024-06-06T08:48:01.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:01 smithi059 ceph-mon[36684]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-06T08:48:01.858 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:01 smithi028 ceph-mon[31564]: pgmap v572: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-06-06T08:48:01.858 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:01 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1539830716' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T08:48:01.859 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:01 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T08:48:01.859 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:01 smithi028 ceph-mon[31564]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-06T08:48:01.859 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:01 smithi028 ceph-mon[31564]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-06T08:48:01.859 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:01 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-06T08:48:01.859 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:01 smithi028 ceph-mon[31564]: osdmap e93: 12 total, 12 up, 12 in 2024-06-06T08:48:01.859 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:01 smithi028 ceph-mon[31564]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-06T08:48:02.269 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:48:02.772 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.59:6832/3783938274,v1:172.21.15.59:6833/3783938274] up:boot 2024-06-06T08:48:02.772 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.37:6832/3915127092,v1:172.21.15.37:6834/3915127092] up:boot 2024-06-06T08:48:02.772 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.37:6833/491498974,v1:172.21.15.37:6835/491498974] up:boot 2024-06-06T08:48:02.772 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.59:6834/668023168,v1:172.21.15.59:6837/668023168] up:boot 2024-06-06T08:48:02.773 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.59:6835/3569011700,v1:172.21.15.59:6838/3569011700] up:boot 2024-06-06T08:48:02.773 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.59:6836/546081657,v1:172.21.15.59:6839/546081657] up:boot 2024-06-06T08:48:02.773 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.37:6836/4286138216,v1:172.21.15.37:6837/4286138216] up:boot 2024-06-06T08:48:02.773 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.37:6838/2180215088,v1:172.21.15.37:6839/2180215088] up:boot 2024-06-06T08:48:02.773 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.28:6838/2850613460,v1:172.21.15.28:6839/2850613460] up:boot 2024-06-06T08:48:02.773 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: mds.? [v2:172.21.15.28:6840/3359500755,v1:172.21.15.28:6841/3359500755] up:boot 2024-06-06T08:48:02.773 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-06-06T08:48:02.773 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T08:48:02.774 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T08:48:02.774 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T08:48:02.774 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T08:48:02.774 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T08:48:02.774 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T08:48:02.774 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T08:48:02.774 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T08:48:02.775 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T08:48:02.775 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:02 smithi028 ceph-mon[31564]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T08:48:02.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.59:6832/3783938274,v1:172.21.15.59:6833/3783938274] up:boot 2024-06-06T08:48:02.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.37:6832/3915127092,v1:172.21.15.37:6834/3915127092] up:boot 2024-06-06T08:48:02.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.37:6833/491498974,v1:172.21.15.37:6835/491498974] up:boot 2024-06-06T08:48:02.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.59:6834/668023168,v1:172.21.15.59:6837/668023168] up:boot 2024-06-06T08:48:02.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.59:6835/3569011700,v1:172.21.15.59:6838/3569011700] up:boot 2024-06-06T08:48:02.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.59:6836/546081657,v1:172.21.15.59:6839/546081657] up:boot 2024-06-06T08:48:02.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.37:6836/4286138216,v1:172.21.15.37:6837/4286138216] up:boot 2024-06-06T08:48:02.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.37:6838/2180215088,v1:172.21.15.37:6839/2180215088] up:boot 2024-06-06T08:48:02.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.28:6838/2850613460,v1:172.21.15.28:6839/2850613460] up:boot 2024-06-06T08:48:02.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: mds.? [v2:172.21.15.28:6840/3359500755,v1:172.21.15.28:6841/3359500755] up:boot 2024-06-06T08:48:02.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-06-06T08:48:02.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T08:48:02.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T08:48:02.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T08:48:02.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T08:48:02.851 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T08:48:02.852 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T08:48:02.852 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T08:48:02.852 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T08:48:02.852 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T08:48:02.852 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:02 smithi059 ceph-mon[36684]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T08:48:03.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.59:6832/3783938274,v1:172.21.15.59:6833/3783938274] up:boot 2024-06-06T08:48:03.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.37:6832/3915127092,v1:172.21.15.37:6834/3915127092] up:boot 2024-06-06T08:48:03.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.37:6833/491498974,v1:172.21.15.37:6835/491498974] up:boot 2024-06-06T08:48:03.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.59:6834/668023168,v1:172.21.15.59:6837/668023168] up:boot 2024-06-06T08:48:03.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.59:6835/3569011700,v1:172.21.15.59:6838/3569011700] up:boot 2024-06-06T08:48:03.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.59:6836/546081657,v1:172.21.15.59:6839/546081657] up:boot 2024-06-06T08:48:03.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.37:6836/4286138216,v1:172.21.15.37:6837/4286138216] up:boot 2024-06-06T08:48:03.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.37:6838/2180215088,v1:172.21.15.37:6839/2180215088] up:boot 2024-06-06T08:48:03.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.28:6838/2850613460,v1:172.21.15.28:6839/2850613460] up:boot 2024-06-06T08:48:03.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: mds.? [v2:172.21.15.28:6840/3359500755,v1:172.21.15.28:6841/3359500755] up:boot 2024-06-06T08:48:03.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-06-06T08:48:03.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T08:48:03.065 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T08:48:03.066 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T08:48:03.066 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T08:48:03.066 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T08:48:03.066 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T08:48:03.066 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T08:48:03.066 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T08:48:03.067 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T08:48:03.067 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:02 smithi037 ceph-mon[36609]: from='mgr.14152 172.21.15.28:0/754606148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T08:48:03.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:03 smithi059 ceph-mon[36684]: pgmap v574: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-06-06T08:48:04.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:03 smithi028 ceph-mon[31564]: pgmap v574: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-06-06T08:48:04.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:03 smithi037 ceph-mon[36609]: pgmap v574: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-06-06T08:48:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.667+0000 7f3c15600700 1 -- 172.21.15.28:0/3701099107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c101073c0 msgr2=0x7f3c1006a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.667+0000 7f3c15600700 1 --2- 172.21.15.28:0/3701099107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c101073c0 0x7f3c1006a1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009990 tx=0x7f3c00009ca0 comp rx=0 tx=0).stop 2024-06-06T08:48:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.667+0000 7f3c15600700 1 -- 172.21.15.28:0/3701099107 shutdown_connections 2024-06-06T08:48:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.668+0000 7f3c15600700 1 --2- 172.21.15.28:0/3701099107 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c10104ed0 0x7f3c10105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.668+0000 7f3c15600700 1 --2- 172.21.15.28:0/3701099107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c101073c0 0x7f3c1006a1a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.668+0000 7f3c15600700 1 --2- 172.21.15.28:0/3701099107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1006a6e0 0x7f3c1006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.668+0000 7f3c15600700 1 -- 172.21.15.28:0/3701099107 >> 172.21.15.28:0/3701099107 conn(0x7f3c10078340 msgr2=0x7f3c10078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:48:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.668+0000 7f3c15600700 1 -- 172.21.15.28:0/3701099107 shutdown_connections 2024-06-06T08:48:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.668+0000 7f3c15600700 1 -- 172.21.15.28:0/3701099107 wait complete. 2024-06-06T08:48:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.670+0000 7f3c15600700 1 Processor -- start 2024-06-06T08:48:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.670+0000 7f3c15600700 1 -- start start 2024-06-06T08:48:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.670+0000 7f3c15600700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1006a6e0 0x7f3c1019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.670+0000 7f3c15600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10104ed0 0x7f3c1019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.670+0000 7f3c15600700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c101073c0 0x7f3c101a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.670+0000 7f3c15600700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3c10118dc0 con 0x7f3c101073c0 2024-06-06T08:48:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.670+0000 7f3c15600700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c10118c40 con 0x7f3c1006a6e0 2024-06-06T08:48:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.670+0000 7f3c15600700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c10118f40 con 0x7f3c10104ed0 2024-06-06T08:48:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.671+0000 7f3c0ea00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1006a6e0 0x7f3c1019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.671+0000 7f3c0ea00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1006a6e0 0x7f3c1019f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.28:37180/0 (socket says 172.21.15.28:37180) 2024-06-06T08:48:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.671+0000 7f3c0ea00700 1 -- 172.21.15.28:0/1060787225 learned_addr learned my addr 172.21.15.28:0/1060787225 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:48:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.671+0000 7f3c0e000700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10104ed0 0x7f3c1019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.671+0000 7f3c0f400700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c101073c0 0x7f3c101a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.671+0000 7f3c0ea00700 1 -- 172.21.15.28:0/1060787225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10104ed0 msgr2=0x7f3c1019f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.671+0000 7f3c0ea00700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10104ed0 0x7f3c1019f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.671+0000 7f3c0ea00700 1 -- 172.21.15.28:0/1060787225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c101073c0 msgr2=0x7f3c101a3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.671+0000 7f3c0ea00700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c101073c0 0x7f3c101a3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.671+0000 7f3c0ea00700 1 -- 172.21.15.28:0/1060787225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c101a4260 con 0x7f3c1006a6e0 2024-06-06T08:48:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.671+0000 7f3c0f400700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c101073c0 0x7f3c101a3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T08:48:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.672+0000 7f3c0ea00700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1006a6e0 0x7f3c1019f250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c00000c00 tx=0x7f3c0000ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:48:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.672+0000 7f3c07400700 1 -- 172.21.15.28:0/1060787225 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00027070 con 0x7f3c1006a6e0 2024-06-06T08:48:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.672+0000 7f3c07400700 1 -- 172.21.15.28:0/1060787225 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c00003d70 con 0x7f3c1006a6e0 2024-06-06T08:48:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.672+0000 7f3c15600700 1 -- 172.21.15.28:0/1060787225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c101a44f0 con 0x7f3c1006a6e0 2024-06-06T08:48:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.672+0000 7f3c07400700 1 -- 172.21.15.28:0/1060787225 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0000f460 con 0x7f3c1006a6e0 2024-06-06T08:48:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.672+0000 7f3c15600700 1 -- 172.21.15.28:0/1060787225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c101abdd0 con 0x7f3c1006a6e0 2024-06-06T08:48:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.673+0000 7f3c15600700 1 -- 172.21.15.28:0/1060787225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c10069180 con 0x7f3c1006a6e0 2024-06-06T08:48:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.675+0000 7f3c07400700 1 -- 172.21.15.28:0/1060787225 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3c0002a070 con 0x7f3c1006a6e0 2024-06-06T08:48:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.677+0000 7f3c07400700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3bf40a2ca0 0x7f3bf40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.677+0000 7f3c07400700 1 -- 172.21.15.28:0/1060787225 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8794+0+0 (secure 0 0 0) 0x7f3c000cffe0 con 0x7f3c1006a6e0 2024-06-06T08:48:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.677+0000 7f3c0e000700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3bf40a2ca0 0x7f3bf40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.678+0000 7f3c0e000700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3bf40a2ca0 0x7f3bf40a5160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3c1006a3e0 tx=0x7f3bfc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:48:04.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.681+0000 7f3c07400700 1 -- 172.21.15.28:0/1060787225 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3c00013070 con 0x7f3c1006a6e0 2024-06-06T08:48:04.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:04.959+0000 7f3c15600700 1 -- 172.21.15.28:0/1060787225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3c101abfa0 con 0x7f3c1006a6e0 2024-06-06T08:48:05.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.614+0000 7f3c07400700 1 -- 172.21.15.28:0/1060787225 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f3c0009cda0 con 0x7f3c1006a6e0 2024-06-06T08:48:05.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.619+0000 7f3c15600700 1 -- 172.21.15.28:0/1060787225 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3bf40a2ca0 msgr2=0x7f3bf40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:05.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.619+0000 7f3c15600700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3bf40a2ca0 0x7f3bf40a5160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3c1006a3e0 tx=0x7f3bfc009260 comp rx=0 tx=0).stop 2024-06-06T08:48:05.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.619+0000 7f3c15600700 1 -- 172.21.15.28:0/1060787225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1006a6e0 msgr2=0x7f3c1019f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:05.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.619+0000 7f3c15600700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1006a6e0 0x7f3c1019f250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c00000c00 tx=0x7f3c0000ba90 comp rx=0 tx=0).stop 2024-06-06T08:48:05.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.619+0000 7f3c15600700 1 -- 172.21.15.28:0/1060787225 shutdown_connections 2024-06-06T08:48:05.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.619+0000 7f3c15600700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f3bf40a2ca0 0x7f3bf40a5160 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:05.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.619+0000 7f3c15600700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c101073c0 0x7f3c101a3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:05.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.619+0000 7f3c15600700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c1006a6e0 0x7f3c1019f250 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:05.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.619+0000 7f3c15600700 1 --2- 172.21.15.28:0/1060787225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10104ed0 0x7f3c1019f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:05.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.619+0000 7f3c15600700 1 -- 172.21.15.28:0/1060787225 >> 172.21.15.28:0/1060787225 conn(0x7f3c10078340 msgr2=0x7f3c10100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:48:05.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.620+0000 7f3c15600700 1 -- 172.21.15.28:0/1060787225 shutdown_connections 2024-06-06T08:48:05.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:05.620+0000 7f3c15600700 1 -- 172.21.15.28:0/1060787225 wait complete. 2024-06-06T08:48:05.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:05 smithi059 ceph-mon[36684]: pgmap v575: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-06-06T08:48:05.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:05 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/1060787225' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:48:05.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:05 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:48:06.015 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:05 smithi028 ceph-mon[31564]: pgmap v575: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-06-06T08:48:06.016 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:05 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/1060787225' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:48:06.016 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:05 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:48:06.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:05 smithi037 ceph-mon[36609]: pgmap v575: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-06-06T08:48:06.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:05 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/1060787225' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:48:06.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:05 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T08:48:06.566 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-06T08:48:06.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:06 smithi028 ceph-mon[31564]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-06T08:48:06.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:06 smithi028 ceph-mon[31564]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-06T08:48:06.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:06 smithi028 ceph-mon[31564]: Cluster is now healthy 2024-06-06T08:48:06.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:06 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-06T08:48:06.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:06 smithi028 ceph-mon[31564]: fsmap 12 up:standby 2024-06-06T08:48:07.037 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:48:07.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:06 smithi037 ceph-mon[36609]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-06T08:48:07.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:06 smithi037 ceph-mon[36609]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-06T08:48:07.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:06 smithi037 ceph-mon[36609]: Cluster is now healthy 2024-06-06T08:48:07.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:06 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-06T08:48:07.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:06 smithi037 ceph-mon[36609]: fsmap 12 up:standby 2024-06-06T08:48:07.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:06 smithi059 ceph-mon[36684]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-06T08:48:07.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:06 smithi059 ceph-mon[36684]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-06T08:48:07.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:06 smithi059 ceph-mon[36684]: Cluster is now healthy 2024-06-06T08:48:07.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:06 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-06T08:48:07.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:06 smithi059 ceph-mon[36684]: fsmap 12 up:standby 2024-06-06T08:48:07.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:07 smithi028 ceph-mon[31564]: pgmap v576: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-06-06T08:48:08.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:07 smithi037 ceph-mon[36609]: pgmap v576: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-06-06T08:48:08.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:07 smithi059 ceph-mon[36684]: pgmap v576: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-06-06T08:48:09.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.392+0000 7fd1df000700 1 -- 172.21.15.28:0/661645027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d8102620 msgr2=0x7fd1d8102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:09.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.392+0000 7fd1df000700 1 --2- 172.21.15.28:0/661645027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d8102620 0x7fd1d8102a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009fc0 tx=0x7fd1cc00b330 comp rx=0 tx=0).stop 2024-06-06T08:48:09.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.392+0000 7fd1df000700 1 -- 172.21.15.28:0/661645027 shutdown_connections 2024-06-06T08:48:09.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.392+0000 7fd1df000700 1 --2- 172.21.15.28:0/661645027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d8107700 0x7fd1d810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:09.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.392+0000 7fd1df000700 1 --2- 172.21.15.28:0/661645027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d8102620 0x7fd1d8102a00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:09.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.392+0000 7fd1df000700 1 --2- 172.21.15.28:0/661645027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d8102fd0 0x7fd1d8107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:09.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.392+0000 7fd1df000700 1 -- 172.21.15.28:0/661645027 >> 172.21.15.28:0/661645027 conn(0x7fd1d80fdf10 msgr2=0x7fd1d8100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:48:09.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.392+0000 7fd1df000700 1 -- 172.21.15.28:0/661645027 shutdown_connections 2024-06-06T08:48:09.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.392+0000 7fd1df000700 1 -- 172.21.15.28:0/661645027 wait complete. 2024-06-06T08:48:09.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.394+0000 7fd1df000700 1 Processor -- start 2024-06-06T08:48:09.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.394+0000 7fd1df000700 1 -- start start 2024-06-06T08:48:09.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.394+0000 7fd1df000700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d8102620 0x7fd1d819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:09.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.394+0000 7fd1df000700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d8102fd0 0x7fd1d819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:09.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.394+0000 7fd1df000700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d8107700 0x7fd1d81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:09.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.394+0000 7fd1df000700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d8112730 con 0x7fd1d8102fd0 2024-06-06T08:48:09.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.394+0000 7fd1df000700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d81125b0 con 0x7fd1d8102620 2024-06-06T08:48:09.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.394+0000 7fd1df000700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d81128b0 con 0x7fd1d8107700 2024-06-06T08:48:09.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1dd200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d8102fd0 0x7fd1d819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:09.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1ddc00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d8102620 0x7fd1d819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:09.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1dd200700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d8102fd0 0x7fd1d819ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60376/0 (socket says 172.21.15.28:60376) 2024-06-06T08:48:09.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1de600700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d8107700 0x7fd1d81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:09.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1dd200700 1 -- 172.21.15.28:0/534773330 learned_addr learned my addr 172.21.15.28:0/534773330 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:48:09.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1ddc00700 1 -- 172.21.15.28:0/534773330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d8107700 msgr2=0x7fd1d81989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:09.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1ddc00700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d8107700 0x7fd1d81989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:09.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1ddc00700 1 -- 172.21.15.28:0/534773330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d8102fd0 msgr2=0x7fd1d819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:09.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1ddc00700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d8102fd0 0x7fd1d819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:09.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1ddc00700 1 -- 172.21.15.28:0/534773330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d8199150 con 0x7fd1d8102620 2024-06-06T08:48:09.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1de600700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d8107700 0x7fd1d81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:48:09.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.395+0000 7fd1dd200700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d8102fd0 0x7fd1d819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:48:09.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.396+0000 7fd1ddc00700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d8102620 0x7fd1d819e7e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc015000 tx=0x7fd1cc00cfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:48:09.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.396+0000 7fd1d6000700 1 -- 172.21.15.28:0/534773330 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc021070 con 0x7fd1d8102620 2024-06-06T08:48:09.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.396+0000 7fd1df000700 1 -- 172.21.15.28:0/534773330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d81993e0 con 0x7fd1d8102620 2024-06-06T08:48:09.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.396+0000 7fd1d6000700 1 -- 172.21.15.28:0/534773330 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1cc007ac0 con 0x7fd1d8102620 2024-06-06T08:48:09.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.396+0000 7fd1d6000700 1 -- 172.21.15.28:0/534773330 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0052a0 con 0x7fd1d8102620 2024-06-06T08:48:09.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.396+0000 7fd1df000700 1 -- 172.21.15.28:0/534773330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d81a56b0 con 0x7fd1d8102620 2024-06-06T08:48:09.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.397+0000 7fd1df000700 1 -- 172.21.15.28:0/534773330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d8069180 con 0x7fd1d8102620 2024-06-06T08:48:09.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.399+0000 7fd1d6000700 1 -- 172.21.15.28:0/534773330 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd1cc024070 con 0x7fd1d8102620 2024-06-06T08:48:09.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.401+0000 7fd1d6000700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd1c00a2c20 0x7fd1c00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:09.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.401+0000 7fd1d6000700 1 -- 172.21.15.28:0/534773330 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8794+0+0 (secure 0 0 0) 0x7fd1cc00f020 con 0x7fd1d8102620 2024-06-06T08:48:09.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.401+0000 7fd1dd200700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd1c00a2c20 0x7fd1c00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:09.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.402+0000 7fd1dd200700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd1c00a2c20 0x7fd1c00a50e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8108ca0 tx=0x7fd1c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:48:09.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.406+0000 7fd1d6000700 1 -- 172.21.15.28:0/534773330 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd1cc02b020 con 0x7fd1d8102620 2024-06-06T08:48:09.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:09.648+0000 7fd1df000700 1 -- 172.21.15.28:0/534773330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd1d802dca0 con 0x7fd1d8102620 2024-06-06T08:48:09.648 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:09 smithi028 ceph-mon[31564]: pgmap v577: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-06-06T08:48:10.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:09 smithi037 ceph-mon[36609]: pgmap v577: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-06-06T08:48:10.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:09 smithi059 ceph-mon[36684]: pgmap v577: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-06-06T08:48:10.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.635+0000 7fd1d6000700 1 -- 172.21.15.28:0/534773330 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7fd1cc09d320 con 0x7fd1d8102620 2024-06-06T08:48:10.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.641+0000 7fd1df000700 1 -- 172.21.15.28:0/534773330 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd1c00a2c20 msgr2=0x7fd1c00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:10.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.641+0000 7fd1df000700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd1c00a2c20 0x7fd1c00a50e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8108ca0 tx=0x7fd1c4009260 comp rx=0 tx=0).stop 2024-06-06T08:48:10.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.641+0000 7fd1df000700 1 -- 172.21.15.28:0/534773330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d8102620 msgr2=0x7fd1d819e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:10.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.641+0000 7fd1df000700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d8102620 0x7fd1d819e7e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc015000 tx=0x7fd1cc00cfa0 comp rx=0 tx=0).stop 2024-06-06T08:48:10.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.641+0000 7fd1df000700 1 -- 172.21.15.28:0/534773330 shutdown_connections 2024-06-06T08:48:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.641+0000 7fd1df000700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7fd1c00a2c20 0x7fd1c00a50e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.641+0000 7fd1df000700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d8107700 0x7fd1d81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.641+0000 7fd1df000700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d8102620 0x7fd1d819e7e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.641+0000 7fd1df000700 1 --2- 172.21.15.28:0/534773330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d8102fd0 0x7fd1d819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.641+0000 7fd1df000700 1 -- 172.21.15.28:0/534773330 >> 172.21.15.28:0/534773330 conn(0x7fd1d80fdf10 msgr2=0x7fd1d8100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:48:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.642+0000 7fd1df000700 1 -- 172.21.15.28:0/534773330 shutdown_connections 2024-06-06T08:48:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:10.642+0000 7fd1df000700 1 -- 172.21.15.28:0/534773330 wait complete. 2024-06-06T08:48:10.643 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2024-06-06T08:48:10.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:10 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/534773330' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:10.850 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:10 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:11.026 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:10 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/534773330' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:11.026 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:10 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:11.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:10 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/534773330' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:11.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:10 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:11.600 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid e34a6934-23de-11ef-bc9b-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-06T08:48:11.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:11 smithi028 ceph-mon[31564]: pgmap v578: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 716 B/s wr, 2 op/s 2024-06-06T08:48:11.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:11 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T08:48:11.791 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:11 smithi028 ceph-mon[31564]: osdmap e94: 12 total, 12 up, 12 in 2024-06-06T08:48:12.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:11 smithi037 ceph-mon[36609]: pgmap v578: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 716 B/s wr, 2 op/s 2024-06-06T08:48:12.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:11 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T08:48:12.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:11 smithi037 ceph-mon[36609]: osdmap e94: 12 total, 12 up, 12 in 2024-06-06T08:48:12.080 INFO:teuthology.orchestra.run.smithi028.stderr:Inferring config /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T08:48:12.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:11 smithi059 ceph-mon[36684]: pgmap v578: 97 pgs: 97 active+clean; 73 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 716 B/s wr, 2 op/s 2024-06-06T08:48:12.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:11 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T08:48:12.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:11 smithi059 ceph-mon[36684]: osdmap e94: 12 total, 12 up, 12 in 2024-06-06T08:48:13.790 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:13 smithi028 ceph-mon[31564]: pgmap v580: 65 pgs: 65 active+clean; 26 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:48:14.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:13 smithi037 ceph-mon[36609]: pgmap v580: 65 pgs: 65 active+clean; 26 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:48:14.102 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:13 smithi059 ceph-mon[36684]: pgmap v580: 65 pgs: 65 active+clean; 26 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:48:14.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.495+0000 7f070f800700 1 -- 172.21.15.28:0/2485291199 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0708101380 msgr2=0x7f0708101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:14.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.495+0000 7f070f800700 1 --2- 172.21.15.28:0/2485291199 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0708101380 0x7f0708101800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009990 tx=0x7f06f4009ca0 comp rx=0 tx=0).stop 2024-06-06T08:48:14.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.495+0000 7f070f800700 1 -- 172.21.15.28:0/2485291199 shutdown_connections 2024-06-06T08:48:14.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.495+0000 7f070f800700 1 --2- 172.21.15.28:0/2485291199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0708101d40 0x7f070810e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:14.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.495+0000 7f070f800700 1 --2- 172.21.15.28:0/2485291199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07081073f0 0x7f07081077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:14.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.495+0000 7f070f800700 1 --2- 172.21.15.28:0/2485291199 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0708101380 0x7f0708101800 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:14.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.495+0000 7f070f800700 1 -- 172.21.15.28:0/2485291199 >> 172.21.15.28:0/2485291199 conn(0x7f0708078300 msgr2=0x7f0708078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:48:14.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.495+0000 7f070f800700 1 -- 172.21.15.28:0/2485291199 shutdown_connections 2024-06-06T08:48:14.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.495+0000 7f070f800700 1 -- 172.21.15.28:0/2485291199 wait complete. 2024-06-06T08:48:14.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.496+0000 7f070f800700 1 Processor -- start 2024-06-06T08:48:14.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.496+0000 7f070f800700 1 -- start start 2024-06-06T08:48:14.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.497+0000 7f070f800700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0708101380 0x7f0708103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:14.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.497+0000 7f070f800700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0708101d40 0x7f07081035a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:14.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.497+0000 7f070f800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07081073f0 0x7f0708103ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:14.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.497+0000 7f070f800700 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f07081116b0 con 0x7f0708101d40 2024-06-06T08:48:14.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.497+0000 7f070f800700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0708111530 con 0x7f0708101380 2024-06-06T08:48:14.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.497+0000 7f070f800700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0708111830 con 0x7f07081073f0 2024-06-06T08:48:14.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.497+0000 7f0707e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0708101d40 0x7f07081035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:14.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.497+0000 7f070d800700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07081073f0 0x7f0708103ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:14.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.497+0000 7f0707e00700 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0708101d40 0x7f07081035a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60408/0 (socket says 172.21.15.28:60408) 2024-06-06T08:48:14.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.497+0000 7f0707e00700 1 -- 172.21.15.28:0/4084641620 learned_addr learned my addr 172.21.15.28:0/4084641620 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-06-06T08:48:14.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.497+0000 7f070ce00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0708101380 0x7f0708103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:14.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.498+0000 7f070ce00700 1 -- 172.21.15.28:0/4084641620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07081073f0 msgr2=0x7f0708103ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:14.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.498+0000 7f070ce00700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07081073f0 0x7f0708103ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:14.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.498+0000 7f070ce00700 1 -- 172.21.15.28:0/4084641620 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0708101d40 msgr2=0x7f07081035a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:14.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.498+0000 7f070ce00700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0708101d40 0x7f07081035a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:14.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.498+0000 7f070ce00700 1 -- 172.21.15.28:0/4084641620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07081a7180 con 0x7f0708101380 2024-06-06T08:48:14.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.498+0000 7f0707e00700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0708101d40 0x7f07081035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:48:14.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.498+0000 7f070d800700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07081073f0 0x7f0708103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T08:48:14.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.498+0000 7f070ce00700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0708101380 0x7f0708103060 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00e9f0 tx=0x7f06fc00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:48:14.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.499+0000 7f0705600700 1 -- 172.21.15.28:0/4084641620 <== mon.2 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc00c9c0 con 0x7f0708101380 2024-06-06T08:48:14.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.499+0000 7f070f800700 1 -- 172.21.15.28:0/4084641620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07081a7470 con 0x7f0708101380 2024-06-06T08:48:14.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.499+0000 7f0705600700 1 -- 172.21.15.28:0/4084641620 <== mon.2 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06fc00cb60 con 0x7f0708101380 2024-06-06T08:48:14.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.499+0000 7f0705600700 1 -- 172.21.15.28:0/4084641620 <== mon.2 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc018680 con 0x7f0708101380 2024-06-06T08:48:14.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.499+0000 7f070f800700 1 -- 172.21.15.28:0/4084641620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07081a7a00 con 0x7f0708101380 2024-06-06T08:48:14.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.501+0000 7f070f800700 1 -- 172.21.15.28:0/4084641620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0708069180 con 0x7f0708101380 2024-06-06T08:48:14.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.502+0000 7f0705600700 1 -- 172.21.15.28:0/4084641620 <== mon.2 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f06fc010430 con 0x7f0708101380 2024-06-06T08:48:14.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.504+0000 7f0705600700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f06f00a2ca0 0x7f06f00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T08:48:14.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.504+0000 7f0705600700 1 -- 172.21.15.28:0/4084641620 <== mon.2 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8240+0+0 (secure 0 0 0) 0x7f06fc0cf070 con 0x7f0708101380 2024-06-06T08:48:14.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.504+0000 7f0707e00700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f06f00a2ca0 0x7f06f00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T08:48:14.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.505+0000 7f0707e00700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f06f00a2ca0 0x7f06f00a5160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009750 tx=0x7f06f400b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T08:48:14.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.508+0000 7f0705600700 1 -- 172.21.15.28:0/4084641620 <== mon.2 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f06fc09bf90 con 0x7f0708101380 2024-06-06T08:48:14.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:14.747+0000 7f070f800700 1 -- 172.21.15.28:0/4084641620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f07081a7d20 con 0x7f0708101380 2024-06-06T08:48:15.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.658+0000 7f0705600700 1 -- 172.21.15.28:0/4084641620 <== mon.2 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7f06fc084e20 con 0x7f0708101380 2024-06-06T08:48:15.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.662+0000 7f070f800700 1 -- 172.21.15.28:0/4084641620 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f06f00a2ca0 msgr2=0x7f06f00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:15.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.662+0000 7f070f800700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f06f00a2ca0 0x7f06f00a5160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009750 tx=0x7f06f400b280 comp rx=0 tx=0).stop 2024-06-06T08:48:15.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.662+0000 7f070f800700 1 -- 172.21.15.28:0/4084641620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0708101380 msgr2=0x7f0708103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T08:48:15.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.662+0000 7f070f800700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0708101380 0x7f0708103060 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00e9f0 tx=0x7f06fc00ed00 comp rx=0 tx=0).stop 2024-06-06T08:48:15.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.662+0000 7f070f800700 1 -- 172.21.15.28:0/4084641620 shutdown_connections 2024-06-06T08:48:15.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.662+0000 7f070f800700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.28:6800/2061522436,v1:172.21.15.28:6801/2061522436] conn(0x7f06f00a2ca0 0x7f06f00a5160 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:15.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.662+0000 7f070f800700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07081073f0 0x7f0708103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.662+0000 7f070f800700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0708101380 0x7f0708103060 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.662+0000 7f070f800700 1 --2- 172.21.15.28:0/4084641620 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0708101d40 0x7f07081035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T08:48:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.662+0000 7f070f800700 1 -- 172.21.15.28:0/4084641620 >> 172.21.15.28:0/4084641620 conn(0x7f0708078300 msgr2=0x7f0708100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T08:48:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.663+0000 7f070f800700 1 -- 172.21.15.28:0/4084641620 shutdown_connections 2024-06-06T08:48:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-06-06T08:48:15.663+0000 7f070f800700 1 -- 172.21.15.28:0/4084641620 wait complete. 2024-06-06T08:48:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2024-06-06T08:48:15.920 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:15 smithi028 ceph-mon[31564]: pgmap v581: 65 pgs: 65 active+clean; 26 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:48:15.921 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:15 smithi028 ceph-mon[31564]: from='client.? 172.21.15.28:0/4084641620' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:15.921 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:15 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:16.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:15 smithi037 ceph-mon[36609]: pgmap v581: 65 pgs: 65 active+clean; 26 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:48:16.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:15 smithi037 ceph-mon[36609]: from='client.? 172.21.15.28:0/4084641620' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:16.064 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:15 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:16.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:15 smithi059 ceph-mon[36684]: pgmap v581: 65 pgs: 65 active+clean; 26 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T08:48:16.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:15 smithi059 ceph-mon[36684]: from='client.? 172.21.15.28:0/4084641620' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:16.100 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:15 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T08:48:16.705 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T08:48:16.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T08:48:16.840 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T08:48:16.880 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-06-06T08:48:16.880 DEBUG:teuthology.orchestra.run.smithi028:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-06T08:48:16.935 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-06T08:48:16.951 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-06T08:48:16.970 INFO:tasks.cephadm:Stopping all daemons... 2024-06-06T08:48:16.970 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-06-06T08:48:16.970 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.a 2024-06-06T08:48:17.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:16 smithi028 ceph-mon[31564]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T08:48:17.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:16 smithi028 ceph-mon[31564]: osdmap e95: 12 total, 12 up, 12 in 2024-06-06T08:48:17.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:16 smithi037 ceph-mon[36609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T08:48:17.063 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:16 smithi037 ceph-mon[36609]: osdmap e95: 12 total, 12 up, 12 in 2024-06-06T08:48:17.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:16 smithi059 ceph-mon[36684]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T08:48:17.099 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:16 smithi059 ceph-mon[36684]: osdmap e95: 12 total, 12 up, 12 in 2024-06-06T08:48:17.541 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:17 smithi028 systemd[1]: Stopping Ceph mon.a for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:48:18.040 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:17 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a[31560]: 2024-06-06T08:48:17.564+0000 7fe34b600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:48:18.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:17 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a[31560]: 2024-06-06T08:48:17.565+0000 7fe34b600700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-06-06T08:48:18.041 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:17 smithi028 podman[97816]: 2024-06-06 08:48:17.79183509 +0000 UTC m=+0.374509215 container died 82bd645ae771c1ca54f0338e8dfca9a2da5b1dbac160f7fd4f67b05fefe09d21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:48:18.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:18 smithi028 podman[97816]: 2024-06-06 08:48:18.398325305 +0000 UTC m=+0.980999396 container cleanup 82bd645ae771c1ca54f0338e8dfca9a2da5b1dbac160f7fd4f67b05fefe09d21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-06T08:48:18.425 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:18 smithi028 bash[97816]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a 2024-06-06T08:48:19.030 INFO:journalctl@ceph.mon.a.smithi028.stdout:Jun 06 08:48:18 smithi028 podman[97831]: 2024-06-06 08:48:18.625398232 +0000 UTC m=+0.808768323 container remove 82bd645ae771c1ca54f0338e8dfca9a2da5b1dbac160f7fd4f67b05fefe09d21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-06-06T08:48:19.071 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.a.service' 2024-06-06T08:48:19.216 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:48:19.216 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-06-06T08:48:19.216 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-06-06T08:48:19.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.b 2024-06-06T08:48:19.540 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:19 smithi037 systemd[1]: Stopping Ceph mon.b for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:48:19.813 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:19 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-b[36605]: 2024-06-06T08:48:19.541+0000 7f10a33de700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:48:19.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:19 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-b[36605]: 2024-06-06T08:48:19.541+0000 7f10a33de700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-06-06T08:48:19.814 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:19 smithi037 podman[70560]: 2024-06-06 08:48:19.634024552 +0000 UTC m=+0.199638232 container died cad5b6259a97984de7b2a466d6007d014bef059ae114747fa65cba7d0a2a4268 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-06T08:48:20.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:20 smithi037 podman[70560]: 2024-06-06 08:48:20.12603996 +0000 UTC m=+0.691653643 container cleanup cad5b6259a97984de7b2a466d6007d014bef059ae114747fa65cba7d0a2a4268 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-06-06T08:48:20.313 INFO:journalctl@ceph.mon.b.smithi037.stdout:Jun 06 08:48:20 smithi037 bash[70560]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-b 2024-06-06T08:48:20.498 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.b.service' 2024-06-06T08:48:20.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:48:20.546 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-06-06T08:48:20.546 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-06-06T08:48:20.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.c 2024-06-06T08:48:20.849 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:20 smithi059 systemd[1]: Stopping Ceph mon.c for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:48:21.118 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:20 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-c[36680]: 2024-06-06T08:48:20.864+0000 7fd3c94d0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:48:21.118 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:20 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-c[36680]: 2024-06-06T08:48:20.864+0000 7fd3c94d0700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-06-06T08:48:21.406 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:21 smithi059 podman[70821]: 2024-06-06 08:48:21.12093637 +0000 UTC m=+0.371595685 container died 5e521794a5c00cb9298d8cec7e8a42d49f1263700ebb6157897c518d07cb95db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:48:21.773 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:21 smithi059 podman[70821]: 2024-06-06 08:48:21.507747734 +0000 UTC m=+0.758407049 container cleanup 5e521794a5c00cb9298d8cec7e8a42d49f1263700ebb6157897c518d07cb95db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0) 2024-06-06T08:48:21.773 INFO:journalctl@ceph.mon.c.smithi059.stdout:Jun 06 08:48:21 smithi059 bash[70821]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mon-c 2024-06-06T08:48:21.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mon.c.service' 2024-06-06T08:48:22.036 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:48:22.037 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-06-06T08:48:22.037 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-06-06T08:48:22.037 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.x 2024-06-06T08:48:22.540 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:48:22 smithi028 systemd[1]: Stopping Ceph mgr.x for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:48:23.041 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:48:22 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:48:22.685+0000 7ff51cc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:48:23.041 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:48:22 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x[31806]: 2024-06-06T08:48:22.685+0000 7ff51cc00700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-06-06T08:48:23.041 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:48:22 smithi028 podman[97936]: 2024-06-06 08:48:22.780003585 +0000 UTC m=+0.268390335 container died 2b47e19df1583213a64690f111ce95a6cab353c2a1255b9ff85d15acae75f919 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-06T08:48:23.791 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:48:23 smithi028 podman[97936]: 2024-06-06 08:48:23.371254591 +0000 UTC m=+0.859641352 container cleanup 2b47e19df1583213a64690f111ce95a6cab353c2a1255b9ff85d15acae75f919 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-06-06T08:48:23.791 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:48:23 smithi028 bash[97936]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x 2024-06-06T08:48:23.791 INFO:journalctl@ceph.mgr.x.smithi028.stdout:Jun 06 08:48:23 smithi028 podman[97949]: 2024-06-06 08:48:23.590313353 +0000 UTC m=+0.794206164 container remove 2b47e19df1583213a64690f111ce95a6cab353c2a1255b9ff85d15acae75f919 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-06-06T08:48:24.154 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.x.service' 2024-06-06T08:48:24.276 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:48:24.276 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-06-06T08:48:24.276 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-06-06T08:48:24.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.y 2024-06-06T08:48:24.563 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:48:24 smithi037 systemd[1]: Stopping Ceph mgr.y for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:48:25.063 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:48:24 smithi037 podman[70687]: 2024-06-06 08:48:24.7435921 +0000 UTC m=+0.259094862 container died 1c61dd9f9c0ee6f5f40c722bc483e1528bca25ac0ffaffc268565ba31f0ef75f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528) 2024-06-06T08:48:25.497 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:48:25 smithi037 podman[70687]: 2024-06-06 08:48:25.231114763 +0000 UTC m=+0.746617517 container cleanup 1c61dd9f9c0ee6f5f40c722bc483e1528bca25ac0ffaffc268565ba31f0ef75f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-06T08:48:25.497 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jun 06 08:48:25 smithi037 bash[70687]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-y 2024-06-06T08:48:25.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.y.service' 2024-06-06T08:48:25.700 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:48:25.700 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-06-06T08:48:25.700 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-06-06T08:48:25.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.z 2024-06-06T08:48:26.039 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:48:25 smithi059 systemd[1]: Stopping Ceph mgr.z for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:48:26.336 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:48:26 smithi059 podman[70948]: 2024-06-06 08:48:26.042006809 +0000 UTC m=+0.138735605 container died a3cbafc5e16e7e8d11cdd1fdeade9ad26b224feb663093e1c1847a7e83cbbc3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2) 2024-06-06T08:48:26.599 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:48:26 smithi059 podman[70948]: 2024-06-06 08:48:26.42139038 +0000 UTC m=+0.518119169 container cleanup a3cbafc5e16e7e8d11cdd1fdeade9ad26b224feb663093e1c1847a7e83cbbc3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:48:26.599 INFO:journalctl@ceph.mgr.z.smithi059.stdout:Jun 06 08:48:26 smithi059 bash[70948]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mgr-z 2024-06-06T08:48:26.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mgr.z.service' 2024-06-06T08:48:26.870 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:48:26.870 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-06-06T08:48:26.871 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-06-06T08:48:26.871 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.0 2024-06-06T08:48:27.290 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:27 smithi028 systemd[1]: Stopping Ceph osd.0 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:48:27.790 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:27 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0[46018]: 2024-06-06T08:48:27.499+0000 7f2797a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:48:27.791 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:27 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0[46018]: 2024-06-06T08:48:27.499+0000 7f2797a00700 -1 osd.0 95 *** Got signal Terminated *** 2024-06-06T08:48:27.791 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:27 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0[46018]: 2024-06-06T08:48:27.499+0000 7f2797a00700 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:48:33.291 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:32 smithi028 podman[98056]: 2024-06-06 08:48:32.943473535 +0000 UTC m=+5.587877536 container died 3738f6b6eac95269a53cfb313cf953c98dff005604e6361884580d774585ff32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-06-06T08:48:33.599 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:33 smithi028 podman[98056]: 2024-06-06 08:48:33.569151592 +0000 UTC m=+6.213555623 container cleanup 3738f6b6eac95269a53cfb313cf953c98dff005604e6361884580d774585ff32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-06T08:48:33.599 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:33 smithi028 bash[98056]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0 2024-06-06T08:48:34.290 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:33 smithi028 podman[98077]: 2024-06-06 08:48:33.812670575 +0000 UTC m=+0.860693431 container remove 3738f6b6eac95269a53cfb313cf953c98dff005604e6361884580d774585ff32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528) 2024-06-06T08:48:35.026 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:34 smithi028 podman[98161]: 2024-06-06 08:48:34.598206259 +0000 UTC m=+0.033870442 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:48:35.027 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:34 smithi028 podman[98161]: 2024-06-06 08:48:34.847186215 +0000 UTC m=+0.282850414 container create b52540bf056007c82625062390867a9a029b98c438c7e50098ef575bae998a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-06T08:48:35.290 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:35 smithi028 podman[98161]: 2024-06-06 08:48:35.15988943 +0000 UTC m=+0.595553711 container init b52540bf056007c82625062390867a9a029b98c438c7e50098ef575bae998a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-06-06T08:48:35.291 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:35 smithi028 podman[98161]: 2024-06-06 08:48:35.172098677 +0000 UTC m=+0.607762895 container start b52540bf056007c82625062390867a9a029b98c438c7e50098ef575bae998a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc) 2024-06-06T08:48:35.291 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:35 smithi028 podman[98161]: 2024-06-06 08:48:35.266712449 +0000 UTC m=+0.702376643 container attach b52540bf056007c82625062390867a9a029b98c438c7e50098ef575bae998a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-06T08:48:35.999 INFO:journalctl@ceph.osd.0.smithi028.stdout:Jun 06 08:48:35 smithi028 podman[98161]: 2024-06-06 08:48:35.644404039 +0000 UTC m=+1.080068283 container died b52540bf056007c82625062390867a9a029b98c438c7e50098ef575bae998a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:48:36.592 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.0.service' 2024-06-06T08:48:36.709 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:48:36.710 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-06-06T08:48:36.710 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-06-06T08:48:36.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.1 2024-06-06T08:48:37.033 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:36 smithi037 systemd[1]: Stopping Ceph osd.1 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:48:37.313 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:37 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1[41132]: 2024-06-06T08:48:37.034+0000 7f94493ed700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:48:37.314 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:37 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1[41132]: 2024-06-06T08:48:37.034+0000 7f94493ed700 -1 osd.1 95 *** Got signal Terminated *** 2024-06-06T08:48:37.314 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:37 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1[41132]: 2024-06-06T08:48:37.034+0000 7f94493ed700 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:48:42.813 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:42 smithi037 podman[70812]: 2024-06-06 08:48:42.505492636 +0000 UTC m=+5.593337560 container died 9fe900380fad90c21b71a3e4bf53d206539af8dbca8b6d1ae296d1e14cecf1eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True) 2024-06-06T08:48:43.209 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:42 smithi037 podman[70812]: 2024-06-06 08:48:42.985793695 +0000 UTC m=+6.073638618 container cleanup 9fe900380fad90c21b71a3e4bf53d206539af8dbca8b6d1ae296d1e14cecf1eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS) 2024-06-06T08:48:43.210 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:42 smithi037 bash[70812]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1 2024-06-06T08:48:43.549 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:43 smithi037 podman[70827]: 2024-06-06 08:48:43.211962391 +0000 UTC m=+0.707409256 container remove 9fe900380fad90c21b71a3e4bf53d206539af8dbca8b6d1ae296d1e14cecf1eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-06T08:48:43.813 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:43 smithi037 podman[70918]: 2024-06-06 08:48:43.454645996 +0000 UTC m=+0.017976410 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:48:43.813 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:43 smithi037 podman[70918]: 2024-06-06 08:48:43.57117 +0000 UTC m=+0.134500420 container create 9e6e36c31523fefdf1ea463ed9bb4a45a858081d6ae20eda93daabfbaae3701a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_CLEAN=True, RELEASE=squid-3d89acc, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-06-06T08:48:44.164 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:43 smithi037 podman[70918]: 2024-06-06 08:48:43.857393196 +0000 UTC m=+0.420723598 container init 9e6e36c31523fefdf1ea463ed9bb4a45a858081d6ae20eda93daabfbaae3701a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-06-06T08:48:44.164 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:43 smithi037 podman[70918]: 2024-06-06 08:48:43.860867295 +0000 UTC m=+0.424197702 container start 9e6e36c31523fefdf1ea463ed9bb4a45a858081d6ae20eda93daabfbaae3701a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-06-06T08:48:44.164 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:43 smithi037 podman[70918]: 2024-06-06 08:48:43.940877893 +0000 UTC m=+0.504208313 container attach 9e6e36c31523fefdf1ea463ed9bb4a45a858081d6ae20eda93daabfbaae3701a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:48:44.448 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jun 06 08:48:44 smithi037 podman[70918]: 2024-06-06 08:48:44.166239185 +0000 UTC m=+0.729569593 container died 9e6e36c31523fefdf1ea463ed9bb4a45a858081d6ae20eda93daabfbaae3701a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:48:44.761 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.1.service' 2024-06-06T08:48:44.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:48:44.800 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-06-06T08:48:44.801 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-06-06T08:48:44.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.2 2024-06-06T08:48:45.099 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:44 smithi059 systemd[1]: Stopping Ceph osd.2 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:48:45.599 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:45 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2[41776]: 2024-06-06T08:48:45.125+0000 7fcdc42e1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:48:45.600 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:45 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2[41776]: 2024-06-06T08:48:45.125+0000 7fcdc42e1700 -1 osd.2 95 *** Got signal Terminated *** 2024-06-06T08:48:45.600 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:45 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2[41776]: 2024-06-06T08:48:45.125+0000 7fcdc42e1700 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:48:50.842 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:50 smithi059 podman[71088]: 2024-06-06 08:48:50.55398492 +0000 UTC m=+5.549119871 container died 786209f0d7e6e0f4c17c112bac888b7c0271b1cd348fe075bcf4c58714102cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2, RELEASE=squid-3d89acc, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:48:51.099 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:50 smithi059 podman[71088]: 2024-06-06 08:48:50.934760363 +0000 UTC m=+5.929895335 container cleanup 786209f0d7e6e0f4c17c112bac888b7c0271b1cd348fe075bcf4c58714102cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc) 2024-06-06T08:48:51.100 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:50 smithi059 bash[71088]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2 2024-06-06T08:48:51.575 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:51 smithi059 podman[71103]: 2024-06-06 08:48:51.127681201 +0000 UTC m=+0.574330281 container remove 786209f0d7e6e0f4c17c112bac888b7c0271b1cd348fe075bcf4c58714102cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-06-06T08:48:51.849 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:51 smithi059 podman[71197]: 2024-06-06 08:48:51.480663782 +0000 UTC m=+0.017712780 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:48:51.849 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:51 smithi059 podman[71197]: 2024-06-06 08:48:51.612322562 +0000 UTC m=+0.149371579 container create 84e241d05c3c6bef8051498e985ffc7b6894bca8f12533af457289ace73ef3e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:48:52.286 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:51 smithi059 podman[71197]: 2024-06-06 08:48:51.981431993 +0000 UTC m=+0.518480979 container init 84e241d05c3c6bef8051498e985ffc7b6894bca8f12533af457289ace73ef3e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:48:52.287 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:51 smithi059 podman[71197]: 2024-06-06 08:48:51.984811515 +0000 UTC m=+0.521860511 container start 84e241d05c3c6bef8051498e985ffc7b6894bca8f12533af457289ace73ef3e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-06-06T08:48:52.287 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:52 smithi059 podman[71197]: 2024-06-06 08:48:52.073144979 +0000 UTC m=+0.610193995 container attach 84e241d05c3c6bef8051498e985ffc7b6894bca8f12533af457289ace73ef3e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-06T08:48:52.568 INFO:journalctl@ceph.osd.2.smithi059.stdout:Jun 06 08:48:52 smithi059 podman[71197]: 2024-06-06 08:48:52.288980049 +0000 UTC m=+0.826029050 container died 84e241d05c3c6bef8051498e985ffc7b6894bca8f12533af457289ace73ef3e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2) 2024-06-06T08:48:52.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.2.service' 2024-06-06T08:48:52.956 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:48:52.956 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-06-06T08:48:52.957 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-06-06T08:48:52.957 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.3 2024-06-06T08:48:53.290 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:53 smithi028 systemd[1]: Stopping Ceph osd.3 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:48:54.041 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:53 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3[52800]: 2024-06-06T08:48:53.606+0000 7f7ffe800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:48:54.042 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:53 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3[52800]: 2024-06-06T08:48:53.606+0000 7f7ffe800700 -1 osd.3 95 *** Got signal Terminated *** 2024-06-06T08:48:54.042 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:53 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3[52800]: 2024-06-06T08:48:53.606+0000 7f7ffe800700 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:48:54.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:48:53 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:48:53.796+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:48:54.435 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:54 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3[52800]: 2024-06-06T08:48:54.163+0000 7f7ffa000700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:30.604510+0000 front 2024-06-06T08:48:30.605215+0000 (oldest deadline 2024-06-06T08:48:53.504864+0000) 2024-06-06T08:48:54.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:48:54 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:48:54.436+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:48:55.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:48:54 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:48:54.809+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:48:55.290 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:55 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3[52800]: 2024-06-06T08:48:55.170+0000 7f7ffa000700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:30.604510+0000 front 2024-06-06T08:48:30.605215+0000 (oldest deadline 2024-06-06T08:48:53.504864+0000) 2024-06-06T08:48:55.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:48:55 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:48:55.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:48:55.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:48:55 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:48:55.394+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:48:56.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:48:55 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:48:55.614+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:48:56.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:48:55 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:48:55.831+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:48:56.540 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:48:56 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:48:56.401+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:48:56.540 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:56 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3[52800]: 2024-06-06T08:48:56.212+0000 7f7ffa000700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:30.604510+0000 front 2024-06-06T08:48:30.605215+0000 (oldest deadline 2024-06-06T08:48:53.504864+0000) 2024-06-06T08:48:56.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:48:56 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:48:56.222+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:48:57.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:48:56 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:48:56.813+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:48:57.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:48:56 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:48:56.632+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:48:57.540 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:57 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3[52800]: 2024-06-06T08:48:57.176+0000 7f7ffa000700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:30.604510+0000 front 2024-06-06T08:48:30.605215+0000 (oldest deadline 2024-06-06T08:48:53.504864+0000) 2024-06-06T08:48:57.541 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:48:57 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:48:57.397+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:48:57.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:48:57 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:48:57.192+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:48:58.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:48:57 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:48:57.672+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:48:58.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:48:57 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:48:57.839+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:48:58.516 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:58 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3[52800]: 2024-06-06T08:48:58.192+0000 7f7ffa000700 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:30.604510+0000 front 2024-06-06T08:48:30.605215+0000 (oldest deadline 2024-06-06T08:48:53.504864+0000) 2024-06-06T08:48:58.517 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:48:58 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:48:58.411+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:48:58.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:48:58 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:48:58.175+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:48:58.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:48:58 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:48:58.516+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:48:59.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:48:58 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:48:58.659+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:48:59.290 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:58 smithi028 podman[98266]: 2024-06-06 08:48:58.971593671 +0000 UTC m=+5.499767930 container died 9cc3e80f3ec40357b092db458a61b6db2dcc3b209cb90deb0aaffb9aeb12460d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-06-06T08:48:59.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:48:58 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:48:58.815+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:48:59.556 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:48:59 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:48:59.457+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:48:59.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:48:59 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:48:59.174+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:00.040 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:59 smithi028 podman[98266]: 2024-06-06 08:48:59.574878021 +0000 UTC m=+6.103052223 container cleanup 9cc3e80f3ec40357b092db458a61b6db2dcc3b209cb90deb0aaffb9aeb12460d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-06-06T08:49:00.041 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:59 smithi028 bash[98266]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3 2024-06-06T08:49:00.041 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:48:59 smithi028 podman[98292]: 2024-06-06 08:48:59.767682097 +0000 UTC m=+0.780354102 container remove 9cc3e80f3ec40357b092db458a61b6db2dcc3b209cb90deb0aaffb9aeb12460d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-06-06T08:49:00.041 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:48:59 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:48:59.556+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:00.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:48:59 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:48:59.808+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:00.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:48:59 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:48:59.706+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:00.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:00.184+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:00.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:00 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:00.483+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:00.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:00 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:00.535+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:00.791 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:49:00 smithi028 podman[98378]: 2024-06-06 08:49:00.557379043 +0000 UTC m=+0.036332867 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:49:00.792 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:49:00 smithi028 podman[98378]: 2024-06-06 08:49:00.710540404 +0000 UTC m=+0.189494279 container create 0f0304790a1816c982d0e8faaa99bbd58e2e741d5e4830a056e17467c15cc124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True) 2024-06-06T08:49:01.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:00 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:00.765+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:01.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:00.677+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:01.290 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:49:00 smithi028 podman[98378]: 2024-06-06 08:49:00.997777796 +0000 UTC m=+0.476731691 container init 0f0304790a1816c982d0e8faaa99bbd58e2e741d5e4830a056e17467c15cc124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-06-06T08:49:01.290 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:49:01 smithi028 podman[98378]: 2024-06-06 08:49:01.008956385 +0000 UTC m=+0.487910247 container start 0f0304790a1816c982d0e8faaa99bbd58e2e741d5e4830a056e17467c15cc124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-06-06T08:49:01.291 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:49:01 smithi028 podman[98378]: 2024-06-06 08:49:01.113233771 +0000 UTC m=+0.592187677 container attach 0f0304790a1816c982d0e8faaa99bbd58e2e741d5e4830a056e17467c15cc124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3d89acc) 2024-06-06T08:49:01.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:01.142+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:01.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:01 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:01.547+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:01.791 INFO:journalctl@ceph.osd.3.smithi028.stdout:Jun 06 08:49:01 smithi028 podman[98378]: 2024-06-06 08:49:01.479171035 +0000 UTC m=+0.958124914 container died 0f0304790a1816c982d0e8faaa99bbd58e2e741d5e4830a056e17467c15cc124 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-06-06T08:49:01.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:01 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:01.513+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:02.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:01 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:01.755+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:02.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:01.699+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:02.375 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.3.service' 2024-06-06T08:49:02.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:49:02.497 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-06-06T08:49:02.497 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-06-06T08:49:02.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.4 2024-06-06T08:49:02.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:02 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:02.142+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:02.782 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:02 smithi037 systemd[1]: Stopping Ceph osd.4 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:49:02.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:02 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:02.517+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:02.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:02 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:02.533+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:03.023 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:02 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:02.730+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:03.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:02 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:02.784+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:03.063 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:02 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4[48048]: 2024-06-06T08:49:02.814+0000 7f7649313700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:49:03.064 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:02 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4[48048]: 2024-06-06T08:49:02.814+0000 7f7649313700 -1 osd.4 95 *** Got signal Terminated *** 2024-06-06T08:49:03.064 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:02 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4[48048]: 2024-06-06T08:49:02.814+0000 7f7649313700 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:49:03.349 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:03.159+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:03.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:03.159+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:03.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:03 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:03.540+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:03.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:03 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:03.515+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:04.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:03 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:03.812+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:04.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:03 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:03.840+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:04.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:03.724+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:04.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:03.724+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:04.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:04.210+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:04.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:04.210+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:04.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:04 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:04.512+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:04.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:04 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:04.547+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:04.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:04 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:04.547+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:05.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:04 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:04.793+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:05.064 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:04 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:04.839+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:05.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:04.763+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:05.100 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:04.763+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:05.100 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:04.893+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:05.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:05.227+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:05.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:05.227+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:05.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:05 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:05.512+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:05.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:05 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:05.504+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:05.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:05 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:05.504+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:06.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:05 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:05.858+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:06.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:05 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:05.757+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:06.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:05.887+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:06.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:05.733+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:06.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:05.733+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:06.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:06.223+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:06.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:06.223+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:06.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:06 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:06.531+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:06.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:06 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:06.531+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:06.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:06 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:06.510+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:06.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:06 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:06.510+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:07.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:06 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:06.877+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:07.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:06 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:06.763+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:07.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:06 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:06.763+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:07.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:06.866+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:07.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:06.685+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:07.100 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:06.685+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:07.563 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:07 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4[48048]: 2024-06-06T08:49:07.115+0000 7f7645907700 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.601525+0000 front 2024-06-06T08:48:40.601555+0000 (oldest deadline 2024-06-06T08:49:06.501747+0000) 2024-06-06T08:49:07.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:07 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:07.203+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:07.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:07 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:07.203+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:07.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:07 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:07.510+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:07.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:07 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:07.510+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:07.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:07 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:07.523+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:07.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:07 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:07.523+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:08.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:07 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:07.876+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:08.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:07 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:07.785+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:08.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:07 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:07.785+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:08.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:07 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:07.834+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:08.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:07 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:07.729+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:08.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:07 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:07.729+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:08.479 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:08 smithi037 podman[71035]: 2024-06-06 08:49:08.172910338 +0000 UTC m=+5.466931839 container died ed4eafc12fce7ea6f9ff19ca1f52473426783053391d37c57f401d9a432f7ee6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-06T08:49:08.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:08 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:08.161+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:08.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:08 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:08.161+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:08.744 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:08 smithi037 podman[71035]: 2024-06-06 08:49:08.589625717 +0000 UTC m=+5.883647185 container cleanup ed4eafc12fce7ea6f9ff19ca1f52473426783053391d37c57f401d9a432f7ee6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T08:49:08.745 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:08 smithi037 bash[71035]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4 2024-06-06T08:49:08.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:08 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:08.505+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:08.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:08 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:08.505+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:08.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:08 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:08.484+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:08.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:08 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:08.484+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:08.815 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:08 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:08.745+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:08.815 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:08 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:08.745+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:09.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:08 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:08.908+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:09.063 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:08 smithi037 podman[71050]: 2024-06-06 08:49:08.816200825 +0000 UTC m=+0.639996719 container remove ed4eafc12fce7ea6f9ff19ca1f52473426783053391d37c57f401d9a432f7ee6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:49:09.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:08 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:08.853+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:09.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:08 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:08.719+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:09.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:08 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:08.720+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:09.542 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:09 smithi037 podman[71141]: 2024-06-06 08:49:09.178814467 +0000 UTC m=+0.017440392 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:49:09.542 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:09 smithi037 podman[71141]: 2024-06-06 08:49:09.308723157 +0000 UTC m=+0.147349060 container create 8dec16f71d02de6b24bb1012b23fc7f8baadf546c9b66ffcc1c6ae47bb23668a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-06-06T08:49:09.542 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:09 smithi037 podman[71141]: 2024-06-06 08:49:09.544503067 +0000 UTC m=+0.383128971 container init 8dec16f71d02de6b24bb1012b23fc7f8baadf546c9b66ffcc1c6ae47bb23668a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4-deactivate, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-06-06T08:49:09.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:09 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:09.119+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:09.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:09 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:09.119+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:09.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:09 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:09.472+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:09.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:09 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:09.472+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:09.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:09 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:09.525+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:09.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:09 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:09.525+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:09.813 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:09 smithi037 podman[71141]: 2024-06-06 08:49:09.548008501 +0000 UTC m=+0.386634415 container start 8dec16f71d02de6b24bb1012b23fc7f8baadf546c9b66ffcc1c6ae47bb23668a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:49:09.813 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:09 smithi037 podman[71141]: 2024-06-06 08:49:09.661322323 +0000 UTC m=+0.499948237 container attach 8dec16f71d02de6b24bb1012b23fc7f8baadf546c9b66ffcc1c6ae47bb23668a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-06T08:49:09.814 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:09 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:09.764+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:09.814 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:09 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:09.764+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:10.083 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:09 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:09.876+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:10.084 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:09 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:09.769+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:10.084 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:09 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:09.769+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:10.170 INFO:journalctl@ceph.osd.4.smithi037.stdout:Jun 06 08:49:09 smithi037 podman[71141]: 2024-06-06 08:49:09.849516498 +0000 UTC m=+0.688142402 container died 8dec16f71d02de6b24bb1012b23fc7f8baadf546c9b66ffcc1c6ae47bb23668a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-06-06T08:49:10.171 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:09 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:09.874+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:10.349 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:10 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:10.085+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:10.349 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:10 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:10.085+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:10.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.4.service' 2024-06-06T08:49:10.568 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:49:10.568 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-06-06T08:49:10.568 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-06-06T08:49:10.568 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.5 2024-06-06T08:49:10.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:10.424+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:10.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:10.424+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:10.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:10.503+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:10.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:10 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:10.503+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:10.850 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:10 smithi059 systemd[1]: Stopping Ceph osd.5 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:49:10.850 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:10 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:10.720+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:10.850 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:10 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:10.720+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:10.850 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:10 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:10.720+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.806759+0000 front 2024-06-06T08:48:47.806782+0000 (oldest deadline 2024-06-06T08:49:10.706968+0000) 2024-06-06T08:49:11.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:10 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:10.869+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:11.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:10 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:10.792+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:11.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:10 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:10.792+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:11.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:10 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:10.870+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:11.350 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:10 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:10.888+0000 7ff8cae85700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:49:11.350 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:10 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:10.888+0000 7ff8cae85700 -1 osd.5 95 *** Got signal Terminated *** 2024-06-06T08:49:11.350 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:10 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:10.888+0000 7ff8cae85700 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:49:11.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:11 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:11.109+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:11.351 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:11 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:11.109+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:11.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:11 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:11.459+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:11.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:11 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:11.459+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:11.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:11 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:11.459+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:11.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:11 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:11.483+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:11.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:11 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:11.483+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:11.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:11 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:11.483+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:12.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:11 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:11.881+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:12.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:11 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:11.745+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:12.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:11 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:11.745+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:12.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:11 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:11.745+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:12.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:11 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:11.869+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:12.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:11 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:11.736+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:12.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:11 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:11.736+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:12.100 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:11 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:11.736+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.806759+0000 front 2024-06-06T08:48:47.806782+0000 (oldest deadline 2024-06-06T08:49:10.706968+0000) 2024-06-06T08:49:12.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:12 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:12.157+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:12.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:12 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:12.157+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:12.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:12 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:12.157+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:12.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:12 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:12.444+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:12.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:12 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:12.444+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:12.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:12 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:12.444+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:12.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:12 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:12.447+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:12.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:12 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:12.447+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:12.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:12 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:12.447+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:13.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:12 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:12.914+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:13.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:12 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:12.742+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:13.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:12 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:12.742+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:13.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:12 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:12.742+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:13.102 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:12 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:12.861+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:13.103 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:12 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:12.743+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:13.103 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:12 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:12.743+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:13.103 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:12 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:12.743+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.806759+0000 front 2024-06-06T08:48:47.806782+0000 (oldest deadline 2024-06-06T08:49:10.706968+0000) 2024-06-06T08:49:13.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:13 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:13.186+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:13.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:13 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:13.186+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:13.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:13 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:13.186+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:13.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:13 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:13.473+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:13.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:13 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:13.473+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:13.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:13 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:13.473+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:13.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:13 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:13.409+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:13.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:13 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:13.409+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:13.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:13 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:13.409+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:14.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:13 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:13.951+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:14.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:13 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:13.757+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:14.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:13 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:13.757+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:14.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:13 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:13.757+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:14.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:13 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:13.859+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:14.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:13 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:13.737+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:14.100 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:13 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:13.737+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:14.100 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:13 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:13.737+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.806759+0000 front 2024-06-06T08:48:47.806782+0000 (oldest deadline 2024-06-06T08:49:10.706968+0000) 2024-06-06T08:49:14.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:14 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:14.170+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:14.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:14 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:14.170+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:14.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:14 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:14.170+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:14.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:14 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:14.451+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:14.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:14 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:14.451+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:14.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:14 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:14.451+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:14.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:14 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:14.393+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:14.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:14 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:14.393+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:14.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:14 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:14.393+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:15.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:14 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:14.981+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:15.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:14 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:14.981+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:15.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:14 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:14.779+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:15.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:14 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:14.779+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:15.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:14 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:14.779+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:15.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:14 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:14.821+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:15.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:14 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:14.821+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:15.100 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:14 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:14.752+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:15.100 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:14 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:14.752+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:15.100 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:14 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:14.752+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.806759+0000 front 2024-06-06T08:48:47.806782+0000 (oldest deadline 2024-06-06T08:49:10.706968+0000) 2024-06-06T08:49:15.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:15 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:15.138+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:15.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:15 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:15.138+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:15.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:15 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:15.138+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:15.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:15 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:15.457+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:15.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:15 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:15.457+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:15.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:15 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:15.457+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:15.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:15 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:15.405+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:15.792 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:15 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:15.405+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:15.792 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:15 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:15.405+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:16.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:15 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:15.944+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:16.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:15 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:15.944+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:16.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:15 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:15.750+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:16.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:15 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:15.750+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:16.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:15 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:15.750+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:16.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:15 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:15.779+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:16.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:15 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:15.779+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:16.100 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:15 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:15.702+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.504611+0000 front 2024-06-06T08:48:28.504476+0000 (oldest deadline 2024-06-06T08:48:55.504987+0000) 2024-06-06T08:49:16.100 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:15 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:15.702+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.805817+0000 front 2024-06-06T08:48:37.805978+0000 (oldest deadline 2024-06-06T08:49:03.105864+0000) 2024-06-06T08:49:16.100 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:15 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5[48294]: 2024-06-06T08:49:15.702+0000 7ff8c7479700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.806759+0000 front 2024-06-06T08:48:47.806782+0000 (oldest deadline 2024-06-06T08:49:10.706968+0000) 2024-06-06T08:49:16.555 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:16 smithi059 podman[71314]: 2024-06-06 08:49:16.256843438 +0000 UTC m=+5.487309029 container died 5f59f8b845987dce6fed959b41908400125a76f7fcf5e87f92db8989a4f4b78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-06T08:49:16.555 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:16 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:16.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:16.556 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:16 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:16.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:16.556 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:16 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:16.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:16.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:16 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:16.463+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:16.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:16 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:16.463+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:16.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:16 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:16.463+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:16.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:16 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:16.377+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:16.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:16 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:16.377+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:16.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:16 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:16.377+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:16.846 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:16 smithi059 podman[71314]: 2024-06-06 08:49:16.655335745 +0000 UTC m=+5.885801337 container cleanup 5f59f8b845987dce6fed959b41908400125a76f7fcf5e87f92db8989a4f4b78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2) 2024-06-06T08:49:16.846 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:16 smithi059 bash[71314]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5 2024-06-06T08:49:16.847 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:16 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:16.776+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:16.847 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:16 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:16.776+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:17.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:16 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:16.954+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:17.064 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:16 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:16.954+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:17.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:16 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:16.726+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:17.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:16 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:16.726+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:17.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:16 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:16.726+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:17.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:16 smithi059 podman[71332]: 2024-06-06 08:49:16.848380535 +0000 UTC m=+0.584916016 container remove 5f59f8b845987dce6fed959b41908400125a76f7fcf5e87f92db8989a4f4b78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, ceph=True, CEPH_POINT_RELEASE=) 2024-06-06T08:49:17.437 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:17 smithi059 podman[71422]: 2024-06-06 08:49:17.183128938 +0000 UTC m=+0.017873283 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:49:17.437 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:17 smithi059 podman[71422]: 2024-06-06 08:49:17.307751402 +0000 UTC m=+0.142495754 container create 10cb186793b01017dbf2f6d13e77e4d73999b048e5b52c694b3b955a27aa1e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:49:17.438 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:17 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:17.174+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:17.438 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:17 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:17.174+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:17.438 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:17 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:17.174+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:17.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:17 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:17.448+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:17.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:17 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:17.448+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:17.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:17 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:17.448+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:17.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:17 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:17.394+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:17.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:17 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:17.394+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:17.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:17 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:17.394+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:17.824 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:17 smithi059 podman[71422]: 2024-06-06 08:49:17.552592503 +0000 UTC m=+0.387336841 container init 10cb186793b01017dbf2f6d13e77e4d73999b048e5b52c694b3b955a27aa1e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-06T08:49:17.824 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:17 smithi059 podman[71422]: 2024-06-06 08:49:17.556135528 +0000 UTC m=+0.390879863 container start 10cb186793b01017dbf2f6d13e77e4d73999b048e5b52c694b3b955a27aa1e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:49:17.824 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:17 smithi059 podman[71422]: 2024-06-06 08:49:17.652089014 +0000 UTC m=+0.486833350 container attach 10cb186793b01017dbf2f6d13e77e4d73999b048e5b52c694b3b955a27aa1e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-06T08:49:18.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:17 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:17.934+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:18.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:17 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:17.934+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:18.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:17 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:17.751+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:18.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:17 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:17.751+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:18.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:17 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:17.751+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:18.099 INFO:journalctl@ceph.osd.5.smithi059.stdout:Jun 06 08:49:17 smithi059 podman[71422]: 2024-06-06 08:49:17.852355467 +0000 UTC m=+0.687099809 container died 10cb186793b01017dbf2f6d13e77e4d73999b048e5b52c694b3b955a27aa1e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-5-deactivate, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T08:49:18.100 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:17 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:17.825+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:18.100 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:17 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:17.825+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:18.430 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:18 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:18.185+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:18.430 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:18 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:18.186+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:18.430 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:18 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:18.186+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:18.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.5.service' 2024-06-06T08:49:18.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:49:18.495 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-06-06T08:49:18.495 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-06-06T08:49:18.495 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.6 2024-06-06T08:49:18.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:18 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:18.442+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:18.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:18 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:18.442+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:18.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:18 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:18.442+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:18.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:18 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:18.496+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:18.792 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:18 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:18.496+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:18.792 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:18 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:18.496+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:18.792 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:18 smithi028 systemd[1]: Stopping Ceph osd.6 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:49:19.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:18 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:18.918+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:19.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:18 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:18.918+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:19.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:18 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:18.710+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:19.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:18 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:18.710+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:19.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:18 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:18.710+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:19.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:18 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:18.793+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:19.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:18 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:18.793+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:19.494 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:19 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:19.409+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:19.495 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:19 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:19.409+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:19.495 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:19 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:19.409+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:19.495 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:19 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:19.160+0000 7f3836e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:49:19.495 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:19 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:19.160+0000 7f3836e00700 -1 osd.6 95 *** Got signal Terminated *** 2024-06-06T08:49:19.495 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:19 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:19.160+0000 7f3836e00700 -1 osd.6 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:49:19.496 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:19 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:19.495+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:19.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:19 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:19.162+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:19.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:19 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:19.162+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:19.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:19 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:19.162+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:19.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:19 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:19.495+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:19.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:19 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:19.495+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:19.923 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:19 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:19.665+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:19.924 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:19 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:19.665+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:19.924 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:19 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:19.665+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:19.924 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:19 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:19.665+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:20.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:19 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:19.818+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:20.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:19 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:19.818+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:20.313 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:19 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:19.924+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:20.313 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:19 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:19.924+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:20.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:20 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:20.121+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:20.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:20 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:20.121+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:20.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:20 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:20.121+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:20.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:20 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:20.462+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:20.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:20 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:20.462+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:20.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:20 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:20.462+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:20.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:20 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:20.376+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:20.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:20 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:20.376+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:20.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:20 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:20.376+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:20.916 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:20 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:20.649+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:20.916 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:20 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:20.649+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:20.916 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:20 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:20.649+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:20.917 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:20 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:20.649+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:21.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:20 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:20.822+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:21.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:20 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:20.822+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:21.314 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:20 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:20.918+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:21.314 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:20 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:20.918+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:21.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:21 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:21.104+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:21.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:21 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:21.104+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:21.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:21 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:21.104+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:21.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:21 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:21.407+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:21.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:21 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:21.407+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:21.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:21 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:21.407+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:21.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:21 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:21.407+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:21.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:21 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:21.490+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:21.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:21 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:21.490+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:21.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:21 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:21.490+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:21.792 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:21 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:21.490+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.619007+0000 front 2024-06-06T08:48:56.619063+0000 (oldest deadline 2024-06-06T08:49:20.719157+0000) 2024-06-06T08:49:21.887 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:21 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:21.623+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:21.888 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:21 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:21.623+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:21.888 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:21 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:21.623+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:21.888 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:21 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:21.623+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:22.313 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:21 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:21.889+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:22.313 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:21 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:21.889+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:22.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:21 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:21.864+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:22.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:21 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:21.864+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:22.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:22 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:22.087+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:22.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:22 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:22.087+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:22.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:22 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:22.087+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:22.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:22 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:22.375+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:22.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:22 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:22.375+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:22.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:22 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:22.375+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:22.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:22 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:22.375+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:22.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:22 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:22.473+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:22.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:22 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:22.473+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:22.791 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:22 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:22.473+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:22.792 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:22 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:22.473+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.619007+0000 front 2024-06-06T08:48:56.619063+0000 (oldest deadline 2024-06-06T08:49:20.719157+0000) 2024-06-06T08:49:23.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:22 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:22.651+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:23.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:22 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:22.651+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:23.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:22 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:22.651+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:23.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:22 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:22.651+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:23.064 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:22 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:22.842+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:23.064 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:22 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:22.842+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:23.064 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:22 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:22.842+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:57.619333+0000 front 2024-06-06T08:48:57.619358+0000 (oldest deadline 2024-06-06T08:49:22.319092+0000) 2024-06-06T08:49:23.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:22 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:22.822+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:23.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:22 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:22.822+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:23.100 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:22 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:22.822+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:23.100 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:23 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:23.064+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:23.100 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:23 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:23.064+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:23.100 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:23 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:23.064+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:23.692 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:23 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:23.495+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.513142+0000 front 2024-06-06T08:48:29.512900+0000 (oldest deadline 2024-06-06T08:48:54.212639+0000) 2024-06-06T08:49:23.693 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:23 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:23.495+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.115170+0000 front 2024-06-06T08:48:40.115090+0000 (oldest deadline 2024-06-06T08:49:06.015315+0000) 2024-06-06T08:49:23.693 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:23 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:23.495+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:46.016415+0000 front 2024-06-06T08:48:46.016521+0000 (oldest deadline 2024-06-06T08:49:10.716654+0000) 2024-06-06T08:49:23.693 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:23 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6[59638]: 2024-06-06T08:49:23.495+0000 7f382d600700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.619007+0000 front 2024-06-06T08:48:56.619063+0000 (oldest deadline 2024-06-06T08:49:20.719157+0000) 2024-06-06T08:49:23.693 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:23 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:23.354+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:23.693 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:23 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:23.354+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:23.694 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:23 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:23.354+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:23.694 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:23 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:23.354+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:24.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:23 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:23.849+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:24.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:23 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:23.849+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:24.064 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:23 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:23.849+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:57.619333+0000 front 2024-06-06T08:48:57.619358+0000 (oldest deadline 2024-06-06T08:49:22.319092+0000) 2024-06-06T08:49:24.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:23 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:23.641+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:24.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:23 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:23.641+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:24.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:23 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:23.641+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:24.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:23 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:23.641+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:24.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:23 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:23.837+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:24.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:23 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:23.837+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:24.100 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:23 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:23.837+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:24.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:24 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:24.101+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:24.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:24 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:24.102+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:24.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:24 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:24.102+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:24.674 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:24 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:24.404+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:24.675 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:24 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:24.404+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:24.675 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:24 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:24.404+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:24.675 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:24 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:24.404+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:24.968 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:24 smithi028 podman[98486]: 2024-06-06 08:49:24.676482672 +0000 UTC m=+5.686337377 container died 40b85554efd2d9b29b9b19774f4d9e43b9222ac8e7e4fcaed80664c7847337af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-06-06T08:49:25.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:24 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:24.864+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:25.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:24 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:24.864+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:25.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:24 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:24.864+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:57.619333+0000 front 2024-06-06T08:48:57.619358+0000 (oldest deadline 2024-06-06T08:49:22.319092+0000) 2024-06-06T08:49:25.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:24 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:24.691+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:25.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:24 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:24.691+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:25.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:24 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:24.691+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:25.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:24 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:24.691+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:25.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:24 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:24.819+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:25.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:24 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:24.819+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:25.099 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:24 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:24.819+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:25.100 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:25 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:25.064+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:25.100 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:25 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:25.064+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:25.100 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:25 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:25.064+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:25.290 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:25 smithi028 podman[98486]: 2024-06-06 08:49:25.170025015 +0000 UTC m=+6.179879750 container cleanup 40b85554efd2d9b29b9b19774f4d9e43b9222ac8e7e4fcaed80664c7847337af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_CLEAN=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-06-06T08:49:25.290 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:25 smithi028 bash[98486]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6 2024-06-06T08:49:25.790 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:25 smithi028 podman[98502]: 2024-06-06 08:49:25.471719836 +0000 UTC m=+0.786044167 container remove 40b85554efd2d9b29b9b19774f4d9e43b9222ac8e7e4fcaed80664c7847337af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-06T08:49:25.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:25 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:25.448+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:25.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:25 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:25.448+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:25.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:25 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:25.448+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:25.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:25 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:25.448+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:26.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:25 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:25.844+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:26.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:25 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:25.844+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:26.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:25 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:25.844+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:57.619333+0000 front 2024-06-06T08:48:57.619358+0000 (oldest deadline 2024-06-06T08:49:22.319092+0000) 2024-06-06T08:49:26.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:25 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:25.740+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:26.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:25 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:25.740+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:26.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:25 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:25.740+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:26.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:25 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:25.740+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:26.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:25 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:25.866+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:26.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:25 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:25.866+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:26.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:25 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:25.866+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:26.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:26 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:26.055+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:26.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:26 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:26.055+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:26.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:26 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:26.055+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:26.540 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:26 smithi028 podman[98605]: 2024-06-06 08:49:26.161556426 +0000 UTC m=+0.033067711 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:49:26.541 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:26 smithi028 podman[98605]: 2024-06-06 08:49:26.280656575 +0000 UTC m=+0.152167897 container create b618fe8c7c755710af36535885f90c891698cd865c6f6237f19a12947c3126fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2) 2024-06-06T08:49:26.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:26 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:26.492+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:26.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:26 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:26.492+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:26.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:26 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:26.492+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:26.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:26 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:26.492+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:27.042 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:26 smithi028 podman[98605]: 2024-06-06 08:49:26.601641946 +0000 UTC m=+0.473153294 container init b618fe8c7c755710af36535885f90c891698cd865c6f6237f19a12947c3126fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc) 2024-06-06T08:49:27.042 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:26 smithi028 podman[98605]: 2024-06-06 08:49:26.613431772 +0000 UTC m=+0.484943101 container start b618fe8c7c755710af36535885f90c891698cd865c6f6237f19a12947c3126fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-06T08:49:27.043 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:26 smithi028 podman[98605]: 2024-06-06 08:49:26.675376163 +0000 UTC m=+0.546887491 container attach b618fe8c7c755710af36535885f90c891698cd865c6f6237f19a12947c3126fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:49:27.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:26 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:26.869+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:27.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:26 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:26.869+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:27.064 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:26 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:26.869+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:57.619333+0000 front 2024-06-06T08:48:57.619358+0000 (oldest deadline 2024-06-06T08:49:22.319092+0000) 2024-06-06T08:49:27.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:26 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:26.700+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:27.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:26 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:26.700+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:27.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:26 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:26.700+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:27.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:26 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:26.700+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:27.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:26 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:26.895+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:27.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:26 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:26.895+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:27.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:26 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:26.895+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:27.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:27 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:27.050+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:27.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:27 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:27.050+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:27.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:27 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:27.050+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:27.407 INFO:journalctl@ceph.osd.6.smithi028.stdout:Jun 06 08:49:27 smithi028 podman[98632]: 2024-06-06 08:49:27.138128846 +0000 UTC m=+0.038587197 container died b618fe8c7c755710af36535885f90c891698cd865c6f6237f19a12947c3126fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528) 2024-06-06T08:49:27.778 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:27 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:27.484+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:27.778 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:27 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:27.484+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:27.778 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:27 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:27.484+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:27.778 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:27 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:27.484+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:27.825 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.6.service' 2024-06-06T08:49:27.944 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:49:27.944 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-06-06T08:49:27.944 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-06-06T08:49:27.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.7 2024-06-06T08:49:27.972 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:27 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:27.867+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:27.972 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:27 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:27.867+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:27.972 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:27 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:27.867+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:57.619333+0000 front 2024-06-06T08:48:57.619358+0000 (oldest deadline 2024-06-06T08:49:22.319092+0000) 2024-06-06T08:49:27.972 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:27 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:27.709+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:27.973 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:27 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:27.709+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:27.973 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:27 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:27.709+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:27.973 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:27 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:27.709+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:28.265 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:28 smithi037 systemd[1]: Stopping Ceph osd.7 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:49:28.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:27 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:27.891+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:28.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:27 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:27.891+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:28.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:27 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:27.892+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:28.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:28 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:28.083+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:28.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:28 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:28.083+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:28.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:28 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:28.083+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:28.563 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:28 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:28.267+0000 7f5055588700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:49:28.563 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:28 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:28.267+0000 7f5055588700 -1 osd.7 95 *** Got signal Terminated *** 2024-06-06T08:49:28.564 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:28 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:28.267+0000 7f5055588700 -1 osd.7 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:49:28.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:28 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:28.445+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:28.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:28 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:28.445+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:28.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:28 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:28.445+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:28.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:28 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:28.445+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:29.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:28 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:28.877+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:29.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:28 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:28.877+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:29.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:28 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:28.877+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:57.619333+0000 front 2024-06-06T08:48:57.619358+0000 (oldest deadline 2024-06-06T08:49:22.319092+0000) 2024-06-06T08:49:29.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:28 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:28.749+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:29.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:28 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:28.749+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:29.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:28 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:28.749+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:29.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:28 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:28.749+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:29.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:28 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:28.921+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:29.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:28 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:28.921+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:29.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:28 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:28.921+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:29.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:29 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:29.097+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:29.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:29 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:29.097+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:29.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:29 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:29.097+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:29.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:29 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:29.402+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:29.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:29 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:29.402+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:29.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:29 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:29.402+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:29.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:29 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:29.402+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:30.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:29 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:29.875+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:30.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:29 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:29.875+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:30.064 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:29 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:29.875+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:57.619333+0000 front 2024-06-06T08:48:57.619358+0000 (oldest deadline 2024-06-06T08:49:22.319092+0000) 2024-06-06T08:49:30.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:29 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:29.709+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:30.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:29 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:29.709+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:30.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:29 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:29.709+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:30.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:29 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:29.709+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:30.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:29 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:29.937+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:30.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:29 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:29.937+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:30.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:29 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:29.937+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:30.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:30 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:30.116+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:30.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:30 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:30.116+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:30.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:30 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:30.116+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:30.351 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:30 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:30.116+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:30.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:30 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:30.357+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:30.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:30 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:30.357+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:30.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:30 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:30.357+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:30.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:30 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:30.357+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:31.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:30 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:30.871+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:31.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:30 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:30.871+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:31.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:30 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:30.871+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:57.619333+0000 front 2024-06-06T08:48:57.619358+0000 (oldest deadline 2024-06-06T08:49:22.319092+0000) 2024-06-06T08:49:31.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:30 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:30.749+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:31.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:30 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:30.749+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:31.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:30 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:30.749+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:31.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:30 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:30.749+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:31.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:30 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:30.749+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:31.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:30 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:30.966+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:31.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:30 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:30.966+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:31.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:30 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:30.966+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:31.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:31 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:31.099+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:31.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:31 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:31.099+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:31.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:31 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:31.099+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:31.351 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:31 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:31.099+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:31.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:31 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:31.322+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:31.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:31 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:31.322+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:31.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:31 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:31.322+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:31.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:31 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:31.322+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:32.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:31 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:31.903+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:32.064 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:31 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:31.903+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:32.064 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:31 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:31.903+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:57.619333+0000 front 2024-06-06T08:48:57.619358+0000 (oldest deadline 2024-06-06T08:49:22.319092+0000) 2024-06-06T08:49:32.064 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:31 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:31.903+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:07.019982+0000 front 2024-06-06T08:49:07.019999+0000 (oldest deadline 2024-06-06T08:49:31.120203+0000) 2024-06-06T08:49:32.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:31 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:31.719+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:32.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:31 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:31.719+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:32.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:31 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:31.719+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:32.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:31 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:31.719+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:32.065 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:31 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:31.719+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:32.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:31 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:31.971+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:32.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:31 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:31.971+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:32.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:31 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:31.971+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:32.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:32 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:32.066+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:32.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:32 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:32.066+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:32.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:32 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:32.066+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:32.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:32 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:32.066+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:32.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:32 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:32.357+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:32.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:32 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:32.357+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:32.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:32 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:32.357+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:32.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:32 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:32.357+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:33.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:32 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:32.949+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:40.815341+0000 front 2024-06-06T08:48:40.815318+0000 (oldest deadline 2024-06-06T08:49:03.115457+0000) 2024-06-06T08:49:33.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:32 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:32.949+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.517275+0000 front 2024-06-06T08:48:49.517431+0000 (oldest deadline 2024-06-06T08:49:14.817324+0000) 2024-06-06T08:49:33.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:32 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:32.949+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:57.619333+0000 front 2024-06-06T08:48:57.619358+0000 (oldest deadline 2024-06-06T08:49:22.319092+0000) 2024-06-06T08:49:33.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:32 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7[54582]: 2024-06-06T08:49:32.949+0000 7f5051b7c700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:07.019982+0000 front 2024-06-06T08:49:07.019999+0000 (oldest deadline 2024-06-06T08:49:31.120203+0000) 2024-06-06T08:49:33.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:32 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:32.728+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:33.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:32 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:32.728+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:33.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:32 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:32.728+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:33.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:32 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:32.728+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:33.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:32 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:32.728+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:33.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:33 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:33.017+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:33.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:33 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:33.017+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:33.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:33 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:33.017+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:33.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:33 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:33.109+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:33.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:33 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:33.109+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:33.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:33 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:33.109+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:33.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:33 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:33.109+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:33.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:33 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:33.347+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:33.794 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:33 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:33.347+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:33.794 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:33 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:33.347+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:33.794 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:33 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:33.347+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:34.063 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:33 smithi037 podman[71261]: 2024-06-06 08:49:33.690798164 +0000 UTC m=+5.536383121 container died ddb090c6c0d20c63eaea0ccf9ff2e762f6edcc8c620740ca681c4a3029348a39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T08:49:34.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:33 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:33.693+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:34.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:33 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:33.693+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:34.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:33 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:33.693+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:34.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:33 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:33.693+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:34.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:33 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:33.693+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:34.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:34 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:34.029+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:34.349 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:34 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:34.029+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:34.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:34 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:34.029+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:34.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:34 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:34.029+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:07.416449+0000 front 2024-06-06T08:49:07.416321+0000 (oldest deadline 2024-06-06T08:49:33.316220+0000) 2024-06-06T08:49:34.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:34 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:34.134+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:34.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:34 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:34.134+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:34.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:34 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:34.134+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:34.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:34 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:34.134+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:34.433 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:34 smithi037 podman[71261]: 2024-06-06 08:49:34.234280976 +0000 UTC m=+6.079865933 container cleanup ddb090c6c0d20c63eaea0ccf9ff2e762f6edcc8c620740ca681c4a3029348a39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-06-06T08:49:34.433 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:34 smithi037 bash[71261]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7 2024-06-06T08:49:34.737 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:34 smithi037 podman[71278]: 2024-06-06 08:49:34.435453662 +0000 UTC m=+0.740483984 container remove ddb090c6c0d20c63eaea0ccf9ff2e762f6edcc8c620740ca681c4a3029348a39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-06T08:49:34.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:34 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:34.306+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:34.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:34 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:34.306+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:34.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:34 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:34.306+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:34.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:34 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:34.306+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:35.045 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:34 smithi037 podman[71371]: 2024-06-06 08:49:34.861189021 +0000 UTC m=+0.113467603 container create 5b40e49f46862c4d886a9d7c0c401cfd3533baa6a97a8125da64defe363ad5f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:49:35.161 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:34 smithi037 podman[71371]: 2024-06-06 08:49:34.765304372 +0000 UTC m=+0.017582975 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:49:35.161 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:34 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:34.738+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:35.161 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:34 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:34.738+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:35.162 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:34 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:34.738+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:35.162 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:34 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:34.738+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:35.162 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:34 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:34.738+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:35.313 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:35 smithi037 podman[71371]: 2024-06-06 08:49:35.046963513 +0000 UTC m=+0.299242115 container init 5b40e49f46862c4d886a9d7c0c401cfd3533baa6a97a8125da64defe363ad5f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-06T08:49:35.313 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:35 smithi037 podman[71371]: 2024-06-06 08:49:35.050278552 +0000 UTC m=+0.302557150 container start 5b40e49f46862c4d886a9d7c0c401cfd3533baa6a97a8125da64defe363ad5f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T08:49:35.313 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:35 smithi037 podman[71371]: 2024-06-06 08:49:35.147007125 +0000 UTC m=+0.399285731 container attach 5b40e49f46862c4d886a9d7c0c401cfd3533baa6a97a8125da64defe363ad5f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=) 2024-06-06T08:49:35.349 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:35 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:35.145+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:35.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:35 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:35.145+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:35.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:35 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:35.145+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:35.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:35 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:35.145+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:35.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:35 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:35.029+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:35.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:35 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:35.029+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:35.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:35 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:35.029+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:35.351 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:35 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:35.029+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:07.416449+0000 front 2024-06-06T08:49:07.416321+0000 (oldest deadline 2024-06-06T08:49:33.316220+0000) 2024-06-06T08:49:35.656 INFO:journalctl@ceph.osd.7.smithi037.stdout:Jun 06 08:49:35 smithi037 podman[71371]: 2024-06-06 08:49:35.360480963 +0000 UTC m=+0.612759560 container died 5b40e49f46862c4d886a9d7c0c401cfd3533baa6a97a8125da64defe363ad5f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-06T08:49:35.768 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:35 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:35.345+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:35.768 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:35 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:35.345+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:35.768 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:35 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:35.345+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:35.768 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:35 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:35.345+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:35.940 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:35 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:35.785+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:35.940 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:35 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:35.785+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:35.940 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:35 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:35.785+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:35.940 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:35 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:35.785+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:35.940 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:35 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:35.785+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:35.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.7.service' 2024-06-06T08:49:36.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:49:36.054 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-06-06T08:49:36.054 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-06-06T08:49:36.055 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.8 2024-06-06T08:49:36.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:36 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:36.155+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:36.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:36 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:36.155+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:36.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:36 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:36.155+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:36.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:36 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:36.155+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:36.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:36 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:36.061+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:36.351 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:36 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:36.061+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:36.351 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:36 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:36.061+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:36.351 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:36 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:36.061+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:07.416449+0000 front 2024-06-06T08:49:07.416321+0000 (oldest deadline 2024-06-06T08:49:33.316220+0000) 2024-06-06T08:49:36.351 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:36 smithi059 systemd[1]: Stopping Ceph osd.8 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:49:36.790 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:36 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:36.308+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:36.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:36 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:36.308+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:36.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:36 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:36.308+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:36.791 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:36 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:36.308+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:36.849 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:36 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:36.391+0000 7f99df934700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:49:36.849 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:36 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:36.391+0000 7f99df934700 -1 osd.8 95 *** Got signal Terminated *** 2024-06-06T08:49:36.849 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:36 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:36.391+0000 7f99df934700 -1 osd.8 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:49:37.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:36 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:36.791+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:37.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:36 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:36.791+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:37.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:36 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:36.791+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:37.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:36 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:36.791+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:37.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:36 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:36.791+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:37.349 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:37 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:37.143+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:37.349 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:37 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:37.143+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:37.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:37 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:37.143+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:37.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:37 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:37.143+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:37.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:37 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:37.076+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:37.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:37 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:37.076+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:37.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:37 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:37.076+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:37.350 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:37 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:37.076+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:07.416449+0000 front 2024-06-06T08:49:07.416321+0000 (oldest deadline 2024-06-06T08:49:33.316220+0000) 2024-06-06T08:49:37.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:37 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:37.264+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:37.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:37 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:37.264+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:37.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:37 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:37.264+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:37.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:37 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:37.264+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:38.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:37 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:37.754+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:38.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:37 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:37.754+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:38.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:37 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:37.754+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:38.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:37 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:37.754+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:38.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:37 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:37.754+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:38.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:38 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:38.232+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:38.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:38 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:38.232+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:38.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:38 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:38.232+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:38.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:38 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:38.232+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:38.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:38 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:38.186+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:38.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:38 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:38.186+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:38.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:38 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:38.186+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:38.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:38 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:38.186+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:38.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:38 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:38.116+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:38.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:38 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:38.116+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:38.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:38 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:38.116+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:38.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:38 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:38.116+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:07.416449+0000 front 2024-06-06T08:49:07.416321+0000 (oldest deadline 2024-06-06T08:49:33.316220+0000) 2024-06-06T08:49:39.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:38 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:38.777+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:39.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:38 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:38.777+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:39.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:38 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:38.777+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:39.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:38 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:38.777+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:39.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:38 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:38.777+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:39.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:38 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:38.777+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:39.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:39 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:39.206+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:39.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:39 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:39.206+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:39.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:39 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:39.206+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:39.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:39 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:39.206+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:39.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:39 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:39.219+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:39.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:39 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:39.219+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:39.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:39 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:39.219+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:39.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:39 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:39.219+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:39.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:39 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:39.156+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:39.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:39 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:39.156+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:39.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:39 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:39.156+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:39.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:39 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:39.156+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:07.416449+0000 front 2024-06-06T08:49:07.416321+0000 (oldest deadline 2024-06-06T08:49:33.316220+0000) 2024-06-06T08:49:40.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:39 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:39.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:40.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:39 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:39.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:40.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:39 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:39.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:40.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:39 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:39.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:40.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:39 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:39.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:40.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:39 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:39.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:40.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:40 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:40.202+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:40.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:40 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:40.202+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:40.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:40 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:40.202+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:40.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:40 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:40.202+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:40.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:40 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:40.213+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:40.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:40 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:40.213+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:40.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:40 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:40.213+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:40.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:40 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:40.213+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:40.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:40 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:40.213+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:40.601 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:40 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:40.118+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:40.601 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:40 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:40.118+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:40.601 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:40 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:40.118+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:40.601 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:40 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:40.118+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:07.416449+0000 front 2024-06-06T08:49:07.416321+0000 (oldest deadline 2024-06-06T08:49:33.316220+0000) 2024-06-06T08:49:40.601 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:40 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:40.118+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:13.316707+0000 front 2024-06-06T08:49:13.316770+0000 (oldest deadline 2024-06-06T08:49:39.216861+0000) 2024-06-06T08:49:41.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:40 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:40.748+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:41.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:40 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:40.748+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:41.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:40 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:40.748+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:41.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:40 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:40.748+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:41.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:40 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:40.748+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:41.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:40 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:40.748+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:41.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:41 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:41.171+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:41.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:41 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:41.171+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:41.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:41 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:41.171+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:41.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:41 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:41.171+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:41.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:41 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:41.171+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.720133+0000 front 2024-06-06T08:49:14.720003+0000 (oldest deadline 2024-06-06T08:49:40.619913+0000) 2024-06-06T08:49:41.599 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:41 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:41.127+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.311040+0000 front 2024-06-06T08:48:41.310869+0000 (oldest deadline 2024-06-06T08:49:04.810972+0000) 2024-06-06T08:49:41.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:41 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:41.127+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:48.212510+0000 front 2024-06-06T08:48:48.212635+0000 (oldest deadline 2024-06-06T08:49:14.013431+0000) 2024-06-06T08:49:41.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:41 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:41.127+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:58.114958+0000 front 2024-06-06T08:48:58.114856+0000 (oldest deadline 2024-06-06T08:49:22.214786+0000) 2024-06-06T08:49:41.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:41 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:41.127+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:07.416449+0000 front 2024-06-06T08:49:07.416321+0000 (oldest deadline 2024-06-06T08:49:33.316220+0000) 2024-06-06T08:49:41.600 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:41 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8[55250]: 2024-06-06T08:49:41.127+0000 7f99d7f20700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:13.316707+0000 front 2024-06-06T08:49:13.316770+0000 (oldest deadline 2024-06-06T08:49:39.216861+0000) 2024-06-06T08:49:41.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:41 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:41.172+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:41.601 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:41 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:41.172+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:41.601 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:41 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:41.172+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:41.601 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:41 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:41.172+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:41.601 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:41 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:41.172+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:42.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:41 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:41.752+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:42.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:41 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:41.752+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:42.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:41 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:41.752+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:42.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:41 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:41.752+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:42.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:41 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:41.752+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:42.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:41 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:41.752+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:42.205 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:41 smithi059 podman[71540]: 2024-06-06 08:49:41.941529523 +0000 UTC m=+5.680316830 container died f9ed6082cfd6657c28071eb6c2bd3582be016692c678d6f1022a8466fc495072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240528) 2024-06-06T08:49:42.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:42 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:42.175+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:42.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:42 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:42.175+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:42.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:42 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:42.175+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:42.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:42 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:42.175+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:42.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:42 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:42.175+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.720133+0000 front 2024-06-06T08:49:14.720003+0000 (oldest deadline 2024-06-06T08:49:40.619913+0000) 2024-06-06T08:49:42.591 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:42 smithi059 podman[71540]: 2024-06-06 08:49:42.300301958 +0000 UTC m=+6.039089266 container cleanup f9ed6082cfd6657c28071eb6c2bd3582be016692c678d6f1022a8466fc495072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-06-06T08:49:42.591 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:42 smithi059 bash[71540]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8 2024-06-06T08:49:42.591 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:42 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:42.206+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:42.591 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:42 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:42.206+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:42.592 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:42 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:42.206+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:42.592 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:42 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:42.206+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:42.592 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:42 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:42.206+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:42.849 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:42 smithi059 podman[71556]: 2024-06-06 08:49:42.593075808 +0000 UTC m=+0.648371938 container remove f9ed6082cfd6657c28071eb6c2bd3582be016692c678d6f1022a8466fc495072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-06-06T08:49:42.987 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:42 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:42.731+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:42.988 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:42 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:42.731+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:42.988 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:42 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:42.731+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:42.988 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:42 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:42.731+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:42.988 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:42 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:42.731+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:42.988 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:42 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:42.731+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:43.202 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:42 smithi059 podman[71645]: 2024-06-06 08:49:42.835691436 +0000 UTC m=+0.017297021 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:49:43.202 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:42 smithi059 podman[71645]: 2024-06-06 08:49:42.94402615 +0000 UTC m=+0.125631723 container create 5649cc8bdf16e81be0c3466ce8ab8088d7a5aef2784a5b736faa486944991d12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-06-06T08:49:43.511 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:43 smithi059 podman[71645]: 2024-06-06 08:49:43.204557154 +0000 UTC m=+0.386162743 container init 5649cc8bdf16e81be0c3466ce8ab8088d7a5aef2784a5b736faa486944991d12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, ceph=True) 2024-06-06T08:49:43.511 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:43 smithi059 podman[71645]: 2024-06-06 08:49:43.208015543 +0000 UTC m=+0.389621116 container start 5649cc8bdf16e81be0c3466ce8ab8088d7a5aef2784a5b736faa486944991d12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T08:49:43.512 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:43 smithi059 podman[71645]: 2024-06-06 08:49:43.279567057 +0000 UTC m=+0.461172635 container attach 5649cc8bdf16e81be0c3466ce8ab8088d7a5aef2784a5b736faa486944991d12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-06-06T08:49:43.512 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:43 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:43.249+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:43.512 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:43 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:43.249+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:43.512 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:43 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:43.249+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:43.513 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:43 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:43.249+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:43.513 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:43 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:43.249+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:43.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:43 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:43.214+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:43.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:43 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:43.214+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:43.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:43 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:43.214+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:43.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:43 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:43.214+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:43.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:43 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:43.214+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.720133+0000 front 2024-06-06T08:49:14.720003+0000 (oldest deadline 2024-06-06T08:49:40.619913+0000) 2024-06-06T08:49:43.849 INFO:journalctl@ceph.osd.8.smithi059.stdout:Jun 06 08:49:43 smithi059 podman[71645]: 2024-06-06 08:49:43.513794375 +0000 UTC m=+0.695399949 container died 5649cc8bdf16e81be0c3466ce8ab8088d7a5aef2784a5b736faa486944991d12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-06-06T08:49:44.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:43 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:43.753+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:44.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:43 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:43.753+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:44.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:43 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:43.753+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:44.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:43 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:43.753+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:44.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:43 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:43.753+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:44.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:43 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:43.753+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:44.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.8.service' 2024-06-06T08:49:44.199 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:49:44.200 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-06-06T08:49:44.200 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-06-06T08:49:44.200 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.9 2024-06-06T08:49:44.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:44.243+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:44.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:44.243+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:44.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:44.243+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:44.542 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:44.243+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:44.542 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:44.243+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.720133+0000 front 2024-06-06T08:49:14.720003+0000 (oldest deadline 2024-06-06T08:49:40.619913+0000) 2024-06-06T08:49:44.542 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:44 smithi028 systemd[1]: Stopping Ceph osd.9 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:49:44.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:44 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:44.276+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:44.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:44 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:44.276+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:44.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:44 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:44.276+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:44.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:44 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:44.276+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:44.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:44 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:44.276+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:45.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:44 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:44.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:45.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:44 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:44.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:45.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:44 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:44.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:45.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:44 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:44.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:45.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:44 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:44.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:45.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:44 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:44.734+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:45.275 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:44.871+0000 7efc92e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:49:45.275 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:44.871+0000 7efc92e00700 -1 osd.9 95 *** Got signal Terminated *** 2024-06-06T08:49:45.276 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:44 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:44.871+0000 7efc92e00700 -1 osd.9 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:49:45.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:45 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:45.276+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:45.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:45 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:45.276+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:45.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:45 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:45.276+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:45.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:45 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:45.276+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:45.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:45 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:45.276+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.720133+0000 front 2024-06-06T08:49:14.720003+0000 (oldest deadline 2024-06-06T08:49:40.619913+0000) 2024-06-06T08:49:45.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:45 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:45.285+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:45.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:45 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:45.285+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:45.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:45 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:45.285+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:45.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:45 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:45.285+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:45.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:45 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:45.285+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:46.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:45 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:45.763+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:46.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:45 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:45.763+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:46.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:45 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:45.763+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:46.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:45 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:45.763+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:46.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:45 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:45.763+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:46.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:45 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:45.763+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:46.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:46 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:46.274+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:46.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:46 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:46.274+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:46.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:46 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:46.274+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:46.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:46 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:46.274+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:46.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:46 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:46.274+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.720133+0000 front 2024-06-06T08:49:14.720003+0000 (oldest deadline 2024-06-06T08:49:40.619913+0000) 2024-06-06T08:49:46.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:46 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:46.237+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:46.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:46 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:46.237+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:46.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:46 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:46.237+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:46.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:46 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:46.237+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:46.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:46 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:46.237+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:46.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:46 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:46.237+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:47.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:46 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:46.716+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:47.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:46 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:46.716+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:47.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:46 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:46.716+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:47.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:46 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:46.716+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:47.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:46 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:46.716+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:47.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:46 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:46.716+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:47.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:47 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:47.229+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:47.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:47 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:47.229+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:47.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:47 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:47.229+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:47.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:47 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:47.229+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:47.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:47 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:47.229+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.720133+0000 front 2024-06-06T08:49:14.720003+0000 (oldest deadline 2024-06-06T08:49:40.619913+0000) 2024-06-06T08:49:47.542 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:47 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:47.229+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:20.620887+0000 front 2024-06-06T08:49:20.620928+0000 (oldest deadline 2024-06-06T08:49:46.520979+0000) 2024-06-06T08:49:47.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:47 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:47.248+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:47.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:47 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:47.248+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:47.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:47 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:47.248+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:47.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:47 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:47.248+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:47.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:47 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:47.248+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:47.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:47 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:47.248+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:48.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:47 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:47.715+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:48.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:47 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:47.715+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:48.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:47 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:47.715+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:48.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:47 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:47.715+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:48.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:47 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:47.715+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:48.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:47 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:47.715+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:48.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:48 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:48.248+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:48.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:48 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:48.248+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:48.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:48 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:48.248+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:48.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:48 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:48.248+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:48.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:48 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:48.248+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.720133+0000 front 2024-06-06T08:49:14.720003+0000 (oldest deadline 2024-06-06T08:49:40.619913+0000) 2024-06-06T08:49:48.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:48 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:48.248+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:20.620887+0000 front 2024-06-06T08:49:20.620928+0000 (oldest deadline 2024-06-06T08:49:46.520979+0000) 2024-06-06T08:49:48.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:48 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:48.232+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:48.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:48 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:48.232+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:48.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:48 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:48.232+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:48.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:48 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:48.232+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:48.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:48 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:48.232+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:48.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:48 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:48.232+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:49.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:48 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:48.726+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:49.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:48 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:48.726+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:49.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:48 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:48.726+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:49.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:48 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:48.726+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:49.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:48 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:48.726+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:49.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:48 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:48.726+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:49.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:49 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:49.216+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:32.205622+0000 front 2024-06-06T08:48:32.205541+0000 (oldest deadline 2024-06-06T08:48:58.105604+0000) 2024-06-06T08:49:49.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:49 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:49.216+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:38.106875+0000 front 2024-06-06T08:48:38.106798+0000 (oldest deadline 2024-06-06T08:49:04.508413+0000) 2024-06-06T08:49:49.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:49 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:49.216+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:49.111914+0000 front 2024-06-06T08:48:49.111967+0000 (oldest deadline 2024-06-06T08:49:11.411805+0000) 2024-06-06T08:49:49.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:49 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:49.216+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:56.113959+0000 front 2024-06-06T08:48:56.114985+0000 (oldest deadline 2024-06-06T08:49:20.813946+0000) 2024-06-06T08:49:49.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:49 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:49.216+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.720133+0000 front 2024-06-06T08:49:14.720003+0000 (oldest deadline 2024-06-06T08:49:40.619913+0000) 2024-06-06T08:49:49.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:49 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9[66668]: 2024-06-06T08:49:49.216+0000 7efc8e600700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:20.620887+0000 front 2024-06-06T08:49:20.620928+0000 (oldest deadline 2024-06-06T08:49:46.520979+0000) 2024-06-06T08:49:49.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:49 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:49.185+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:49.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:49 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:49.185+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:49.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:49 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:49.185+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:49.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:49 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:49.185+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:49.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:49 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:49.185+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:49.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:49 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:49.185+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:50.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:49 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:49.771+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:50.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:49 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:49.771+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:50.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:49 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:49.771+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:50.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:49 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:49.771+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:50.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:49 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:49.771+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:50.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:49 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:49.771+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:50.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:49 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:49.771+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:23.714972+0000 front 2024-06-06T08:49:23.714814+0000 (oldest deadline 2024-06-06T08:49:49.014631+0000) 2024-06-06T08:49:50.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:50 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:50.224+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:50.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:50 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:50.224+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:50.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:50 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:50.224+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:50.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:50 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:50.224+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:50.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:50 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:50.224+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:50.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:50 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:50.224+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:50.669 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:50 smithi028 podman[98713]: 2024-06-06 08:49:50.38832313 +0000 UTC m=+5.669991516 container died 8dd3245d8de1a8ea81ea4a772bbc09f2433d35f7ff5f441ac784ef1ff8b88826 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-06-06T08:49:50.940 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:50 smithi028 podman[98713]: 2024-06-06 08:49:50.772612741 +0000 UTC m=+6.054281167 container cleanup 8dd3245d8de1a8ea81ea4a772bbc09f2433d35f7ff5f441ac784ef1ff8b88826 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:49:50.940 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:50 smithi028 bash[98713]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9 2024-06-06T08:49:51.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:50 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:50.800+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:51.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:50 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:50.800+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:51.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:50 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:50.800+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:51.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:50 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:50.800+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:51.065 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:50 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:50.800+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:51.065 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:50 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:50.800+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:51.065 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:50 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:50.800+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:23.714972+0000 front 2024-06-06T08:49:23.714814+0000 (oldest deadline 2024-06-06T08:49:49.014631+0000) 2024-06-06T08:49:51.290 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:50 smithi028 podman[98734]: 2024-06-06 08:49:50.94023543 +0000 UTC m=+0.537029558 container remove 8dd3245d8de1a8ea81ea4a772bbc09f2433d35f7ff5f441ac784ef1ff8b88826 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-06T08:49:51.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:51 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:51.244+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:51.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:51 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:51.244+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:51.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:51 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:51.244+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:51.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:51 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:51.244+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:51.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:51 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:51.244+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:51.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:51 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:51.244+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:52.076 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:51 smithi028 podman[98822]: 2024-06-06 08:49:51.710132725 +0000 UTC m=+0.036249564 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:49:52.077 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:51 smithi028 podman[98822]: 2024-06-06 08:49:51.82424943 +0000 UTC m=+0.150366283 container create c9dc282fc0e0a4cae2165b689d194d314b1855132d974d96f2ec50b06537d8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-06-06T08:49:52.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:51 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:51.838+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:52.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:51 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:51.838+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:52.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:51 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:51.838+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:52.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:51 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:51.838+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:52.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:51 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:51.838+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:52.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:51 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:51.838+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:52.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:51 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:51.838+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:23.714972+0000 front 2024-06-06T08:49:23.714814+0000 (oldest deadline 2024-06-06T08:49:49.014631+0000) 2024-06-06T08:49:52.540 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:52 smithi028 podman[98822]: 2024-06-06 08:49:52.077968615 +0000 UTC m=+0.404085532 container init c9dc282fc0e0a4cae2165b689d194d314b1855132d974d96f2ec50b06537d8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9-deactivate, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-06T08:49:52.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:52 smithi028 podman[98822]: 2024-06-06 08:49:52.089535659 +0000 UTC m=+0.415652508 container start c9dc282fc0e0a4cae2165b689d194d314b1855132d974d96f2ec50b06537d8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9-deactivate, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-06T08:49:52.541 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:52 smithi028 podman[98822]: 2024-06-06 08:49:52.168167529 +0000 UTC m=+0.494284382 container attach c9dc282fc0e0a4cae2165b689d194d314b1855132d974d96f2ec50b06537d8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-06-06T08:49:52.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:52 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:52.261+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:52.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:52 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:52.261+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:52.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:52 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:52.261+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:52.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:52 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:52.261+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:52.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:52 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:52.261+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:52.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:52 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:52.261+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:52.891 INFO:journalctl@ceph.osd.9.smithi028.stdout:Jun 06 08:49:52 smithi028 podman[98848]: 2024-06-06 08:49:52.615021787 +0000 UTC m=+0.037971686 container died c9dc282fc0e0a4cae2165b689d194d314b1855132d974d96f2ec50b06537d8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-06T08:49:53.294 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.9.service' 2024-06-06T08:49:53.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:52 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:52.861+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:53.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:52 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:52.861+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:53.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:52 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:52.861+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:53.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:52 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:52.861+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:53.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:52 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:52.861+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:53.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:52 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:52.861+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:53.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:52 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:52.861+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:23.714972+0000 front 2024-06-06T08:49:23.714814+0000 (oldest deadline 2024-06-06T08:49:49.014631+0000) 2024-06-06T08:49:53.387 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:49:53.387 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-06-06T08:49:53.387 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-06-06T08:49:53.387 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.10 2024-06-06T08:49:53.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:53 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:53.218+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:53.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:53 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:53.218+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:53.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:53 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:53.218+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:53.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:53 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:53.218+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:53.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:53 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:53.218+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:53.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:53 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:53.218+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:53.718 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:53 smithi037 systemd[1]: Stopping Ceph osd.10 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:49:53.718 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:53 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:53.719+0000 7fd034bd7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:49:54.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:53 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:53.719+0000 7fd034bd7700 -1 osd.10 95 *** Got signal Terminated *** 2024-06-06T08:49:54.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:53 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:53.719+0000 7fd034bd7700 -1 osd.10 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:49:54.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:53 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:53.823+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:54.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:53 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:53.823+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:54.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:53 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:53.823+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:54.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:53 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:53.823+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:54.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:53 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:53.823+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:54.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:53 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:53.823+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:54.064 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:53 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:53.823+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:23.714972+0000 front 2024-06-06T08:49:23.714814+0000 (oldest deadline 2024-06-06T08:49:49.014631+0000) 2024-06-06T08:49:54.450 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:54 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:54.184+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:54.450 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:54 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:54.184+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:54.450 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:54 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:54.184+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:54.451 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:54 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:54.184+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:54.451 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:54 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:54.184+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:54.451 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:54 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:54.184+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:55.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:54 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:54.869+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:55.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:54 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:54.869+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:55.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:54 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:54.869+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:55.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:54 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:54.869+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:55.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:54 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:54.869+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:55.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:54 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:54.869+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:55.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:54 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:54.869+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:23.714972+0000 front 2024-06-06T08:49:23.714814+0000 (oldest deadline 2024-06-06T08:49:49.014631+0000) 2024-06-06T08:49:55.349 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:55 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:55.153+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:55.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:55 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:55.153+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:55.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:55 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:55.153+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:55.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:55 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:55.153+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:55.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:55 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:55.153+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:55.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:55 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:55.153+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:55.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:55 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:55.153+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:49:56.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:55 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:55.841+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:56.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:55 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:55.841+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:56.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:55 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:55.841+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:56.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:55 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:55.841+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:56.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:55 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:55.841+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:56.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:55 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:55.841+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:56.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:55 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:55.841+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:23.714972+0000 front 2024-06-06T08:49:23.714814+0000 (oldest deadline 2024-06-06T08:49:49.014631+0000) 2024-06-06T08:49:56.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:56 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:56.113+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:56.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:56 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:56.113+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:56.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:56 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:56.113+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:56.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:56 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:56.113+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:56.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:56 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:56.113+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:56.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:56 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:56.113+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:56.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:56 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:56.113+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:49:57.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:56 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:56.860+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:57.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:56 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:56.860+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:57.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:56 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:56.860+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:57.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:56 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:56.860+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:57.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:56 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:56.860+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:57.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:56 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:56.860+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:57.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:56 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:56.860+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:23.714972+0000 front 2024-06-06T08:49:23.714814+0000 (oldest deadline 2024-06-06T08:49:49.014631+0000) 2024-06-06T08:49:57.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:57 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:57.127+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:57.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:57 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:57.127+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:57.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:57 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:57.127+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:57.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:57 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:57.127+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:57.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:57 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:57.127+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:57.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:57 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:57.127+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:57.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:57 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:57.127+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:49:58.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:57 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:57.852+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:28.103732+0000 front 2024-06-06T08:48:28.103480+0000 (oldest deadline 2024-06-06T08:48:53.403340+0000) 2024-06-06T08:49:58.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:57 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:57.852+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:41.505733+0000 front 2024-06-06T08:48:41.505766+0000 (oldest deadline 2024-06-06T08:49:06.205956+0000) 2024-06-06T08:49:58.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:57 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:57.852+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:47.307189+0000 front 2024-06-06T08:48:47.307134+0000 (oldest deadline 2024-06-06T08:49:10.807124+0000) 2024-06-06T08:49:58.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:57 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:57.852+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6814 osd.3 since back 2024-06-06T08:48:53.108270+0000 front 2024-06-06T08:48:53.108406+0000 (oldest deadline 2024-06-06T08:49:19.008061+0000) 2024-06-06T08:49:58.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:57 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:57.852+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:06.911322+0000 front 2024-06-06T08:49:06.911352+0000 (oldest deadline 2024-06-06T08:49:29.811416+0000) 2024-06-06T08:49:58.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:57 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:57.852+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.512728+0000 front 2024-06-06T08:49:14.512626+0000 (oldest deadline 2024-06-06T08:49:38.513151+0000) 2024-06-06T08:49:58.314 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:57 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10[61618]: 2024-06-06T08:49:57.852+0000 7fd0311cb700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:23.714972+0000 front 2024-06-06T08:49:23.714814+0000 (oldest deadline 2024-06-06T08:49:49.014631+0000) 2024-06-06T08:49:58.349 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:58 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:58.085+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:58.349 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:58 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:58.085+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:58.349 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:58 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:58.085+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:58.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:58 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:58.085+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:58.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:58 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:58.085+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:58.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:58 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:58.085+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:58.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:58 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:58.085+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:49:59.313 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:59 smithi037 podman[71489]: 2024-06-06 08:49:59.052432772 +0000 UTC m=+5.459242194 container died 6e7aefc5b3c5c1be57719497391db2285a8fb246c72b1579c000ae51692be0da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:49:59.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:59 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:59.086+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:49:59.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:59 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:59.086+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:49:59.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:59 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:59.086+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:49:59.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:59 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:59.086+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:49:59.350 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:59 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:59.086+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:49:59.351 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:59 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:59.086+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:49:59.351 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:49:59 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:49:59.086+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:49:59.668 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:59 smithi037 podman[71489]: 2024-06-06 08:49:59.477653376 +0000 UTC m=+5.884462820 container cleanup 6e7aefc5b3c5c1be57719497391db2285a8fb246c72b1579c000ae51692be0da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-06T08:49:59.668 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:59 smithi037 bash[71489]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10 2024-06-06T08:50:00.063 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:49:59 smithi037 podman[71505]: 2024-06-06 08:49:59.6702827 +0000 UTC m=+0.617448814 container remove 6e7aefc5b3c5c1be57719497391db2285a8fb246c72b1579c000ae51692be0da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc) 2024-06-06T08:50:00.404 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:50:00 smithi037 podman[71594]: 2024-06-06 08:50:00.017177233 +0000 UTC m=+0.017529256 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:50:00.405 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:50:00 smithi037 podman[71594]: 2024-06-06 08:50:00.121013039 +0000 UTC m=+0.121365042 container create 36a49258af10a406376779d53c5f3b12572dc1f223441cc1276a2f63a18be25c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10-deactivate, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, ceph=True) 2024-06-06T08:50:00.405 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:50:00 smithi037 podman[71594]: 2024-06-06 08:50:00.323475421 +0000 UTC m=+0.323827432 container init 36a49258af10a406376779d53c5f3b12572dc1f223441cc1276a2f63a18be25c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-06T08:50:00.405 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:50:00 smithi037 podman[71594]: 2024-06-06 08:50:00.326569653 +0000 UTC m=+0.326921665 container start 36a49258af10a406376779d53c5f3b12572dc1f223441cc1276a2f63a18be25c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-06-06T08:50:00.405 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:50:00 smithi037 podman[71594]: 2024-06-06 08:50:00.406760539 +0000 UTC m=+0.407112551 container attach 36a49258af10a406376779d53c5f3b12572dc1f223441cc1276a2f63a18be25c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2) 2024-06-06T08:50:00.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:00.104+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:50:00.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:00.104+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:50:00.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:00.104+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:50:00.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:00.104+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:50:00.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:00.104+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:50:00.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:00.104+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:50:00.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:00 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:00.104+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:50:00.813 INFO:journalctl@ceph.osd.10.smithi037.stdout:Jun 06 08:50:00 smithi037 podman[71594]: 2024-06-06 08:50:00.630113907 +0000 UTC m=+0.630465929 container died 36a49258af10a406376779d53c5f3b12572dc1f223441cc1276a2f63a18be25c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-06-06T08:50:01.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.10.service' 2024-06-06T08:50:01.245 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:01.245 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-06-06T08:50:01.246 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-06-06T08:50:01.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.11 2024-06-06T08:50:01.551 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:01.149+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:50:01.551 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:01.149+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:50:01.551 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:01.149+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:50:01.551 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:01.149+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:50:01.551 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:01.149+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:50:01.551 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:01.149+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:50:01.551 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:01.149+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:50:01.552 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:01 smithi059 systemd[1]: Stopping Ceph osd.11 for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:01.552 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:01.552+0000 7f249043f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:01.552 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:01.552+0000 7f249043f700 -1 osd.11 95 *** Got signal Terminated *** 2024-06-06T08:50:01.552 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:01 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:01.552+0000 7f249043f700 -1 osd.11 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T08:50:02.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:02 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:02.144+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:50:02.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:02 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:02.144+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:50:02.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:02 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:02.144+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:50:02.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:02 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:02.144+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:50:02.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:02 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:02.144+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:50:02.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:02 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:02.144+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:50:02.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:02 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:02.144+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:50:03.501 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:03.183+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:50:03.501 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:03.183+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:50:03.502 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:03.183+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:50:03.502 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:03.183+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:50:03.502 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:03.183+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:50:03.502 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:03.183+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:50:03.502 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:03 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:03.183+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:50:04.517 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:04.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:50:04.518 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:04.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:50:04.518 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:04.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:50:04.518 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:04.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:50:04.518 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:04.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:50:04.518 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:04.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:50:04.518 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:04.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:50:04.519 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:04 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:04.173+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6820 osd.8 since back 2024-06-06T08:49:40.662425+0000 front 2024-06-06T08:49:40.662459+0000 (oldest deadline 2024-06-06T08:50:03.562416+0000) 2024-06-06T08:50:05.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:05.154+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:50:05.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:05.154+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:50:05.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:05.154+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:50:05.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:05.154+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:50:05.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:05.154+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:50:05.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:05.154+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:50:05.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:05.154+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:50:05.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:05 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:05.154+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6820 osd.8 since back 2024-06-06T08:49:40.662425+0000 front 2024-06-06T08:49:40.662459+0000 (oldest deadline 2024-06-06T08:50:03.562416+0000) 2024-06-06T08:50:06.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:06.117+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6806 osd.0 since back 2024-06-06T08:48:29.051575+0000 front 2024-06-06T08:48:29.051642+0000 (oldest deadline 2024-06-06T08:48:54.951290+0000) 2024-06-06T08:50:06.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:06.117+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6804 osd.1 since back 2024-06-06T08:48:37.152875+0000 front 2024-06-06T08:48:37.152861+0000 (oldest deadline 2024-06-06T08:49:03.052924+0000) 2024-06-06T08:50:06.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:06.117+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6804 osd.2 since back 2024-06-06T08:48:50.054626+0000 front 2024-06-06T08:48:50.054755+0000 (oldest deadline 2024-06-06T08:49:11.154689+0000) 2024-06-06T08:50:06.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:06.117+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6812 osd.4 since back 2024-06-06T08:49:03.857970+0000 front 2024-06-06T08:49:03.858139+0000 (oldest deadline 2024-06-06T08:49:29.757856+0000) 2024-06-06T08:50:06.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:06.117+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6812 osd.5 since back 2024-06-06T08:49:14.259642+0000 front 2024-06-06T08:49:14.259792+0000 (oldest deadline 2024-06-06T08:49:39.559777+0000) 2024-06-06T08:50:06.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:06.117+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.28:6822 osd.6 since back 2024-06-06T08:49:19.560512+0000 front 2024-06-06T08:49:19.560558+0000 (oldest deadline 2024-06-06T08:49:45.460269+0000) 2024-06-06T08:50:06.600 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:06.117+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6820 osd.7 since back 2024-06-06T08:49:30.761395+0000 front 2024-06-06T08:49:30.761358+0000 (oldest deadline 2024-06-06T08:49:54.861289+0000) 2024-06-06T08:50:06.601 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:06 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11[62148]: 2024-06-06T08:50:06.117+0000 7f248ca33700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.59:6820 osd.8 since back 2024-06-06T08:49:40.662425+0000 front 2024-06-06T08:49:40.662459+0000 (oldest deadline 2024-06-06T08:50:03.562416+0000) 2024-06-06T08:50:07.349 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:06 smithi059 podman[71756]: 2024-06-06 08:50:06.972427669 +0000 UTC m=+5.524360157 container died 4a9d09db3122934bb1a3d651817cd8fa5c282df6cf04f6ecae68faf5555352cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-06-06T08:50:07.700 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:07 smithi059 podman[71756]: 2024-06-06 08:50:07.427018907 +0000 UTC m=+5.978951396 container cleanup 4a9d09db3122934bb1a3d651817cd8fa5c282df6cf04f6ecae68faf5555352cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc) 2024-06-06T08:50:07.701 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:07 smithi059 bash[71756]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11 2024-06-06T08:50:08.051 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:07 smithi059 podman[71785]: 2024-06-06 08:50:07.703277664 +0000 UTC m=+0.725441495 container remove 4a9d09db3122934bb1a3d651817cd8fa5c282df6cf04f6ecae68faf5555352cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-06-06T08:50:08.337 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:08 smithi059 podman[71873]: 2024-06-06 08:50:08.054076732 +0000 UTC m=+0.105163264 container create deedda4992f0cb79363873fca5adcecd12569022b0354c362a082108a582d6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-06-06T08:50:08.337 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:08 smithi059 podman[71873]: 2024-06-06 08:50:07.966275494 +0000 UTC m=+0.017362037 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-06T08:50:08.337 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:08 smithi059 podman[71873]: 2024-06-06 08:50:08.281357082 +0000 UTC m=+0.332443610 container init deedda4992f0cb79363873fca5adcecd12569022b0354c362a082108a582d6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-06-06T08:50:08.337 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:08 smithi059 podman[71873]: 2024-06-06 08:50:08.285083728 +0000 UTC m=+0.336170259 container start deedda4992f0cb79363873fca5adcecd12569022b0354c362a082108a582d6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11-deactivate, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528) 2024-06-06T08:50:08.337 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:08 smithi059 podman[71873]: 2024-06-06 08:50:08.339420753 +0000 UTC m=+0.390507291 container attach deedda4992f0cb79363873fca5adcecd12569022b0354c362a082108a582d6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:50:08.599 INFO:journalctl@ceph.osd.11.smithi059.stdout:Jun 06 08:50:08 smithi059 podman[71873]: 2024-06-06 08:50:08.583656846 +0000 UTC m=+0.634743376 container died deedda4992f0cb79363873fca5adcecd12569022b0354c362a082108a582d6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:50:09.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@osd.11.service' 2024-06-06T08:50:09.189 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:09.189 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-06-06T08:50:09.189 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-06-06T08:50:09.189 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.a 2024-06-06T08:50:09.540 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:50:09 smithi028 systemd[1]: Stopping Ceph mds.a for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:10.290 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:50:09 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a[73729]: 2024-06-06T08:50:09.849+0000 7f6668e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:10.291 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:50:09 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a[73729]: 2024-06-06T08:50:09.849+0000 7f6668e00700 -1 mds.a *** got signal Terminated *** 2024-06-06T08:50:12.976 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:50:12 smithi028 podman[98941]: 2024-06-06 08:50:12.719336433 +0000 UTC m=+3.042968146 container died cca8901e7351785a24da8d9772bfdcb3e07573b697382cd5f6ce017aa59265f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux ) 2024-06-06T08:50:13.290 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:50:13 smithi028 podman[98941]: 2024-06-06 08:50:13.09834524 +0000 UTC m=+3.421976977 container cleanup cca8901e7351785a24da8d9772bfdcb3e07573b697382cd5f6ce017aa59265f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-06T08:50:13.290 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:50:13 smithi028 bash[98941]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a 2024-06-06T08:50:13.790 INFO:journalctl@ceph.mds.a.smithi028.stdout:Jun 06 08:50:13 smithi028 podman[98956]: 2024-06-06 08:50:13.341389201 +0000 UTC m=+0.607609671 container remove cca8901e7351785a24da8d9772bfdcb3e07573b697382cd5f6ce017aa59265f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0) 2024-06-06T08:50:13.912 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.a.service' 2024-06-06T08:50:14.030 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:14.030 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-06-06T08:50:14.030 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-06-06T08:50:14.031 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.d 2024-06-06T08:50:14.291 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:50:14 smithi028 systemd[1]: Stopping Ceph mds.d for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:15.040 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:50:14 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-d[72556]: 2024-06-06T08:50:14.582+0000 7fa989a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:15.040 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:50:14 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-d[72556]: 2024-06-06T08:50:14.582+0000 7fa989a00700 -1 mds.d *** got signal Terminated *** 2024-06-06T08:50:18.688 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:50:18 smithi028 podman[99062]: 2024-06-06 08:50:18.415974197 +0000 UTC m=+3.960875224 container died c29d2ec501a35b4f745cbdb8fe474e2c2c820c6f82dc72f46c8729cbd8b4878f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-06T08:50:19.026 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:50:18 smithi028 podman[99062]: 2024-06-06 08:50:18.793336633 +0000 UTC m=+4.338237669 container cleanup c29d2ec501a35b4f745cbdb8fe474e2c2c820c6f82dc72f46c8729cbd8b4878f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc) 2024-06-06T08:50:19.026 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:50:18 smithi028 bash[99062]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-d 2024-06-06T08:50:19.290 INFO:journalctl@ceph.mds.d.smithi028.stdout:Jun 06 08:50:19 smithi028 podman[99075]: 2024-06-06 08:50:19.027789738 +0000 UTC m=+0.596921982 container remove c29d2ec501a35b4f745cbdb8fe474e2c2c820c6f82dc72f46c8729cbd8b4878f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=) 2024-06-06T08:50:19.498 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.d.service' 2024-06-06T08:50:19.604 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:19.605 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-06-06T08:50:19.605 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-06-06T08:50:19.605 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.g 2024-06-06T08:50:20.040 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:50:19 smithi028 systemd[1]: Stopping Ceph mds.g for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:20.540 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:50:20 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g[73335]: 2024-06-06T08:50:20.236+0000 7f4292800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:20.540 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:50:20 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g[73335]: 2024-06-06T08:50:20.236+0000 7f4292800700 -1 mds.g *** got signal Terminated *** 2024-06-06T08:50:24.517 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:50:24 smithi028 podman[99181]: 2024-06-06 08:50:24.249959189 +0000 UTC m=+4.136453513 container died ee17ab967d385588ba5c8601a54a014c1d72dc14c0ab98b42ec223fdc18cae38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-06T08:50:24.790 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:50:24 smithi028 podman[99181]: 2024-06-06 08:50:24.638669595 +0000 UTC m=+4.525163926 container cleanup ee17ab967d385588ba5c8601a54a014c1d72dc14c0ab98b42ec223fdc18cae38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:50:24.791 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:50:24 smithi028 bash[99181]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g 2024-06-06T08:50:25.290 INFO:journalctl@ceph.mds.g.smithi028.stdout:Jun 06 08:50:24 smithi028 podman[99195]: 2024-06-06 08:50:24.915112753 +0000 UTC m=+0.641554512 container remove ee17ab967d385588ba5c8601a54a014c1d72dc14c0ab98b42ec223fdc18cae38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-06T08:50:25.488 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.g.service' 2024-06-06T08:50:25.596 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:25.597 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-06-06T08:50:25.597 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-06-06T08:50:25.597 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.j 2024-06-06T08:50:26.040 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:50:25 smithi028 systemd[1]: Stopping Ceph mds.j for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:26.540 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:50:26 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-j[72142]: 2024-06-06T08:50:26.165+0000 7efe07800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:26.540 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:50:26 smithi028 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-j[72142]: 2024-06-06T08:50:26.165+0000 7efe07800700 -1 mds.j *** got signal Terminated *** 2024-06-06T08:50:30.290 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:50:29 smithi028 podman[99300]: 2024-06-06 08:50:29.941420801 +0000 UTC m=+3.892445973 container died de48cba5fc90a2032dd4e3b3dabdd087424e590ca1cb90f71058fbaa6a0c28d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-06T08:50:30.684 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:50:30 smithi028 podman[99300]: 2024-06-06 08:50:30.467524661 +0000 UTC m=+4.418549826 container cleanup de48cba5fc90a2032dd4e3b3dabdd087424e590ca1cb90f71058fbaa6a0c28d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-j, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240528) 2024-06-06T08:50:30.684 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:50:30 smithi028 bash[99300]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-j 2024-06-06T08:50:31.040 INFO:journalctl@ceph.mds.j.smithi028.stdout:Jun 06 08:50:30 smithi028 podman[99324]: 2024-06-06 08:50:30.684942821 +0000 UTC m=+0.723425323 container remove de48cba5fc90a2032dd4e3b3dabdd087424e590ca1cb90f71058fbaa6a0c28d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, ceph=True) 2024-06-06T08:50:31.214 DEBUG:teuthology.orchestra.run.smithi028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.j.service' 2024-06-06T08:50:31.329 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:31.329 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-06-06T08:50:31.330 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-06-06T08:50:31.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.b 2024-06-06T08:50:31.642 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:50:31 smithi037 systemd[1]: Stopping Ceph mds.b for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:31.911 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:50:31 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b[67261]: 2024-06-06T08:50:31.643+0000 7f470fc14700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:31.911 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:50:31 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b[67261]: 2024-06-06T08:50:31.643+0000 7f470fc14700 -1 mds.b *** got signal Terminated *** 2024-06-06T08:50:32.917 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:50:32 smithi037 podman[71699]: 2024-06-06 08:50:32.650496021 +0000 UTC m=+1.113307155 container died 9b5f9b2bc609a2897096c94b377ddd3b5a47df8a3ac622afa7938bd0c9656725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-06T08:50:33.301 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:50:33 smithi037 podman[71699]: 2024-06-06 08:50:33.018416027 +0000 UTC m=+1.481227160 container cleanup 9b5f9b2bc609a2897096c94b377ddd3b5a47df8a3ac622afa7938bd0c9656725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5) 2024-06-06T08:50:33.301 INFO:journalctl@ceph.mds.b.smithi037.stdout:Jun 06 08:50:33 smithi037 bash[71699]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-b 2024-06-06T08:50:33.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.b.service' 2024-06-06T08:50:33.479 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:33.479 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-06-06T08:50:33.479 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-06-06T08:50:33.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.e 2024-06-06T08:50:34.063 INFO:journalctl@ceph.mds.e.smithi037.stdout:Jun 06 08:50:33 smithi037 systemd[1]: Stopping Ceph mds.e for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:34.063 INFO:journalctl@ceph.mds.e.smithi037.stdout:Jun 06 08:50:33 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-e[66647]: 2024-06-06T08:50:33.813+0000 7f2d85b43700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:34.063 INFO:journalctl@ceph.mds.e.smithi037.stdout:Jun 06 08:50:33 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-e[66647]: 2024-06-06T08:50:33.813+0000 7f2d85b43700 -1 mds.e *** got signal Terminated *** 2024-06-06T08:50:36.946 INFO:journalctl@ceph.mds.e.smithi037.stdout:Jun 06 08:50:36 smithi037 podman[71833]: 2024-06-06 08:50:36.657149413 +0000 UTC m=+2.947684301 container died f451a0b45195c5b99c3ec78b8839cc2defb2b548b7377b9ea8b84bcb1567e2d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-e, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-06-06T08:50:37.279 INFO:journalctl@ceph.mds.e.smithi037.stdout:Jun 06 08:50:37 smithi037 podman[71833]: 2024-06-06 08:50:37.022219047 +0000 UTC m=+3.312753943 container cleanup f451a0b45195c5b99c3ec78b8839cc2defb2b548b7377b9ea8b84bcb1567e2d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-06T08:50:37.279 INFO:journalctl@ceph.mds.e.smithi037.stdout:Jun 06 08:50:37 smithi037 bash[71833]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-e 2024-06-06T08:50:37.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.e.service' 2024-06-06T08:50:37.447 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:37.447 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-06-06T08:50:37.447 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-06-06T08:50:37.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.h 2024-06-06T08:50:37.563 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:50:37 smithi037 systemd[1]: Stopping Ceph mds.h for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:38.063 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:50:37 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h[66949]: 2024-06-06T08:50:37.766+0000 7fabd29d8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:38.063 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:50:37 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h[66949]: 2024-06-06T08:50:37.766+0000 7fabd29d8700 -1 mds.h *** got signal Terminated *** 2024-06-06T08:50:40.924 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:50:40 smithi037 podman[71953]: 2024-06-06 08:50:40.651308351 +0000 UTC m=+2.979200339 container died bfa090feaa21e54dde2f74e69e97031bfaf354ba94cb81e41af50c8cf4da22cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528) 2024-06-06T08:50:41.275 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:50:41 smithi037 podman[71953]: 2024-06-06 08:50:41.009002322 +0000 UTC m=+3.336894309 container cleanup bfa090feaa21e54dde2f74e69e97031bfaf354ba94cb81e41af50c8cf4da22cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-06T08:50:41.275 INFO:journalctl@ceph.mds.h.smithi037.stdout:Jun 06 08:50:41 smithi037 bash[71953]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-h 2024-06-06T08:50:41.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.h.service' 2024-06-06T08:50:41.475 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:41.475 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-06-06T08:50:41.476 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-06-06T08:50:41.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.k 2024-06-06T08:50:41.794 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:50:41 smithi037 systemd[1]: Stopping Ceph mds.k for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:42.063 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:50:41 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k[66324]: 2024-06-06T08:50:41.795+0000 7f28f1ec0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:42.063 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:50:41 smithi037 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k[66324]: 2024-06-06T08:50:41.795+0000 7f28f1ec0700 -1 mds.k *** got signal Terminated *** 2024-06-06T08:50:44.945 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:50:44 smithi037 podman[72072]: 2024-06-06 08:50:44.654646302 +0000 UTC m=+2.956820757 container died 22164ee410a4f81fc8861f6eeb8027d2e74ab5ee3e1c8c64d9f9b6b889ac8470 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-06-06T08:50:45.269 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:50:45 smithi037 podman[72072]: 2024-06-06 08:50:45.037553211 +0000 UTC m=+3.339727663 container cleanup 22164ee410a4f81fc8861f6eeb8027d2e74ab5ee3e1c8c64d9f9b6b889ac8470 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-06-06T08:50:45.270 INFO:journalctl@ceph.mds.k.smithi037.stdout:Jun 06 08:50:45 smithi037 bash[72072]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-k 2024-06-06T08:50:45.401 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.k.service' 2024-06-06T08:50:45.432 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:45.432 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-06-06T08:50:45.433 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-06-06T08:50:45.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.c 2024-06-06T08:50:45.740 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:50:45 smithi059 systemd[1]: Stopping Ceph mds.c for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:46.015 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:50:45 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c[67114]: 2024-06-06T08:50:45.743+0000 7ff2298eb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:46.015 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:50:45 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c[67114]: 2024-06-06T08:50:45.743+0000 7ff2298eb700 -1 mds.c *** got signal Terminated *** 2024-06-06T08:50:48.909 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:50:48 smithi059 podman[71977]: 2024-06-06 08:50:48.649254258 +0000 UTC m=+3.009413158 container died e6f5b1445916e349bd83348f9d5f270bf33ca612603eb6efae07156fedac772f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-06T08:50:49.165 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:50:48 smithi059 podman[71977]: 2024-06-06 08:50:48.992413104 +0000 UTC m=+3.352572023 container cleanup e6f5b1445916e349bd83348f9d5f270bf33ca612603eb6efae07156fedac772f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-06T08:50:49.166 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:50:48 smithi059 bash[71977]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c 2024-06-06T08:50:49.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.c.service' 2024-06-06T08:50:49.428 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:50:49 smithi059 podman[72002]: 2024-06-06 08:50:49.168230669 +0000 UTC m=+0.515954033 container remove e6f5b1445916e349bd83348f9d5f270bf33ca612603eb6efae07156fedac772f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=) 2024-06-06T08:50:49.428 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:50:49 smithi059 systemd[1]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.c.service: Deactivated successfully. 2024-06-06T08:50:49.428 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:50:49 smithi059 systemd[1]: Stopped Ceph mds.c for e34a6934-23de-11ef-bc9b-c7b262605968. 2024-06-06T08:50:49.428 INFO:journalctl@ceph.mds.c.smithi059.stdout:Jun 06 08:50:49 smithi059 systemd[1]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.c.service: Consumed 3.717s CPU time. 2024-06-06T08:50:49.442 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:49.442 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-06-06T08:50:49.442 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-06-06T08:50:49.443 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.f 2024-06-06T08:50:49.777 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:50:49 smithi059 systemd[1]: Stopping Ceph mds.f for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:50.099 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:50:49 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f[66810]: 2024-06-06T08:50:49.778+0000 7f2536bc1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:50.099 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:50:49 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f[66810]: 2024-06-06T08:50:49.778+0000 7f2536bc1700 -1 mds.f *** got signal Terminated *** 2024-06-06T08:50:52.927 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:50:52 smithi059 podman[72109]: 2024-06-06 08:50:52.653609667 +0000 UTC m=+2.973886243 container died 2a4b5056d1830f510971b207a84e8f4a475f8d3f6e2af74f555689e10a451051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-06T08:50:53.186 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:50:53 smithi059 podman[72109]: 2024-06-06 08:50:53.004015501 +0000 UTC m=+3.324292066 container cleanup 2a4b5056d1830f510971b207a84e8f4a475f8d3f6e2af74f555689e10a451051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T08:50:53.186 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:50:53 smithi059 bash[72109]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f 2024-06-06T08:50:53.442 INFO:journalctl@ceph.mds.f.smithi059.stdout:Jun 06 08:50:53 smithi059 podman[72123]: 2024-06-06 08:50:53.188406315 +0000 UTC m=+0.523765354 container remove 2a4b5056d1830f510971b207a84e8f4a475f8d3f6e2af74f555689e10a451051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-06-06T08:50:53.445 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.f.service' 2024-06-06T08:50:53.479 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:53.479 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-06-06T08:50:53.479 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-06-06T08:50:53.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.i 2024-06-06T08:50:53.831 INFO:journalctl@ceph.mds.i.smithi059.stdout:Jun 06 08:50:53 smithi059 systemd[1]: Stopping Ceph mds.i for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:54.099 INFO:journalctl@ceph.mds.i.smithi059.stdout:Jun 06 08:50:53 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-i[67429]: 2024-06-06T08:50:53.832+0000 7fa5e892c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:54.099 INFO:journalctl@ceph.mds.i.smithi059.stdout:Jun 06 08:50:53 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-i[67429]: 2024-06-06T08:50:53.832+0000 7fa5e892c700 -1 mds.i *** got signal Terminated *** 2024-06-06T08:50:56.849 INFO:journalctl@ceph.mds.i.smithi059.stdout:Jun 06 08:50:56 smithi059 podman[72228]: 2024-06-06 08:50:56.657484701 +0000 UTC m=+2.946179743 container died 9b4c36b19d7bc0ccc7ff6703c84ad48b289a87f4df1765ce3e050cf64241692d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-i, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-06-06T08:50:57.173 INFO:journalctl@ceph.mds.i.smithi059.stdout:Jun 06 08:50:56 smithi059 podman[72228]: 2024-06-06 08:50:56.999195154 +0000 UTC m=+3.287890186 container cleanup 9b4c36b19d7bc0ccc7ff6703c84ad48b289a87f4df1765ce3e050cf64241692d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-06T08:50:57.173 INFO:journalctl@ceph.mds.i.smithi059.stdout:Jun 06 08:50:56 smithi059 bash[72228]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-i 2024-06-06T08:50:57.435 INFO:journalctl@ceph.mds.i.smithi059.stdout:Jun 06 08:50:57 smithi059 podman[72242]: 2024-06-06 08:50:57.175486894 +0000 UTC m=+0.515746326 container remove 9b4c36b19d7bc0ccc7ff6703c84ad48b289a87f4df1765ce3e050cf64241692d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-06T08:50:57.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.i.service' 2024-06-06T08:50:57.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:50:57.472 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-06-06T08:50:57.472 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-06-06T08:50:57.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.l 2024-06-06T08:50:57.801 INFO:journalctl@ceph.mds.l.smithi059.stdout:Jun 06 08:50:57 smithi059 systemd[1]: Stopping Ceph mds.l for e34a6934-23de-11ef-bc9b-c7b262605968... 2024-06-06T08:50:58.099 INFO:journalctl@ceph.mds.l.smithi059.stdout:Jun 06 08:50:57 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-l[66509]: 2024-06-06T08:50:57.802+0000 7fc28061f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T08:50:58.099 INFO:journalctl@ceph.mds.l.smithi059.stdout:Jun 06 08:50:57 smithi059 ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-l[66509]: 2024-06-06T08:50:57.802+0000 7fc28061f700 -1 mds.l *** got signal Terminated *** 2024-06-06T08:51:00.985 INFO:journalctl@ceph.mds.l.smithi059.stdout:Jun 06 08:51:00 smithi059 podman[72348]: 2024-06-06 08:51:00.661497612 +0000 UTC m=+2.962208394 container died 21f07610004f3fcf8ee93b5e792611fe3dde42939be4cd7969f9a3cba5410243 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-l, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, ceph=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-06-06T08:51:01.276 INFO:journalctl@ceph.mds.l.smithi059.stdout:Jun 06 08:51:01 smithi059 podman[72348]: 2024-06-06 08:51:01.053067689 +0000 UTC m=+3.353778470 container cleanup 21f07610004f3fcf8ee93b5e792611fe3dde42939be4cd7969f9a3cba5410243 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-06T08:51:01.277 INFO:journalctl@ceph.mds.l.smithi059.stdout:Jun 06 08:51:01 smithi059 bash[72348]: ceph-e34a6934-23de-11ef-bc9b-c7b262605968-mds-l 2024-06-06T08:51:01.418 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e34a6934-23de-11ef-bc9b-c7b262605968@mds.l.service' 2024-06-06T08:51:01.449 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T08:51:01.450 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-06-06T08:51:01.450 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e34a6934-23de-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-06T08:51:01.776 INFO:teuthology.orchestra.run.smithi028.stdout:Deleting cluster with fsid: e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:51:06.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e34a6934-23de-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-06T08:51:07.172 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:51:09.719 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e34a6934-23de-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-06T08:51:09.917 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:51:12.318 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T08:51:12.422 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T08:51:12.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T08:51:12.480 INFO:tasks.cephadm:Archiving crash dumps... 2024-06-06T08:51:12.482 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250/remote/smithi028/crash 2024-06-06T08:51:12.484 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/crash -- . 2024-06-06T08:51:12.583 INFO:teuthology.orchestra.run.smithi028.stderr:tar: /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-06T08:51:12.584 INFO:teuthology.orchestra.run.smithi028.stderr:tar: Error is not recoverable: exiting now 2024-06-06T08:51:12.588 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250/remote/smithi037/crash 2024-06-06T08:51:12.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/crash -- . 2024-06-06T08:51:12.634 INFO:teuthology.orchestra.run.smithi037.stderr:tar: /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-06T08:51:12.634 INFO:teuthology.orchestra.run.smithi037.stderr:tar: Error is not recoverable: exiting now 2024-06-06T08:51:12.636 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250/remote/smithi059/crash 2024-06-06T08:51:12.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/crash -- . 2024-06-06T08:51:12.706 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /var/lib/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-06T08:51:12.706 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now 2024-06-06T08:51:12.707 INFO:tasks.cephadm:Checking cluster log for badness... 2024-06-06T08:51:12.708 DEBUG:teuthology.orchestra.run.smithi028:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-06-06T08:51:12.817 INFO:teuthology.orchestra.run.smithi028.stdout:2024-06-06T08:40:00.000265+0000 mon.a (mon.0) 1001 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-06-06T08:51:12.819 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-06-06T08:51:12.819 INFO:tasks.cephadm:Compressing logs... 2024-06-06T08:51:12.819 DEBUG:teuthology.orchestra.run.smithi028:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-06T08:51:12.823 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-06T08:51:12.826 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-06T08:51:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-06T08:51:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:: No such file or directory 2024-06-06T08:51:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.log 2024-06-06T08:51:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.2.log 2024-06-06T08:51:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.f.log 2024-06-06T08:51:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.log: /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-06T08:51:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.5.log 2024-06-06T08:51:12.855 INFO:teuthology.orchestra.run.smithi059.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-06T08:51:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.c.log 2024-06-06T08:51:12.856 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mon.c.log 2024-06-06T08:51:12.856 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.5.log: /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mgr.z.log 2024-06-06T08:51:12.856 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.i.log 2024-06-06T08:51:12.856 INFO:teuthology.orchestra.run.smithi059.stderr: 86.7% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-06T08:51:12.856 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mgr.z.log: 90.4% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-06T08:51:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-06T08:51:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:: No such file or directory 2024-06-06T08:51:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.log 2024-06-06T08:51:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-06T08:51:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.7.log 2024-06-06T08:51:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.log: /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.b.log 2024-06-06T08:51:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.4.log 2024-06-06T08:51:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.7.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-06T08:51:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.1.log 2024-06-06T08:51:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mgr.y.log 2024-06-06T08:51:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.h.log 2024-06-06T08:51:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mgr.y.log: 86.7% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-06T08:51:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.10.log 2024-06-06T08:51:12.864 INFO:teuthology.orchestra.run.smithi037.stderr: 90.3% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-06T08:51:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-06T08:51:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.e.log 2024-06-06T08:51:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.cephadm.log: 82.6% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-06T08:51:12.864 INFO:teuthology.orchestra.run.smithi037.stderr: 92.5% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mgr.y.log.gz 2024-06-06T08:51:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-06T08:51:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mon.b.log 2024-06-06T08:51:12.867 INFO:teuthology.orchestra.run.smithi059.stderr: 92.7% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mgr.z.log.gz 2024-06-06T08:51:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-06T08:51:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.11.log 2024-06-06T08:51:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.8.log 2024-06-06T08:51:12.867 INFO:teuthology.orchestra.run.smithi059.stderr: 82.6% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-06T08:51:12.875 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-06T08:51:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.k.log 2024-06-06T08:51:12.881 INFO:teuthology.orchestra.run.smithi028.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-06T08:51:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mon.b.log: /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.k.log: 91.0% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-06T08:51:12.885 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-06T08:51:12.886 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.log 2024-06-06T08:51:12.887 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-06T08:51:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.l.log 2024-06-06T08:51:12.888 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.g.log 2024-06-06T08:51:12.889 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.j.log 2024-06-06T08:51:12.890 INFO:teuthology.orchestra.run.smithi028.stderr: 86.7% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-06T08:51:12.890 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.3.log 2024-06-06T08:51:12.892 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.j.log: 90.2% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-06T08:51:12.892 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.0.log 2024-06-06T08:51:12.893 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mgr.x.log 2024-06-06T08:51:12.894 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.3.log: /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.0.log: 94.6% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.j.log.gz 2024-06-06T08:51:12.895 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mon.a.log 2024-06-06T08:51:12.896 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.6.log 2024-06-06T08:51:12.896 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mgr.x.log: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-06T08:51:12.897 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-06T08:51:12.899 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.a.log 2024-06-06T08:51:12.901 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.cephadm.log: 83.0% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-06T08:51:12.901 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-06T08:51:12.904 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.d.log 2024-06-06T08:51:12.908 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.9.log 2024-06-06T08:51:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-volume.log: /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-06T08:51:12.922 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.9.log: 94.5% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.d.log.gz 2024-06-06T08:51:12.930 INFO:teuthology.orchestra.run.smithi028.stderr: 91.0% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-06T08:51:13.055 INFO:teuthology.orchestra.run.smithi028.stderr: 94.2% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.g.log.gz 2024-06-06T08:51:13.090 INFO:teuthology.orchestra.run.smithi028.stderr: 94.4% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.a.log.gz 2024-06-06T08:51:13.173 INFO:teuthology.orchestra.run.smithi028.stderr: 90.0% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mgr.x.log.gz 2024-06-06T08:51:13.222 INFO:teuthology.orchestra.run.smithi059.stderr: 91.8% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mon.c.log.gz 2024-06-06T08:51:13.263 INFO:teuthology.orchestra.run.smithi059.stderr: 93.9% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.l.log.gz 2024-06-06T08:51:13.330 INFO:teuthology.orchestra.run.smithi037.stderr: 91.8% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mon.b.log.gz 2024-06-06T08:51:13.375 INFO:teuthology.orchestra.run.smithi037.stderr: 94.7% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.k.log.gz 2024-06-06T08:51:13.757 INFO:teuthology.orchestra.run.smithi059.stderr: 94.0% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.c.log.gz 2024-06-06T08:51:13.904 INFO:teuthology.orchestra.run.smithi028.stderr: 90.4% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mon.a.log.gz 2024-06-06T08:51:14.104 INFO:teuthology.orchestra.run.smithi028.stderr: 92.1% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.9.log.gz 2024-06-06T08:51:14.177 INFO:teuthology.orchestra.run.smithi059.stderr: 95.2% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.f.log.gz 2024-06-06T08:51:14.192 INFO:teuthology.orchestra.run.smithi037.stderr: 94.0% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.e.log.gz 2024-06-06T08:51:14.416 INFO:teuthology.orchestra.run.smithi028.stderr: 91.9% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.0.log.gz 2024-06-06T08:51:14.454 INFO:teuthology.orchestra.run.smithi037.stderr: 92.1% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.4.log.gz 2024-06-06T08:51:14.466 INFO:teuthology.orchestra.run.smithi028.stderr: 91.8% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.3.log.gz 2024-06-06T08:51:14.579 INFO:teuthology.orchestra.run.smithi059.stderr: 94.0% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.i.log.gz 2024-06-06T08:51:14.610 INFO:teuthology.orchestra.run.smithi059.stderr: 92.0% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.11.log.gz 2024-06-06T08:51:14.640 INFO:teuthology.orchestra.run.smithi059.stderr: 91.8% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.5.log.gz 2024-06-06T08:51:14.766 INFO:teuthology.orchestra.run.smithi037.stderr: 92.1% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.10.log.gz 2024-06-06T08:51:14.873 INFO:teuthology.orchestra.run.smithi059.stderr: 92.4% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.8.log.gz 2024-06-06T08:51:15.005 INFO:teuthology.orchestra.run.smithi028.stderr: 92.5% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.6.log.gz 2024-06-06T08:51:15.009 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-06-06T08:51:15.009 INFO:teuthology.orchestra.run.smithi028.stderr:real 0m2.152s 2024-06-06T08:51:15.009 INFO:teuthology.orchestra.run.smithi028.stderr:user 0m7.526s 2024-06-06T08:51:15.009 INFO:teuthology.orchestra.run.smithi028.stderr:sys 0m0.621s 2024-06-06T08:51:15.011 INFO:teuthology.orchestra.run.smithi037.stderr: 94.2% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.h.log.gz 2024-06-06T08:51:15.109 INFO:teuthology.orchestra.run.smithi037.stderr: 91.9% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.7.log.gz 2024-06-06T08:51:15.224 INFO:teuthology.orchestra.run.smithi059.stderr: 92.5% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.2.log.gz 2024-06-06T08:51:15.226 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-06-06T08:51:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m2.385s 2024-06-06T08:51:15.226 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m11.917s 2024-06-06T08:51:15.227 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m0.360s 2024-06-06T08:51:15.350 INFO:teuthology.orchestra.run.smithi037.stderr: 92.4% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-osd.1.log.gz 2024-06-06T08:51:24.437 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/e34a6934-23de-11ef-bc9b-c7b262605968/ceph-mds.b.log.gz 2024-06-06T08:51:24.439 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-06-06T08:51:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m11.598s 2024-06-06T08:51:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m23.177s 2024-06-06T08:51:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m0.655s 2024-06-06T08:51:24.440 INFO:tasks.cephadm:Archiving logs... 2024-06-06T08:51:24.440 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250/remote/smithi028/log 2024-06-06T08:51:24.441 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-06T08:51:25.630 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250/remote/smithi037/log 2024-06-06T08:51:25.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-06T08:51:28.610 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250/remote/smithi059/log 2024-06-06T08:51:28.611 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-06T08:51:30.029 INFO:tasks.cephadm:Removing cluster... 2024-06-06T08:51:30.029 DEBUG:teuthology.orchestra.run.smithi028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e34a6934-23de-11ef-bc9b-c7b262605968 --force 2024-06-06T08:51:30.365 INFO:teuthology.orchestra.run.smithi028.stdout:Deleting cluster with fsid: e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:51:31.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e34a6934-23de-11ef-bc9b-c7b262605968 --force 2024-06-06T08:51:31.248 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:51:31.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e34a6934-23de-11ef-bc9b-c7b262605968 --force 2024-06-06T08:51:31.736 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: e34a6934-23de-11ef-bc9b-c7b262605968 2024-06-06T08:51:32.008 INFO:tasks.cephadm:Removing cephadm ... 2024-06-06T08:51:32.008 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-06T08:51:32.065 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-06T08:51:32.081 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-06T08:51:32.097 INFO:tasks.cephadm:Teardown complete 2024-06-06T08:51:32.098 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-06T08:51:32.108 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-06T08:51:32.108 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-06T08:51:32.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-06T08:51:32.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-06T08:51:32.270 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-06T08:51:32.280 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-06T08:51:32.280 DEBUG:teuthology.orchestra.run.smithi028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T08:51:32.288 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T08:51:32.291 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T08:51:32.304 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-06-06T08:51:32.305 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-06-06T08:51:32.309 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T08:51:32.309 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-06-06T08:51:32.309 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 +75us[ +70us] +/- 54ms 2024-06-06T08:51:32.309 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 -2005us[-2009us] +/- 76ms 2024-06-06T08:51:32.309 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +1825us[+1821us] +/- 71ms 2024-06-06T08:51:32.310 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:51:32.311 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T08:51:32.311 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-06-06T08:51:32.311 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +59us[ +59us] +/- 54ms 2024-06-06T08:51:32.311 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 -2013us[-2013us] +/- 76ms 2024-06-06T08:51:32.311 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +1811us[+1811us] +/- 71ms 2024-06-06T08:51:32.311 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:51:32.333 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: ntpq: command not found 2024-06-06T08:51:32.343 INFO:teuthology.orchestra.run.smithi028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T08:51:32.343 INFO:teuthology.orchestra.run.smithi028.stdout:=============================================================================== 2024-06-06T08:51:32.343 INFO:teuthology.orchestra.run.smithi028.stdout:^* hv01.front.sepia.ceph.com 3 7 377 14 +224us[ +214us] +/- 54ms 2024-06-06T08:51:32.343 INFO:teuthology.orchestra.run.smithi028.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 17 -1809us[-1818us] +/- 76ms 2024-06-06T08:51:32.343 INFO:teuthology.orchestra.run.smithi028.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +1934us[+1925us] +/- 71ms 2024-06-06T08:51:32.344 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T08:51:32.345 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-06T08:51:32.355 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-06T08:51:32.355 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-06T08:51:32.365 DEBUG:teuthology.orchestra.run.smithi028:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-06T08:51:32.523 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-06T08:51:32.593 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-06T08:51:32.660 DEBUG:teuthology.orchestra.run.smithi028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T08:51:32.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:51:32.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T08:51:32.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:51:32.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T08:51:32.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:51:32.803 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-06T08:51:32.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-06T08:51:32.843 INFO:teuthology.task.internal:Duration was 1818.068663 seconds 2024-06-06T08:51:32.844 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-06T08:51:32.855 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-06T08:51:32.855 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-06T08:51:32.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-06T08:51:32.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-06T08:51:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T08:51:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T08:51:33.000 INFO:teuthology.orchestra.run.smithi028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T08:51:33.388 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-06T08:51:33.389 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi028.front.sepia.ceph.com 2024-06-06T08:51:33.389 DEBUG:teuthology.orchestra.run.smithi028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-06T08:51:33.452 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-06-06T08:51:33.452 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-06T08:51:33.480 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-06-06T08:51:33.480 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-06T08:51:33.512 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-06T08:51:33.512 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-06T08:51:33.519 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-06T08:51:33.523 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-06T08:51:33.596 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-06T08:51:33.596 DEBUG:teuthology.orchestra.run.smithi028:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-06T08:51:33.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-06T08:51:33.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-06T08:51:34.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-06T08:51:34.264 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-06T08:51:34.264 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-06T08:51:34.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-06T08:51:34.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-06T08:51:34.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-06T08:51:34.415 DEBUG:teuthology.orchestra.run.smithi028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-06T08:51:34.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-06T08:51:34.426 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-06T08:51:34.447 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-06-06T08:51:34.468 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-06-06T08:51:34.518 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = core 2024-06-06T08:51:34.563 DEBUG:teuthology.orchestra.run.smithi028:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-06T08:51:34.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:51:34.613 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-06T08:51:34.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:51:34.629 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-06T08:51:34.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T08:51:34.644 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-06T08:51:34.656 INFO:teuthology.task.internal:Transferring archived files... 2024-06-06T08:51:34.657 DEBUG:teuthology.misc:Transferring archived files from smithi028:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250/remote/smithi028 2024-06-06T08:51:34.657 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-06T08:51:34.777 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250/remote/smithi037 2024-06-06T08:51:34.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-06T08:51:34.815 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-05_21:24:16-fs-squid-distro-default-smithi/7743250/remote/smithi059 2024-06-06T08:51:34.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-06T08:51:34.852 INFO:teuthology.task.internal:Removing archive directory... 2024-06-06T08:51:34.853 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-06T08:51:34.861 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-06T08:51:34.863 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-06T08:51:34.911 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-06T08:51:34.925 INFO:teuthology.task.internal:Not uploading archives. 2024-06-06T08:51:34.925 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-06T08:51:34.935 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-06T08:51:34.936 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-06T08:51:34.941 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-06T08:51:34.944 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-06T08:51:34.957 INFO:teuthology.orchestra.run.smithi037.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 6 08:51 /home/ubuntu/cephtest 2024-06-06T08:51:34.959 INFO:teuthology.orchestra.run.smithi059.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 6 08:51 /home/ubuntu/cephtest 2024-06-06T08:51:34.991 INFO:teuthology.orchestra.run.smithi028.stdout: 393243 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 6 08:51 /home/ubuntu/cephtest 2024-06-06T08:51:34.994 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-06T08:51:35.005 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-06T08:51:35.030 INFO:teuthology.run:Summary data: client.0-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsx}} duration: 1818.0686633586884 failure_reason: 'Command failed (workunit test suites/fsx.sh) on smithi028 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d746ca5346f34eef7e826a1eb71e59e02b682ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=0ad6675325f547549222eece543febdb status: fail success: false 2024-06-06T08:51:35.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-06T08:51:35.122 INFO:teuthology.run:FAIL